Jul 06 01:24:45.911643 ip-10-0-128-8 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 06 01:24:45.911654 ip-10-0-128-8 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 06 01:24:45.911663 ip-10-0-128-8 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 06 01:24:45.911956 ip-10-0-128-8 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 06 01:24:56.101205 ip-10-0-128-8 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 06 01:24:56.101222 ip-10-0-128-8 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 7b66db73e7cf42b0ab139b8716a8a9ad --
Jul 06 01:26:29.767378 ip-10-0-128-8 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 01:26:30.261739 ip-10-0-128-8 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 01:26:30.261739 ip-10-0-128-8 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 01:26:30.261739 ip-10-0-128-8 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 01:26:30.261739 ip-10-0-128-8 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 01:26:30.261739 ip-10-0-128-8 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 01:26:30.261739 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.234967    2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 01:26:30.261739 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240422    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 01:26:30.261739 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240443    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 01:26:30.261739 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240447    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 01:26:30.261739 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240450    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 01:26:30.261739 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240454    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 01:26:30.261739 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240456    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 01:26:30.261739 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240460    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 01:26:30.261739 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240462    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 01:26:30.422341 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240465    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 01:26:30.422341 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240468    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 01:26:30.422341 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240470    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 01:26:30.422341 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240473    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 01:26:30.422341 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240476    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 01:26:30.422341 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240479    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 01:26:30.422341 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240481    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 01:26:30.422341 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240484    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 01:26:30.422341 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240487    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 01:26:30.422341 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240489    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 01:26:30.422341 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240492    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 01:26:30.422341 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240495    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 01:26:30.422341 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240498    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 01:26:30.422341 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240501    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 01:26:30.422341 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240512    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 01:26:30.422341 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240516    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 01:26:30.422341 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240519    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 01:26:30.422341 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240523    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 01:26:30.422341 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240526    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 01:26:30.422341 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240529    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 01:26:30.319124 ip-10-0-128-8 systemd[1]: Started Kubernetes Kubelet.
Jul 06 01:26:30.423334 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240532    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 01:26:30.423334 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240535    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 01:26:30.423334 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240538    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 01:26:30.423334 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240541    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 01:26:30.423334 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240543    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 01:26:30.423334 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240546    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 01:26:30.423334 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240549    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 01:26:30.423334 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240552    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 01:26:30.423334 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240554    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 01:26:30.423334 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240557    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 01:26:30.423334 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240559    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 01:26:30.423334 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240562    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 01:26:30.423334 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240564    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 01:26:30.423334 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240568    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 01:26:30.423334 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240570    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 01:26:30.423334 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240573    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 01:26:30.423334 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240576    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 01:26:30.423334 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240579    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 01:26:30.423334 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240581    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 01:26:30.423334 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240584    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 01:26:30.424866 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240586    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 01:26:30.424866 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240589    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 01:26:30.424866 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240592    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 01:26:30.424866 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240594    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 01:26:30.424866 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240597    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 01:26:30.424866 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240600    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 01:26:30.424866 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240603    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 01:26:30.424866 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240605    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 01:26:30.424866 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240608    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 01:26:30.424866 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240611    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 01:26:30.424866 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240613    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 01:26:30.424866 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240616    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 01:26:30.424866 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240618    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 01:26:30.424866 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240621    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 01:26:30.424866 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240623    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 01:26:30.424866 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240626    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 01:26:30.424866 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240628    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 01:26:30.424866 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240631    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 01:26:30.424866 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240634    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 01:26:30.424866 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240636    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 01:26:30.430102 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240639    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 01:26:30.430102 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240641    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 01:26:30.430102 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240644    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 01:26:30.430102 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240647    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 01:26:30.430102 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240652    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 01:26:30.430102 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240656    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 01:26:30.430102 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240659    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 01:26:30.430102 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240662    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 01:26:30.430102 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240665    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 01:26:30.430102 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240668    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 01:26:30.430102 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240671    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 01:26:30.430102 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240675    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 01:26:30.430102 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240677    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 01:26:30.430102 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240680    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 01:26:30.430102 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240683    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 01:26:30.430102 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240685    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 01:26:30.430102 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240688    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 01:26:30.430102 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240691    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 01:26:30.430102 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240694    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 01:26:30.431321 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240696    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 01:26:30.431321 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240699    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 01:26:30.431321 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240701    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 01:26:30.431321 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240704    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 01:26:30.431321 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240707    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 01:26:30.431321 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240709    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 01:26:30.431321 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240712    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 01:26:30.431321 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240714    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 01:26:30.431321 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240716    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 01:26:30.431321 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240719    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 01:26:30.431321 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240722    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 01:26:30.431321 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.240728    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 01:26:30.431321 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241507    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 01:26:30.431321 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241516    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 01:26:30.431321 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241519    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 01:26:30.431321 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241523    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 01:26:30.431321 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241527    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 01:26:30.431321 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241530    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 01:26:30.431321 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241533    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 01:26:30.431321 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241536    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 01:26:30.432346 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241539    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 01:26:30.432346 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241543    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 01:26:30.432346 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241547    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 01:26:30.432346 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241550    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 01:26:30.432346 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241553    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 01:26:30.432346 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241556    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 01:26:30.432346 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241559    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 01:26:30.432346 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241562    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 01:26:30.432346 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241565    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 01:26:30.432346 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241567    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 01:26:30.432346 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241570    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 01:26:30.432346 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241573    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 01:26:30.432346 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241575    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 01:26:30.432346 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241578    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 01:26:30.432346 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241582    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 01:26:30.432346 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241585    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 01:26:30.432346 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241589    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 01:26:30.432346 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241592    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 01:26:30.432346 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241596    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 01:26:30.432346 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241599    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 01:26:30.433503 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241602    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 01:26:30.433503 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241604    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 01:26:30.433503 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241607    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 01:26:30.433503 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241610    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 01:26:30.433503 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241612    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 01:26:30.433503 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241615    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 01:26:30.433503 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241618    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 01:26:30.433503 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241621    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 01:26:30.433503 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241623    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 01:26:30.433503 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241626    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 01:26:30.433503 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241628    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 01:26:30.433503 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241630    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 01:26:30.433503 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241633    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 01:26:30.433503 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241636    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 01:26:30.433503 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241638    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 01:26:30.433503 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241642    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 01:26:30.433503 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241645    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 01:26:30.433503 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241647    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 01:26:30.433503 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241651    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 01:26:30.433503 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241654    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 01:26:30.433503 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241656    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 01:26:30.434481 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241659    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 01:26:30.434481 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241661    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 01:26:30.434481 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241664    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 01:26:30.434481 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241666    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 01:26:30.434481 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241669    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 01:26:30.434481 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241671    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 01:26:30.434481 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241674    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 01:26:30.434481 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241676    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 01:26:30.434481 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241680    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 01:26:30.434481 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241684    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 01:26:30.434481 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241688    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 01:26:30.434481 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241691    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 01:26:30.434481 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241695    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 01:26:30.434481 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241697    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 01:26:30.434481 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241701    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 01:26:30.434481 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241704    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 01:26:30.434481 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241707    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 01:26:30.434481 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241709    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 01:26:30.435471 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241712    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 01:26:30.435471 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241714    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 01:26:30.435471 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241717    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 01:26:30.435471 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241719    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 01:26:30.435471 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241722    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 01:26:30.435471 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241726    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 01:26:30.435471 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241728    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 01:26:30.435471 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241731    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 01:26:30.435471 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241735    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 01:26:30.435471 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241740    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 01:26:30.435471 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241743    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 01:26:30.435471 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241747    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 01:26:30.435471 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241750    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 01:26:30.435471 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241753    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 01:26:30.435471 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241756    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 01:26:30.435471 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241758    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 01:26:30.435471 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241761    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 01:26:30.435471 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241764    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 01:26:30.435471 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241766    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 01:26:30.437672 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241769    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 01:26:30.437672 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241771    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 01:26:30.437672 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241774    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 01:26:30.437672 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241776    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 01:26:30.437672 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241779    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 01:26:30.437672 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241781    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 01:26:30.437672 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241784    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 01:26:30.437672 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241787    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 01:26:30.437672 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241790    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 01:26:30.437672 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241793    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 01:26:30.437672 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241796    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 01:26:30.437672 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241798    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 01:26:30.437672 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.241801    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 01:26:30.437672 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242231    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 01:26:30.437672 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242237    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 01:26:30.437672 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242240    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 01:26:30.437672 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242244    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 01:26:30.437672 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242246    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 01:26:30.437672 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242249    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 01:26:30.438682 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242253    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 01:26:30.438682 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242255    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 01:26:30.438682 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242258    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 01:26:30.438682 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242260    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 01:26:30.438682 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242264    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 01:26:30.438682 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242266    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 01:26:30.438682 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242269    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 01:26:30.438682 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242272    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 01:26:30.438682 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242275    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 01:26:30.438682 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242278    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 01:26:30.438682 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242280    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 01:26:30.438682 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242283    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 01:26:30.438682 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242285    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 01:26:30.438682 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242288    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 01:26:30.438682 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242292    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 01:26:30.438682 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242294    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 01:26:30.438682 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242297    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 01:26:30.438682 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242300    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 01:26:30.438682 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242303    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 01:26:30.438682 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242305    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 01:26:30.440239 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242308    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 01:26:30.440239 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242311    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 01:26:30.440239 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242314    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 01:26:30.440239 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242317    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 01:26:30.440239 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242322    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 01:26:30.440239 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242326    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 01:26:30.440239 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242329    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 01:26:30.440239 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242332    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 01:26:30.440239 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242335    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 01:26:30.440239 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242338    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 01:26:30.440239 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242341    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 01:26:30.440239 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242345    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 01:26:30.440239 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242347    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 01:26:30.440239 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242350    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 01:26:30.440239 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242352    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 01:26:30.440239 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242355    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 01:26:30.440239 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242357    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 01:26:30.440239 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242360    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 01:26:30.440239 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242362    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 01:26:30.442547 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242365    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 01:26:30.442547 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242368    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 01:26:30.442547 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242371    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 01:26:30.442547 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242377    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 01:26:30.442547 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242380    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 01:26:30.442547 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242382    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 01:26:30.442547 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242385    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 01:26:30.442547 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242387    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 01:26:30.442547 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242390    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 01:26:30.442547 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242392    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 01:26:30.442547 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242396    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 01:26:30.442547 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242404    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 01:26:30.442547 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242407    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 01:26:30.442547 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242409    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 01:26:30.442547 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242412    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 01:26:30.442547 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242414    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 01:26:30.442547 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242417    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 01:26:30.442547 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242420    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 01:26:30.442547 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242422    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 01:26:30.442547 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242425    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 01:26:30.444995 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242427    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 01:26:30.444995 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242431    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 01:26:30.444995 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242434    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 01:26:30.444995 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242436    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 01:26:30.444995 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242439    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 01:26:30.444995 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242441    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 01:26:30.444995 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242444    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 01:26:30.444995 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242446    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 01:26:30.444995 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242449    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 01:26:30.444995 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242452    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 01:26:30.444995 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242455    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 01:26:30.444995 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242458    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 01:26:30.444995 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242462    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 01:26:30.444995 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242466    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 01:26:30.444995 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242469    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 01:26:30.444995 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242474    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 01:26:30.444995 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242477    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 01:26:30.444995 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242479    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 01:26:30.444995 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242482    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 01:26:30.447253 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242484    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 01:26:30.447253 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242487    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 01:26:30.447253 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242490    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 01:26:30.447253 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242492    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 01:26:30.447253 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242496    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 01:26:30.447253 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242498    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 01:26:30.447253 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242501    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 01:26:30.447253 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242504    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 01:26:30.447253 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242506    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 01:26:30.447253 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242509    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 01:26:30.447253 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242511    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 01:26:30.447253 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242514    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 01:26:30.447253 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242516    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 01:26:30.447253 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242519    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 01:26:30.447253 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.242522    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 01:26:30.447253 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242603    2584 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 01:26:30.447253 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242611    2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 01:26:30.447253 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242619    2584 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 01:26:30.447253 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242625    2584 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 01:26:30.447253 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242629    2584 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 01:26:30.447253 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242632    2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 01:26:30.449553 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242637    2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 01:26:30.449553 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242642    2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 01:26:30.449553 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242645    2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 01:26:30.449553 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242648    2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 01:26:30.449553 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242652    2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 01:26:30.449553 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242655    2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 01:26:30.449553 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242659    2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 01:26:30.449553 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242664    2584 flags.go:64] FLAG: --cgroup-root=""
Jul 06 01:26:30.449553 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242667    2584 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 01:26:30.449553 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242670    2584 flags.go:64] FLAG: --client-ca-file=""
Jul 06 01:26:30.449553 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242673    2584 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 01:26:30.449553 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242676    2584 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 01:26:30.449553 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242680    2584 flags.go:64] FLAG: --cluster-domain=""
Jul 06 01:26:30.449553 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242683    2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 01:26:30.449553 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242686    2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 01:26:30.449553 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242690    2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 01:26:30.449553 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242694    2584 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 01:26:30.449553 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242698    2584 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 01:26:30.449553 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242701    2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 01:26:30.449553 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242704    2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 01:26:30.449553 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242708    2584 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 01:26:30.449553 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242711    2584 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 01:26:30.449553 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242714    2584 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 01:26:30.449553 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242717    2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 01:26:30.451815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242720    2584 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 01:26:30.451815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242723    2584 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 01:26:30.451815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242727    2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 01:26:30.451815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242731    2584 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 01:26:30.451815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242734    2584 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 01:26:30.451815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242736    2584 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 01:26:30.451815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242739    2584 flags.go:64] FLAG: --enable-server="true"
Jul 06 01:26:30.451815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242742    2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 01:26:30.451815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242747    2584 flags.go:64] FLAG: --event-burst="100"
Jul 06 01:26:30.451815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242750    2584 flags.go:64] FLAG: --event-qps="50"
Jul 06 01:26:30.451815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242753    2584 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 01:26:30.451815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242756    2584 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 01:26:30.451815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242759    2584 flags.go:64] FLAG: --eviction-hard=""
Jul 06 01:26:30.451815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242763    2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 01:26:30.451815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242766    2584 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 01:26:30.451815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242772    2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 01:26:30.451815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242775    2584 flags.go:64] FLAG: --eviction-soft=""
Jul 06 01:26:30.451815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242778    2584 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 01:26:30.451815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242781    2584 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 01:26:30.451815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242784    2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 01:26:30.451815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242787    2584 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 01:26:30.451815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242790    2584 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 01:26:30.451815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242793    2584 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 01:26:30.451815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242797    2584 flags.go:64] FLAG: --feature-gates=""
Jul 06 01:26:30.451815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242802    2584 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 01:26:30.453185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242805    2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 01:26:30.453185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242808    2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 01:26:30.453185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242811    2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 01:26:30.453185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242815    2584 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 01:26:30.453185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242819    2584 flags.go:64] FLAG: --help="false"
Jul 06 01:26:30.453185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242823    2584 flags.go:64] FLAG: --hostname-override="ip-10-0-128-8.ec2.internal"
Jul 06 01:26:30.453185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242827    2584 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 01:26:30.453185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242830    2584 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 01:26:30.453185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242833    2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 01:26:30.453185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242837    2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 01:26:30.453185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242840    2584 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 01:26:30.453185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242843    2584 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 01:26:30.453185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242846    2584 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 01:26:30.453185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242849    2584 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 01:26:30.453185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242851    2584 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 01:26:30.453185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242854    2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 01:26:30.453185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242858    2584 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 01:26:30.453185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242861    2584 flags.go:64] FLAG: --kube-reserved=""
Jul 06 01:26:30.453185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242864    2584 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 01:26:30.453185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242867    2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 01:26:30.453185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242870    2584 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 01:26:30.453185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242873    2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 01:26:30.453185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242877    2584 flags.go:64] FLAG: --lock-file=""
Jul 06 01:26:30.453185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242882    2584 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 01:26:30.454844 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242885    2584 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 01:26:30.454844 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242888    2584 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 01:26:30.454844 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242893    2584 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 01:26:30.454844 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242896    2584 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 01:26:30.454844 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242899    2584 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 01:26:30.454844 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242903    2584 flags.go:64] FLAG: --logging-format="text"
Jul 06 01:26:30.454844 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242907    2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 01:26:30.454844 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242911    2584 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 01:26:30.454844 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242914    2584 flags.go:64] FLAG: --manifest-url=""
Jul 06 01:26:30.454844 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242917    2584 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 01:26:30.454844 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242921    2584 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 01:26:30.454844 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242924    2584 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 01:26:30.454844 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242929    2584 flags.go:64] FLAG: --max-pods="110"
Jul 06 01:26:30.454844 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242932    2584 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 01:26:30.454844 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242935    2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 01:26:30.454844 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242938    2584 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 01:26:30.454844 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242941    2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 01:26:30.454844 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242944    2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 01:26:30.454844 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242947    2584 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 01:26:30.454844 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242950    2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 01:26:30.454844 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242958    2584 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 01:26:30.454844 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242961    2584 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 01:26:30.454844 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242964    2584 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 01:26:30.454844 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242967    2584 flags.go:64] FLAG: --pod-cidr=""
Jul 06 01:26:30.456325 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242970    2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 01:26:30.456325 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242976    2584 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 01:26:30.456325 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242979    2584 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 01:26:30.456325 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242982    2584 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 01:26:30.456325 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242985    2584 flags.go:64] FLAG: --port="10250"
Jul 06 01:26:30.456325 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242988    2584 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 01:26:30.456325 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242993    2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-075f6eb6743a3bc1d"
Jul 06 01:26:30.456325 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242996    2584 flags.go:64] FLAG: --qos-reserved=""
Jul 06 01:26:30.456325 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.242999    2584 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 01:26:30.456325 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243003    2584 flags.go:64] FLAG: --register-node="true"
Jul 06 01:26:30.456325 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243023    2584 flags.go:64] FLAG: --register-with-taints=""
Jul 06 01:26:30.456325 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243027    2584 flags.go:64] FLAG: --registry-burst="10"
Jul 06 01:26:30.456325 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243030    2584 flags.go:64] FLAG: --registry-qps="5"
Jul 06 01:26:30.456325 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243033    2584 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 01:26:30.456325 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243036    2584 flags.go:64] FLAG: --reserved-memory=""
Jul 06 01:26:30.456325 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243042    2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 01:26:30.456325 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243045    2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 01:26:30.456325 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243048    2584 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 01:26:30.456325 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243051    2584 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 01:26:30.456325 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243054    2584 flags.go:64] FLAG: --runonce="false"
Jul 06 01:26:30.456325 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243057    2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 01:26:30.456325 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243060    2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 01:26:30.456325 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243063    2584 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 01:26:30.456325 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243066    2584 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 01:26:30.456325 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243069    2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 01:26:30.457736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243072    2584 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 01:26:30.457736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243075    2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 01:26:30.457736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243079    2584 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 01:26:30.457736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243082    2584 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 01:26:30.457736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243084    2584 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 01:26:30.457736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243087    2584 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 01:26:30.457736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243090    2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 01:26:30.457736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243093    2584 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 01:26:30.457736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243096    2584 flags.go:64] FLAG: --system-cgroups=""
Jul 06 01:26:30.457736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243099    2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 01:26:30.457736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243104    2584 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 01:26:30.457736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243107    2584 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 01:26:30.457736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243110    2584 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 01:26:30.457736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243116    2584 flags.go:64] FLAG: --tls-min-version=""
Jul 06 01:26:30.457736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243118    2584 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 01:26:30.457736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243121    2584 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 01:26:30.457736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243125    2584 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 01:26:30.457736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243129    2584 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 01:26:30.457736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243132    2584 flags.go:64] FLAG: --v="2"
Jul 06 01:26:30.457736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243136    2584 flags.go:64] FLAG: --version="false"
Jul 06 01:26:30.457736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243140    2584 flags.go:64] FLAG: --vmodule=""
Jul 06 01:26:30.457736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243144    2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 01:26:30.457736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243148    2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 01:26:30.457736 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243273    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 01:26:30.457736 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243277    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 01:26:30.458756 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243280    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 01:26:30.458756 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243283    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 01:26:30.458756 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243286    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 01:26:30.458756 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243289    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 01:26:30.458756 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243291    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 01:26:30.458756 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243294    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 01:26:30.458756 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243297    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 01:26:30.458756 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243300    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 01:26:30.458756 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243302    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 01:26:30.458756 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243305    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 01:26:30.458756 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243308    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 01:26:30.458756 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243311    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 01:26:30.458756 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243313    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 01:26:30.458756 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243316    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 01:26:30.458756 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243318    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 01:26:30.458756 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243321    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 01:26:30.458756 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243323    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 01:26:30.458756 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243326    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 01:26:30.458756 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243328    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 01:26:30.459654 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243331    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 01:26:30.459654 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243335    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 01:26:30.459654 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243339    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 01:26:30.459654 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243342    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 01:26:30.459654 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243345    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 01:26:30.459654 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243349    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 01:26:30.459654 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243352    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 01:26:30.459654 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243355    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 01:26:30.459654 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243358    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 01:26:30.459654 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243361    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 01:26:30.459654 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243365    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 01:26:30.459654 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243368    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 01:26:30.459654 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243371    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 01:26:30.459654 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243374    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 01:26:30.459654 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243377    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 01:26:30.459654 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243379    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 01:26:30.459654 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243382    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 01:26:30.459654 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243385    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 01:26:30.459654 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243388    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 01:26:30.460562 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243391    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 01:26:30.460562 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243393    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 01:26:30.460562 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243396    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 01:26:30.460562 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243398    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 01:26:30.460562 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243401    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 01:26:30.460562 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243403    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 01:26:30.460562 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243407    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 01:26:30.460562 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243410    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 01:26:30.460562 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243413    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 01:26:30.460562 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243415    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 01:26:30.460562 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243418    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 01:26:30.460562 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243420    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 01:26:30.460562 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243423    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 01:26:30.460562 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243426    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 01:26:30.460562 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243429    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 01:26:30.460562 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243432    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 01:26:30.460562 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243435    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 01:26:30.460562 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243437    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 01:26:30.460562 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243440    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 01:26:30.460562 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243443    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 01:26:30.461444 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243446    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 01:26:30.461444 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243448    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 01:26:30.461444 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243451    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 01:26:30.461444 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243455    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 01:26:30.461444 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243457    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 01:26:30.461444 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243460    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 01:26:30.461444 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243463    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 01:26:30.461444 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243465    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 01:26:30.461444 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243468    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 01:26:30.461444 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243470    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 01:26:30.461444 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243473    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 01:26:30.461444 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243475    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 01:26:30.461444 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243478    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 01:26:30.461444 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243480    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 01:26:30.461444 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243483    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 01:26:30.461444 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243485    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 01:26:30.461444 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243488    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 01:26:30.461444 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243490    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 01:26:30.461444 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243493    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 01:26:30.461444 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243496    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 01:26:30.463021 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243498    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 01:26:30.463021 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243502    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 01:26:30.463021 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243505    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 01:26:30.463021 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243508    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 01:26:30.463021 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243511    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 01:26:30.463021 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243514    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 01:26:30.463021 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243519    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 01:26:30.463021 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243521    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 01:26:30.463021 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243524    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 01:26:30.463021 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243526    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 01:26:30.463021 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243529    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 01:26:30.463021 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243531    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 01:26:30.463021 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243534    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 01:26:30.463021 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243537    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 01:26:30.463021 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243539    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 01:26:30.463021 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243543    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 01:26:30.463021 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243546    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 01:26:30.463021 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243549    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 01:26:30.463021 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.243551    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 01:26:30.463908 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.243557    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 01:26:30.463908 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.252190    2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 01:26:30.463908 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.252213    2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 01:26:30.463908 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.252231    2584 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 01:26:30.463908 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.252237    2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 01:26:30.463908 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252300    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 01:26:30.463908 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252305    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 01:26:30.463908 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252309    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 01:26:30.463908 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252313    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 01:26:30.463908 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252318    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 01:26:30.463908 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252321    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 01:26:30.463908 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252324    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 01:26:30.463908 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252327    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 01:26:30.463908 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252330    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 01:26:30.465628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252333    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 01:26:30.465628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252336    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 01:26:30.465628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252339    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 01:26:30.465628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252342    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 01:26:30.465628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252345    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 01:26:30.465628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252348    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 01:26:30.465628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252351    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 01:26:30.465628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252354    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 01:26:30.465628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252357    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 01:26:30.465628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252360    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 01:26:30.465628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252362    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 01:26:30.465628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252365    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 01:26:30.465628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252368    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 01:26:30.465628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252371    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 01:26:30.465628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252374    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 01:26:30.465628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252377    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 01:26:30.465628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252380    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 01:26:30.465628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252383    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 01:26:30.465628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252385    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 01:26:30.465628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252388    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 01:26:30.466462 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252392    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 01:26:30.466462 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252394    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 01:26:30.466462 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252397    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 01:26:30.466462 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252400    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 01:26:30.466462 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252402    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 01:26:30.466462 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252407    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 01:26:30.466462 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252411    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 01:26:30.466462 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252414    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 01:26:30.466462 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252416    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 01:26:30.466462 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252423    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 01:26:30.466462 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252426    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 01:26:30.466462 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252429    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 01:26:30.466462 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252433    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 01:26:30.466462 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252437    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 01:26:30.466462 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252440    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 01:26:30.466462 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252444    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 01:26:30.466462 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252446    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 01:26:30.466462 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252449    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 01:26:30.466462 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252452    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 01:26:30.467722 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252455    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 01:26:30.467722 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252458    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 01:26:30.467722 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252461    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 01:26:30.467722 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252463    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 01:26:30.467722 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252466    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 01:26:30.467722 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252471    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 01:26:30.467722 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252473    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 01:26:30.467722 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252476    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 01:26:30.467722 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252479    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 01:26:30.467722 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252481    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 01:26:30.467722 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252484    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 01:26:30.467722 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252487    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 01:26:30.467722 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252489    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 01:26:30.467722 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252492    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 01:26:30.467722 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252495    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 01:26:30.467722 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252498    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 01:26:30.467722 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252501    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 01:26:30.467722 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252503    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 01:26:30.467722 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252506    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 01:26:30.467722 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252508    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 01:26:30.468551 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252511    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 01:26:30.468551 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252514    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 01:26:30.468551 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252518    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 01:26:30.468551 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252521    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 01:26:30.468551 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252524    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 01:26:30.468551 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252526    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 01:26:30.468551 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252529    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 01:26:30.468551 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252531    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 01:26:30.468551 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252534    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 01:26:30.468551 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252536    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 01:26:30.468551 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252539    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 01:26:30.468551 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252542    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 01:26:30.468551 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252544    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 01:26:30.468551 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252547    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 01:26:30.468551 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252550    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 01:26:30.468551 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252553    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 01:26:30.468551 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252555    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 01:26:30.468551 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252559    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 01:26:30.468551 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252562    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 01:26:30.468551 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252565    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 01:26:30.469167 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252568    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 01:26:30.469167 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252570    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 01:26:30.469167 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252573    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 01:26:30.469167 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252576    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 01:26:30.469167 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252579    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 01:26:30.469167 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252581    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 01:26:30.469167 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252584    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 01:26:30.469167 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252587    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 01:26:30.469167 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252589    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 01:26:30.469167 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252592    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 01:26:30.469167 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252595    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 01:26:30.469167 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.252600    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 01:26:30.469167 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252719    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 01:26:30.469167 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252725    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 01:26:30.469803 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252729    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 01:26:30.469803 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252732    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 01:26:30.469803 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252735    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 01:26:30.469803 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252738    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 01:26:30.469803 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252740    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 01:26:30.469803 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252743    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 01:26:30.469803 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252746    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 01:26:30.469803 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252748    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 01:26:30.469803 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252751    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 01:26:30.469803 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252753    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 01:26:30.469803 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252756    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 01:26:30.469803 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252759    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 01:26:30.469803 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252761    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 01:26:30.469803 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252764    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 01:26:30.469803 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252766    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 01:26:30.469803 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252769    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 01:26:30.469803 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252773    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 01:26:30.469803 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252775    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 01:26:30.469803 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252778    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 01:26:30.469803 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252780    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 01:26:30.470436 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252784    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 01:26:30.470436 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252788    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 01:26:30.470436 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252791    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 01:26:30.470436 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252794    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 01:26:30.470436 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252796    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 01:26:30.470436 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252799    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 01:26:30.470436 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252802    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 01:26:30.470436 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252805    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 01:26:30.470436 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252807    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 01:26:30.470436 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252810    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 01:26:30.470436 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252813    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 01:26:30.470436 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252815    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 01:26:30.470436 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252819    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 01:26:30.470436 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252822    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 01:26:30.470436 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252825    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 01:26:30.470436 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252828    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 01:26:30.470436 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252830    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 01:26:30.470436 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252833    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 01:26:30.470436 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252836    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 01:26:30.527687 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252838    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 01:26:30.527687 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252841    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 01:26:30.527687 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252844    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 01:26:30.527687 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252846    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 01:26:30.527687 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252849    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 01:26:30.527687 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252852    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 01:26:30.527687 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252854    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 01:26:30.527687 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252857    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 01:26:30.527687 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252861    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 01:26:30.527687 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252865    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 01:26:30.527687 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252869    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 01:26:30.527687 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252871    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 01:26:30.527687 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252874    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 01:26:30.527687 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252877    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 01:26:30.527687 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252880    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 01:26:30.527687 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252882    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 01:26:30.527687 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252885    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 01:26:30.527687 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252888    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 01:26:30.527687 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252891    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 01:26:30.528628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252893    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 01:26:30.528628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252896    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 01:26:30.528628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252899    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 01:26:30.528628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252902    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 01:26:30.528628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252904    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 01:26:30.528628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252907    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 01:26:30.528628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252911    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 01:26:30.528628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252913    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 01:26:30.528628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252916    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 01:26:30.528628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252919    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 01:26:30.528628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252921    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 01:26:30.528628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252924    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 01:26:30.528628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252927    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 01:26:30.528628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252929    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 01:26:30.528628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252932    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 01:26:30.528628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252935    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 01:26:30.528628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252937    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 01:26:30.528628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252941    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 01:26:30.528628 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252944    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 01:26:30.529280 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252947    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 01:26:30.529280 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252950    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 01:26:30.529280 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252953    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 01:26:30.529280 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252957    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 01:26:30.529280 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252960    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 01:26:30.529280 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252963    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 01:26:30.529280 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252966    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 01:26:30.529280 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252968    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 01:26:30.529280 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252971    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 01:26:30.529280 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252973    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 01:26:30.529280 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252976    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 01:26:30.529280 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252979    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 01:26:30.529280 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252981    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 01:26:30.529280 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252984    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 01:26:30.529280 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252986    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 01:26:30.529280 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252989    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 01:26:30.529280 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252992    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 01:26:30.529280 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252994    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 01:26:30.529280 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.252997    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 01:26:30.529280 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:30.253001    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 01:26:30.529925 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.253025    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 01:26:30.529925 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.253175    2584 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 01:26:30.529925 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.255782    2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 01:26:30.529925 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.257490    2584 server.go:1019] "Starting client certificate rotation"
Jul 06 01:26:30.529925 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.257615    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 01:26:30.529925 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.257676    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 01:26:30.529925 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.260453    2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 01:26:30.529925 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.268248    2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 01:26:30.529925 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.279563    2584 log.go:25] "Validated CRI v1 runtime API"
Jul 06 01:26:30.529925 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.282351    2584 log.go:25] "Validated CRI v1 image API"
Jul 06 01:26:30.529925 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.284843    2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 01:26:30.529925 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.287577    2584 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a039c6df-7511-401f-8f32-7cefc18e2b0e:/dev/nvme0n1p3 c2bd322d-99bc-461c-9d3a-5a0670f04da6:/dev/nvme0n1p4]
Jul 06 01:26:30.530769 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.287595    2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 01:26:30.530769 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.293914    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 01:26:30.531615 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.294432    2584 manager.go:216] Machine: {Timestamp:2026-07-06 01:26:30.292962649 +0000 UTC m=+0.410348273 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097346 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b05808f8e306ebe5b31dc3f5bba78 SystemUUID:ec2b0580-8f8e-306e-be5b-31dc3f5bba78 BootID:7b66db73-e7cf-42b0-ab13-9b8716a8a9ad Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:73:16:0d:5f:69 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:73:16:0d:5f:69 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:27:c7:ba:e2:c3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 01:26:30.531615 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.294543    2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 01:26:30.531615 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.294642    2584 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 01:26:30.531615 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.298125    2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 01:26:30.531615 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.298165    2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-8.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 01:26:30.531615 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.299066    2584 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 01:26:30.531615 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.299079    2584 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 01:26:30.531615 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.299087    2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 01:26:30.531615 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.299104    2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 01:26:30.531615 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.301070    2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 01:26:30.531615 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.305800    2584 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 01:26:30.531615 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.305948    2584 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 01:26:30.531615 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.305980    2584 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 01:26:30.531615 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.305991    2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 01:26:30.531615 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.306020    2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 01:26:30.531615 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.306035    2584 kubelet.go:398] "Adding apiserver pod source"
Jul 06 01:26:30.531615 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.306047    2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 01:26:30.531615 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.306478    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.306496    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.310400    2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.313121    2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.313154    2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.314579    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.314595    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.314602    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.314607    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.314616    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.314622    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.314632    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.314637    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.314645    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.314650    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.314659    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.314664    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.314688    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.314694    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:30.316580    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:30.316580    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.318111    2584 server.go:1268] "Started kubelet"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.318168    2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.318205    2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.318490    2584 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.319498    2584 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:30.324310    2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.329196    2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-8.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:30.329197    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-8.ec2.internal.18bf8efbf870ce25  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-8.ec2.internal,UID:ip-10-0-128-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-8.ec2.internal,},FirstTimestamp:2026-07-06 01:26:30.318083621 +0000 UTC m=+0.435469244,LastTimestamp:2026-07-06 01:26:30.318083621 +0000 UTC m=+0.435469244,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-8.ec2.internal,}"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.343669    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xgtkb"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.349250    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xgtkb"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.422048    2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.430136    2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.430143    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:30.430266    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-8.ec2.internal\" not found"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.430992    2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.431042    2584 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.431053    2584 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.431190    2584 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.431202    2584 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 01:26:30.532245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.431610    2584 factory.go:55] Registering systemd factory
Jul 06 01:26:30.533730 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.431627    2584 factory.go:223] Registration of the systemd container factory successfully
Jul 06 01:26:30.533730 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.431863    2584 factory.go:153] Registering CRI-O factory
Jul 06 01:26:30.533730 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.431880    2584 factory.go:223] Registration of the crio container factory successfully
Jul 06 01:26:30.533730 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.431937    2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 01:26:30.533730 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.431975    2584 factory.go:103] Registering Raw factory
Jul 06 01:26:30.533730 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.431990    2584 manager.go:1196] Started watching for new ooms in manager
Jul 06 01:26:30.533730 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.432472    2584 manager.go:349] Starting recovery of all containers
Jul 06 01:26:30.533730 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.487641    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 01:26:30.533730 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.488239    2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 01:26:30.533730 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:30.524913    2584 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-8.ec2.internal\" not found" node="ip-10-0-128-8.ec2.internal"
Jul 06 01:26:30.533730 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:30.530984    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-8.ec2.internal\" not found"
Jul 06 01:26:30.600605 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.543898    2584 manager.go:354] Recovery completed
Jul 06 01:26:30.600605 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.575354    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 01:26:30.602704 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.602615    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 01:26:30.602704 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.602649    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 01:26:30.602704 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.602663    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientPID"
Jul 06 01:26:30.603446 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.603197    2584 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 01:26:30.603446 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.603210    2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 01:26:30.603446 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.603233    2584 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 01:26:30.603446 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.603247    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 01:26:30.671181 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.604051    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 01:26:30.671181 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.604076    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 01:26:30.671181 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.604087    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientPID"
Jul 06 01:26:30.671181 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.605429    2584 policy_none.go:49] "None policy: Start"
Jul 06 01:26:30.671181 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.605445    2584 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 01:26:30.671181 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.605458    2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 01:26:30.671181 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.607401    2584 policy_none.go:47] "Start"
Jul 06 01:26:30.671181 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:30.631699    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-8.ec2.internal\" not found"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.702762    2584 manager.go:337] "Starting Device Plugin manager"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:30.702811    2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.702822    2584 server.go:87] "Starting device plugin registration server"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.703129    2584 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.703139    2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.703257    2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.703357    2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.703365    2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:30.704619    2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:30.704662    2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-8.ec2.internal\" not found"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.733039    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.733079    2584 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.733109    2584 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:30.733142    2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.735732    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.804062    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.809111    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.809142    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.809154    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientPID"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.809179    2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-8.ec2.internal"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.819279    2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-8.ec2.internal"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:30.819306    2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-8.ec2.internal\": node \"ip-10-0-128-8.ec2.internal\" not found"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.834210    2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-8.ec2.internal"]
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.834284    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.835194    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.835222    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.835232    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientPID"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.837697    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.837804    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal"
Jul 06 01:26:30.841037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.837839    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 01:26:30.842218 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.841925    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 01:26:30.842218 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.841955    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 01:26:30.842218 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.841965    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientPID"
Jul 06 01:26:30.842218 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.841925    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 01:26:30.842218 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.842050    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 01:26:30.842218 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.842065    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientPID"
Jul 06 01:26:32.860770 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.844373    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-8.ec2.internal"
Jul 06 01:26:32.860770 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.844398    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 01:26:32.860770 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.845359    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 01:26:32.860770 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.845385    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 01:26:32.860770 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.845398    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeHasSufficientPID"
Jul 06 01:26:32.860770 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:30.848098    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-8.ec2.internal\" not found"
Jul 06 01:26:32.860770 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:30.877947    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-8.ec2.internal\" not found" node="ip-10-0-128-8.ec2.internal"
Jul 06 01:26:32.860770 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:30.882682    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-8.ec2.internal\" not found" node="ip-10-0-128-8.ec2.internal"
Jul 06 01:26:32.860770 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.933232    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71f330f0340bfbcab58413a81f320c47-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal\" (UID: \"71f330f0340bfbcab58413a81f320c47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal"
Jul 06 01:26:32.860770 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.933260    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71f330f0340bfbcab58413a81f320c47-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal\" (UID: \"71f330f0340bfbcab58413a81f320c47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal"
Jul 06 01:26:32.860770 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:30.933282    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a39d0d7260635ade2bf76fa6546e26a1-config\") pod \"kube-apiserver-proxy-ip-10-0-128-8.ec2.internal\" (UID: \"a39d0d7260635ade2bf76fa6546e26a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-8.ec2.internal"
Jul 06 01:26:32.860770 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:30.948338    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-8.ec2.internal\" not found"
Jul 06 01:26:33.007140 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:32.909381    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71f330f0340bfbcab58413a81f320c47-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal\" (UID: \"71f330f0340bfbcab58413a81f320c47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal"
Jul 06 01:26:33.007140 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:32.909571    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71f330f0340bfbcab58413a81f320c47-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal\" (UID: \"71f330f0340bfbcab58413a81f320c47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal"
Jul 06 01:26:33.007140 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:32.909588    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a39d0d7260635ade2bf76fa6546e26a1-config\") pod \"kube-apiserver-proxy-ip-10-0-128-8.ec2.internal\" (UID: \"a39d0d7260635ade2bf76fa6546e26a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-8.ec2.internal"
Jul 06 01:26:33.007140 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:32.909618    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a39d0d7260635ade2bf76fa6546e26a1-config\") pod \"kube-apiserver-proxy-ip-10-0-128-8.ec2.internal\" (UID: \"a39d0d7260635ade2bf76fa6546e26a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-8.ec2.internal"
Jul 06 01:26:33.007140 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:32.909488    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71f330f0340bfbcab58413a81f320c47-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal\" (UID: \"71f330f0340bfbcab58413a81f320c47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal"
Jul 06 01:26:33.007140 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:32.909673    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71f330f0340bfbcab58413a81f320c47-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal\" (UID: \"71f330f0340bfbcab58413a81f320c47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal"
Jul 06 01:26:33.007140 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:32.924502    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-8.ec2.internal\" not found"
Jul 06 01:26:33.079691 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:33.024994    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-8.ec2.internal\" not found"
Jul 06 01:26:33.079691 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:33.057148    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal"
Jul 06 01:26:33.079691 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:33.061268    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-8.ec2.internal"
Jul 06 01:26:33.168951 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:33.125361    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-8.ec2.internal\" not found"
Jul 06 01:26:33.168951 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:33.132533    2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 01:26:33.168951 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:33.132743    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 01:26:33.168951 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:33.132748    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 01:26:33.225458 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:33.225424    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-8.ec2.internal\" not found"
Jul 06 01:26:33.229541 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:33.229514    2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 01:26:33.303339 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:33.303242    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 01:21:32 +0000 UTC" deadline="2028-01-30 18:59:32.95952801 +0000 UTC"
Jul 06 01:26:33.303339 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:33.303281    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13769h32m59.656250796s"
Jul 06 01:26:33.325827 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:33.325801    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-8.ec2.internal\" not found"
Jul 06 01:26:33.426347 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:33.426311    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-8.ec2.internal\" not found"
Jul 06 01:26:33.526952 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:33.526908    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-8.ec2.internal\" not found"
Jul 06 01:26:33.605528 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:33.605496    2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 01:26:33.606892 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:33.606854    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-8.ec2.internal"
Jul 06 01:26:33.616806 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:33.616777    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 01:26:33.617659 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:33.617645    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal"
Jul 06 01:26:33.630258 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:33.630234    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 01:26:33.709869 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:33.709836    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda39d0d7260635ade2bf76fa6546e26a1.slice/crio-61f78f8ab0adb6b12c24bd58cd20e83860ab344ad22a37d8fe62075fead62f24 WatchSource:0}: Error finding container 61f78f8ab0adb6b12c24bd58cd20e83860ab344ad22a37d8fe62075fead62f24: Status 404 returned error can't find the container with id 61f78f8ab0adb6b12c24bd58cd20e83860ab344ad22a37d8fe62075fead62f24
Jul 06 01:26:33.710223 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:33.710200    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71f330f0340bfbcab58413a81f320c47.slice/crio-f670d7726e689aec5806a9b0c7c025f9be7bfc53cfb88192e00f1d2561b6c13b WatchSource:0}: Error finding container f670d7726e689aec5806a9b0c7c025f9be7bfc53cfb88192e00f1d2561b6c13b: Status 404 returned error can't find the container with id f670d7726e689aec5806a9b0c7c025f9be7bfc53cfb88192e00f1d2561b6c13b
Jul 06 01:26:33.714942 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:33.714925    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 01:26:34.041849 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.041764    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 01:26:34.058063 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.058041    2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 01:26:34.181912 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.181883    2584 apiserver.go:52] "Watching apiserver"
Jul 06 01:26:34.190463 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.190433    2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 01:26:34.191599 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.191572    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-9kj2t","kube-system/konnectivity-agent-wkxsp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6","openshift-cluster-node-tuning-operator/tuned-th2j5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal","openshift-multus/multus-additional-cni-plugins-9qmzt","openshift-network-operator/iptables-alerter-9fkfs","openshift-ovn-kubernetes/ovnkube-node-mnnbg","kube-system/global-pull-secret-syncer-tx6kv","kube-system/kube-apiserver-proxy-ip-10-0-128-8.ec2.internal","openshift-dns/node-resolver-zzmqr","openshift-image-registry/node-ca-bphvc","openshift-multus/multus-5gfv5","openshift-multus/network-metrics-daemon-7fkg2"]
Jul 06 01:26:34.194145 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.194119    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9fkfs"
Jul 06 01:26:34.196435 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.196410    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zzmqr"
Jul 06 01:26:34.197086 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.196925    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 01:26:34.197086 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.196948    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 01:26:34.197086 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.196930    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 01:26:34.197086 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.197015    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9blcj\""
Jul 06 01:26:34.198563 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.198541    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6mg99\""
Jul 06 01:26:34.199115 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.198910    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:26:34.199115 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.198925    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 01:26:34.199115 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:34.199000    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fkg2" podUID="d05d6ef9-2d73-4ab9-b875-7d121bd89c4d"
Jul 06 01:26:34.199377 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.199205    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 01:26:34.201278 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.201260    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.203514 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.203496    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 01:26:34.203662 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.203620    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bphvc"
Jul 06 01:26:34.203732 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.203674    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 01:26:34.203790 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.203751    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sccwj\""
Jul 06 01:26:34.206039 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.206016    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.206507 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.206486    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 01:26:34.206507 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.206501    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mdm9w\""
Jul 06 01:26:34.206667 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.206512    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 01:26:34.206748 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.206735    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 01:26:34.208658 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.208416    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 01:26:34.208658 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.208455    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wkxsp"
Jul 06 01:26:34.208658 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.208491    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x925q\""
Jul 06 01:26:34.208658 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.208525    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 01:26:34.208906 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.208877    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 01:26:34.208906 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.208887    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 01:26:34.209002 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.208950    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 01:26:34.210921 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.210901    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 01:26:34.211014 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.210948    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 01:26:34.211014 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.210978    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bj66x\""
Jul 06 01:26:34.211115 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.211059    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.213363 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.213343    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:34.213459 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:34.213400    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tx6kv" podUID="1d0e1c2f-f2d9-4114-b29f-eae649ac05fc"
Jul 06 01:26:34.213459 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.213343    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-h6b4t\""
Jul 06 01:26:34.213459 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.213440    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 01:26:34.215707 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.215689    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:26:34.215805 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.215737    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f01121e-88d5-4f62-bae1-6957d6f8969a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9qmzt\" (UID: \"3f01121e-88d5-4f62-bae1-6957d6f8969a\") " pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.215805 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:34.215758    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kj2t" podUID="a8f3b161-3401-49ab-9dd4-f7b921a569e1"
Jul 06 01:26:34.215805 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.215768    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a357dec8-e2fb-4fd2-bea2-5f16400a0aef-tmp-dir\") pod \"node-resolver-zzmqr\" (UID: \"a357dec8-e2fb-4fd2-bea2-5f16400a0aef\") " pod="openshift-dns/node-resolver-zzmqr"
Jul 06 01:26:34.215805 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.215790    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-run\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.215978 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.215814    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-sys\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.215978 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.215836    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58jbv\" (UniqueName: \"kubernetes.io/projected/077f7485-8962-4195-b5a1-26f4e3b1c3e0-kube-api-access-58jbv\") pod \"node-ca-bphvc\" (UID: \"077f7485-8962-4195-b5a1-26f4e3b1c3e0\") " pod="openshift-image-registry/node-ca-bphvc"
Jul 06 01:26:34.215978 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.215877    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80aef9e5-5abe-4811-aeed-121974d1e798-host-slash\") pod \"iptables-alerter-9fkfs\" (UID: \"80aef9e5-5abe-4811-aeed-121974d1e798\") " pod="openshift-network-operator/iptables-alerter-9fkfs"
Jul 06 01:26:34.215978 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.215901    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/077f7485-8962-4195-b5a1-26f4e3b1c3e0-serviceca\") pod \"node-ca-bphvc\" (UID: \"077f7485-8962-4195-b5a1-26f4e3b1c3e0\") " pod="openshift-image-registry/node-ca-bphvc"
Jul 06 01:26:34.215978 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.215915    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a357dec8-e2fb-4fd2-bea2-5f16400a0aef-hosts-file\") pod \"node-resolver-zzmqr\" (UID: \"a357dec8-e2fb-4fd2-bea2-5f16400a0aef\") " pod="openshift-dns/node-resolver-zzmqr"
Jul 06 01:26:34.215978 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.215931    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-lib-modules\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.215978 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.215956    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4vl9\" (UniqueName: \"kubernetes.io/projected/80aef9e5-5abe-4811-aeed-121974d1e798-kube-api-access-s4vl9\") pod \"iptables-alerter-9fkfs\" (UID: \"80aef9e5-5abe-4811-aeed-121974d1e798\") " pod="openshift-network-operator/iptables-alerter-9fkfs"
Jul 06 01:26:34.216268 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.216010    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk6gb\" (UniqueName: \"kubernetes.io/projected/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-kube-api-access-fk6gb\") pod \"network-metrics-daemon-7fkg2\" (UID: \"d05d6ef9-2d73-4ab9-b875-7d121bd89c4d\") " pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:26:34.216268 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.216046    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-etc-sysctl-conf\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.216268 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.216070    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0a61dd74-ba03-41b4-a076-771a636d7538-etc-tuned\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.216268 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.216089    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f01121e-88d5-4f62-bae1-6957d6f8969a-cnibin\") pod \"multus-additional-cni-plugins-9qmzt\" (UID: \"3f01121e-88d5-4f62-bae1-6957d6f8969a\") " pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.216268 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.216113    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3f01121e-88d5-4f62-bae1-6957d6f8969a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9qmzt\" (UID: \"3f01121e-88d5-4f62-bae1-6957d6f8969a\") " pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.216268 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.216133    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/077f7485-8962-4195-b5a1-26f4e3b1c3e0-host\") pod \"node-ca-bphvc\" (UID: \"077f7485-8962-4195-b5a1-26f4e3b1c3e0\") " pod="openshift-image-registry/node-ca-bphvc"
Jul 06 01:26:34.216268 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.216163    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3f407833-2077-45ce-85d9-dbb45b639be0-konnectivity-ca\") pod \"konnectivity-agent-wkxsp\" (UID: \"3f407833-2077-45ce-85d9-dbb45b639be0\") " pod="kube-system/konnectivity-agent-wkxsp"
Jul 06 01:26:34.216268 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.216193    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2zkf\" (UniqueName: \"kubernetes.io/projected/a357dec8-e2fb-4fd2-bea2-5f16400a0aef-kube-api-access-m2zkf\") pod \"node-resolver-zzmqr\" (UID: \"a357dec8-e2fb-4fd2-bea2-5f16400a0aef\") " pod="openshift-dns/node-resolver-zzmqr"
Jul 06 01:26:34.216268 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.216217    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-etc-modprobe-d\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.216268 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.216241    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-etc-kubernetes\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.216751 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.216274    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-etc-systemd\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.216751 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.216298    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a61dd74-ba03-41b4-a076-771a636d7538-tmp\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.216751 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.216326    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f01121e-88d5-4f62-bae1-6957d6f8969a-cni-binary-copy\") pod \"multus-additional-cni-plugins-9qmzt\" (UID: \"3f01121e-88d5-4f62-bae1-6957d6f8969a\") " pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.216751 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.216351    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3f01121e-88d5-4f62-bae1-6957d6f8969a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9qmzt\" (UID: \"3f01121e-88d5-4f62-bae1-6957d6f8969a\") " pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.216751 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.216377    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc8bv\" (UniqueName: \"kubernetes.io/projected/3f01121e-88d5-4f62-bae1-6957d6f8969a-kube-api-access-kc8bv\") pod \"multus-additional-cni-plugins-9qmzt\" (UID: \"3f01121e-88d5-4f62-bae1-6957d6f8969a\") " pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.216751 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.216418    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-etc-sysctl-d\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.216751 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.216466    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-var-lib-kubelet\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.216751 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.216489    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzrdd\" (UniqueName: \"kubernetes.io/projected/0a61dd74-ba03-41b4-a076-771a636d7538-kube-api-access-kzrdd\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.216751 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.216512    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f01121e-88d5-4f62-bae1-6957d6f8969a-system-cni-dir\") pod \"multus-additional-cni-plugins-9qmzt\" (UID: \"3f01121e-88d5-4f62-bae1-6957d6f8969a\") " pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.216751 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.216536    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3f407833-2077-45ce-85d9-dbb45b639be0-agent-certs\") pod \"konnectivity-agent-wkxsp\" (UID: \"3f407833-2077-45ce-85d9-dbb45b639be0\") " pod="kube-system/konnectivity-agent-wkxsp"
Jul 06 01:26:34.216751 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.216558    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs\") pod \"network-metrics-daemon-7fkg2\" (UID: \"d05d6ef9-2d73-4ab9-b875-7d121bd89c4d\") " pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:26:34.216751 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.216614    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-etc-sysconfig\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.216751 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.216660    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/80aef9e5-5abe-4811-aeed-121974d1e798-iptables-alerter-script\") pod \"iptables-alerter-9fkfs\" (UID: \"80aef9e5-5abe-4811-aeed-121974d1e798\") " pod="openshift-network-operator/iptables-alerter-9fkfs"
Jul 06 01:26:34.216751 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.216683    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-host\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.216751 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.216706    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f01121e-88d5-4f62-bae1-6957d6f8969a-os-release\") pod \"multus-additional-cni-plugins-9qmzt\" (UID: \"3f01121e-88d5-4f62-bae1-6957d6f8969a\") " pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.218195 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.218177    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.220771 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.220746    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6"
Jul 06 01:26:34.220955 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.220936    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 01:26:34.220955 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.220951    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 01:26:34.221098 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.220967    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 01:26:34.222093 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.222069    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 01:26:34.222225 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.222209    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gzqbf\""
Jul 06 01:26:34.223377 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.223358    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 01:26:34.223585 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.223555    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 01:26:34.223669 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.223642    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 01:26:34.223954 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.223935    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 01:26:34.224066 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.224013    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-k65tm\""
Jul 06 01:26:34.224215 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.224199    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 01:26:34.306969 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.306892    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 01:26:34.307919 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.307865    2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 01:26:34.317024 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.316989    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-run\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.317195 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317036    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58jbv\" (UniqueName: \"kubernetes.io/projected/077f7485-8962-4195-b5a1-26f4e3b1c3e0-kube-api-access-58jbv\") pod \"node-ca-bphvc\" (UID: \"077f7485-8962-4195-b5a1-26f4e3b1c3e0\") " pod="openshift-image-registry/node-ca-bphvc"
Jul 06 01:26:34.317195 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317068    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/07c965a6-ea92-4d74-b540-92e2d82572da-ovn-node-metrics-cert\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.317195 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317095    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpjcr\" (UniqueName: \"kubernetes.io/projected/07c965a6-ea92-4d74-b540-92e2d82572da-kube-api-access-cpjcr\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.317195 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317119    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/077f7485-8962-4195-b5a1-26f4e3b1c3e0-serviceca\") pod \"node-ca-bphvc\" (UID: \"077f7485-8962-4195-b5a1-26f4e3b1c3e0\") " pod="openshift-image-registry/node-ca-bphvc"
Jul 06 01:26:34.317195 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317143    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a357dec8-e2fb-4fd2-bea2-5f16400a0aef-hosts-file\") pod \"node-resolver-zzmqr\" (UID: \"a357dec8-e2fb-4fd2-bea2-5f16400a0aef\") " pod="openshift-dns/node-resolver-zzmqr"
Jul 06 01:26:34.317195 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317167    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4vl9\" (UniqueName: \"kubernetes.io/projected/80aef9e5-5abe-4811-aeed-121974d1e798-kube-api-access-s4vl9\") pod \"iptables-alerter-9fkfs\" (UID: \"80aef9e5-5abe-4811-aeed-121974d1e798\") " pod="openshift-network-operator/iptables-alerter-9fkfs"
Jul 06 01:26:34.317195 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317193    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-host-run-netns\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.317503 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317220    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t884s\" (UniqueName: \"kubernetes.io/projected/a8f3b161-3401-49ab-9dd4-f7b921a569e1-kube-api-access-t884s\") pod \"network-check-target-9kj2t\" (UID: \"a8f3b161-3401-49ab-9dd4-f7b921a569e1\") " pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:26:34.317503 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317245    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-host-run-ovn-kubernetes\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.317503 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317298    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk6gb\" (UniqueName: \"kubernetes.io/projected/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-kube-api-access-fk6gb\") pod \"network-metrics-daemon-7fkg2\" (UID: \"d05d6ef9-2d73-4ab9-b875-7d121bd89c4d\") " pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:26:34.317503 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317327    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-etc-sysctl-conf\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.317503 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317349    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0a61dd74-ba03-41b4-a076-771a636d7538-etc-tuned\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.317503 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317374    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f01121e-88d5-4f62-bae1-6957d6f8969a-cnibin\") pod \"multus-additional-cni-plugins-9qmzt\" (UID: \"3f01121e-88d5-4f62-bae1-6957d6f8969a\") " pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.317503 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317400    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3f01121e-88d5-4f62-bae1-6957d6f8969a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9qmzt\" (UID: \"3f01121e-88d5-4f62-bae1-6957d6f8969a\") " pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.317503 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317427    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3f407833-2077-45ce-85d9-dbb45b639be0-konnectivity-ca\") pod \"konnectivity-agent-wkxsp\" (UID: \"3f407833-2077-45ce-85d9-dbb45b639be0\") " pod="kube-system/konnectivity-agent-wkxsp"
Jul 06 01:26:34.317503 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317451    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-etc-kubernetes\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.317503 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317478    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2zkf\" (UniqueName: \"kubernetes.io/projected/a357dec8-e2fb-4fd2-bea2-5f16400a0aef-kube-api-access-m2zkf\") pod \"node-resolver-zzmqr\" (UID: \"a357dec8-e2fb-4fd2-bea2-5f16400a0aef\") " pod="openshift-dns/node-resolver-zzmqr"
Jul 06 01:26:34.318039 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317507    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-etc-modprobe-d\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.318039 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317531    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-etc-kubernetes\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.318039 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317572    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a61dd74-ba03-41b4-a076-771a636d7538-tmp\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.318039 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317597    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f01121e-88d5-4f62-bae1-6957d6f8969a-cni-binary-copy\") pod \"multus-additional-cni-plugins-9qmzt\" (UID: \"3f01121e-88d5-4f62-bae1-6957d6f8969a\") " pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.318039 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317649    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3f01121e-88d5-4f62-bae1-6957d6f8969a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9qmzt\" (UID: \"3f01121e-88d5-4f62-bae1-6957d6f8969a\") " pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.318039 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317679    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-original-pull-secret\") pod \"global-pull-secret-syncer-tx6kv\" (UID: \"1d0e1c2f-f2d9-4114-b29f-eae649ac05fc\") " pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:34.318039 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317715    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-host-slash\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.318039 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317740    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-host-run-k8s-cni-cncf-io\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.318039 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317766    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-etc-sysctl-d\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.318039 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317793    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f01121e-88d5-4f62-bae1-6957d6f8969a-system-cni-dir\") pod \"multus-additional-cni-plugins-9qmzt\" (UID: \"3f01121e-88d5-4f62-bae1-6957d6f8969a\") " pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.318039 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317825    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3f407833-2077-45ce-85d9-dbb45b639be0-agent-certs\") pod \"konnectivity-agent-wkxsp\" (UID: \"3f407833-2077-45ce-85d9-dbb45b639be0\") " pod="kube-system/konnectivity-agent-wkxsp"
Jul 06 01:26:34.318039 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317864    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc-socket-dir\") pod \"aws-ebs-csi-driver-node-zltx6\" (UID: \"35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6"
Jul 06 01:26:34.318039 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317888    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-system-cni-dir\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.318039 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317915    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs\") pod \"network-metrics-daemon-7fkg2\" (UID: \"d05d6ef9-2d73-4ab9-b875-7d121bd89c4d\") " pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:26:34.318039 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317940    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-etc-sysconfig\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.318039 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.317967    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/80aef9e5-5abe-4811-aeed-121974d1e798-iptables-alerter-script\") pod \"iptables-alerter-9fkfs\" (UID: \"80aef9e5-5abe-4811-aeed-121974d1e798\") " pod="openshift-network-operator/iptables-alerter-9fkfs"
Jul 06 01:26:34.318039 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318005    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc-etc-selinux\") pod \"aws-ebs-csi-driver-node-zltx6\" (UID: \"35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6"
Jul 06 01:26:34.318981 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318029    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-log-socket\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.318981 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318058    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/07c965a6-ea92-4d74-b540-92e2d82572da-ovnkube-script-lib\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.318981 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318083    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-host\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.318981 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318108    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f01121e-88d5-4f62-bae1-6957d6f8969a-os-release\") pod \"multus-additional-cni-plugins-9qmzt\" (UID: \"3f01121e-88d5-4f62-bae1-6957d6f8969a\") " pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.318981 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318136    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f01121e-88d5-4f62-bae1-6957d6f8969a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9qmzt\" (UID: \"3f01121e-88d5-4f62-bae1-6957d6f8969a\") " pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.318981 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318157    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/afe45663-750d-40c6-aae9-69a91e054d7f-multus-daemon-config\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.318981 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318181    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-etc-openvswitch\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.318981 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318196    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a357dec8-e2fb-4fd2-bea2-5f16400a0aef-hosts-file\") pod \"node-resolver-zzmqr\" (UID: \"a357dec8-e2fb-4fd2-bea2-5f16400a0aef\") " pod="openshift-dns/node-resolver-zzmqr"
Jul 06 01:26:34.318981 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318204    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-run-ovn\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.318981 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318226    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-node-log\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.318981 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318253    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a357dec8-e2fb-4fd2-bea2-5f16400a0aef-tmp-dir\") pod \"node-resolver-zzmqr\" (UID: \"a357dec8-e2fb-4fd2-bea2-5f16400a0aef\") " pod="openshift-dns/node-resolver-zzmqr"
Jul 06 01:26:34.318981 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318272    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-sys\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.318981 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318294    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc-device-dir\") pod \"aws-ebs-csi-driver-node-zltx6\" (UID: \"35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6"
Jul 06 01:26:34.318981 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318319    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-run-systemd\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.318981 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318327    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-run\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.318981 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318344    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-host-cni-bin\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.318981 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318375    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80aef9e5-5abe-4811-aeed-121974d1e798-host-slash\") pod \"iptables-alerter-9fkfs\" (UID: \"80aef9e5-5abe-4811-aeed-121974d1e798\") " pod="openshift-network-operator/iptables-alerter-9fkfs"
Jul 06 01:26:34.319674 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318423    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/077f7485-8962-4195-b5a1-26f4e3b1c3e0-serviceca\") pod \"node-ca-bphvc\" (UID: \"077f7485-8962-4195-b5a1-26f4e3b1c3e0\") " pod="openshift-image-registry/node-ca-bphvc"
Jul 06 01:26:34.319674 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318529    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-host\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.319674 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318581    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-etc-sysctl-d\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.319674 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318586    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f01121e-88d5-4f62-bae1-6957d6f8969a-os-release\") pod \"multus-additional-cni-plugins-9qmzt\" (UID: \"3f01121e-88d5-4f62-bae1-6957d6f8969a\") " pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.319674 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318618    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f01121e-88d5-4f62-bae1-6957d6f8969a-system-cni-dir\") pod \"multus-additional-cni-plugins-9qmzt\" (UID: \"3f01121e-88d5-4f62-bae1-6957d6f8969a\") " pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.319674 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318679    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc-sys-fs\") pod \"aws-ebs-csi-driver-node-zltx6\" (UID: \"35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6"
Jul 06 01:26:34.319674 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318703    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-host-var-lib-kubelet\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.319674 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318727    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-hostroot\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.319674 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318753    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-systemd-units\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.319674 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318765    2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 01:26:34.319674 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318778    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-host-run-netns\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.319674 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318801    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-host-cni-netd\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.319674 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318826    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/07c965a6-ea92-4d74-b540-92e2d82572da-ovnkube-config\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.319674 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318855    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-lib-modules\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.319674 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318861    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f01121e-88d5-4f62-bae1-6957d6f8969a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9qmzt\" (UID: \"3f01121e-88d5-4f62-bae1-6957d6f8969a\") " pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.319674 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318881    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-multus-socket-dir-parent\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.319674 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318902    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f01121e-88d5-4f62-bae1-6957d6f8969a-cnibin\") pod \"multus-additional-cni-plugins-9qmzt\" (UID: \"3f01121e-88d5-4f62-bae1-6957d6f8969a\") " pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.320397 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318909    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-host-var-lib-cni-bin\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.320397 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318944    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-host-run-multus-certs\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.320397 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318972    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/07c965a6-ea92-4d74-b540-92e2d82572da-env-overrides\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.320397 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.319019    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-cnibin\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.320397 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.319048    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/afe45663-750d-40c6-aae9-69a91e054d7f-cni-binary-copy\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.320397 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.319077    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/077f7485-8962-4195-b5a1-26f4e3b1c3e0-host\") pod \"node-ca-bphvc\" (UID: \"077f7485-8962-4195-b5a1-26f4e3b1c3e0\") " pod="openshift-image-registry/node-ca-bphvc"
Jul 06 01:26:34.320397 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.319104    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-run-openvswitch\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.320397 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.319133    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zltx6\" (UID: \"35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6"
Jul 06 01:26:34.320397 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.318946    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80aef9e5-5abe-4811-aeed-121974d1e798-host-slash\") pod \"iptables-alerter-9fkfs\" (UID: \"80aef9e5-5abe-4811-aeed-121974d1e798\") " pod="openshift-network-operator/iptables-alerter-9fkfs"
Jul 06 01:26:34.320397 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.319216    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-etc-systemd\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.320397 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.319245    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc8bv\" (UniqueName: \"kubernetes.io/projected/3f01121e-88d5-4f62-bae1-6957d6f8969a-kube-api-access-kc8bv\") pod \"multus-additional-cni-plugins-9qmzt\" (UID: \"3f01121e-88d5-4f62-bae1-6957d6f8969a\") " pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.320397 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.319269    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-host-kubelet\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.320397 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.319296    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-multus-cni-dir\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.320397 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.319320    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-os-release\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.320397 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.319346    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-var-lib-kubelet\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.320397 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.319381    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzrdd\" (UniqueName: \"kubernetes.io/projected/0a61dd74-ba03-41b4-a076-771a636d7538-kube-api-access-kzrdd\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.320397 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:34.319388    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 01:26:34.321209 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.319410    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-kubelet-config\") pod \"global-pull-secret-syncer-tx6kv\" (UID: \"1d0e1c2f-f2d9-4114-b29f-eae649ac05fc\") " pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:34.321209 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.319437    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w54xw\" (UniqueName: \"kubernetes.io/projected/35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc-kube-api-access-w54xw\") pod \"aws-ebs-csi-driver-node-zltx6\" (UID: \"35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6"
Jul 06 01:26:34.321209 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:34.319503    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs podName:d05d6ef9-2d73-4ab9-b875-7d121bd89c4d nodeName:}" failed. No retries permitted until 2026-07-06 01:26:34.819458597 +0000 UTC m=+3.061226446 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs") pod "network-metrics-daemon-7fkg2" (UID: "d05d6ef9-2d73-4ab9-b875-7d121bd89c4d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 01:26:34.321209 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.319522    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-multus-conf-dir\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.321209 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.319553    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-dbus\") pod \"global-pull-secret-syncer-tx6kv\" (UID: \"1d0e1c2f-f2d9-4114-b29f-eae649ac05fc\") " pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:34.321209 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.319591    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-host-var-lib-cni-multus\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.321209 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.319620    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc-registration-dir\") pod \"aws-ebs-csi-driver-node-zltx6\" (UID: \"35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6"
Jul 06 01:26:34.321209 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.319687    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpwp8\" (UniqueName: \"kubernetes.io/projected/afe45663-750d-40c6-aae9-69a91e054d7f-kube-api-access-jpwp8\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.321209 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.319715    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-var-lib-openvswitch\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.321209 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.319743    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.321209 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.319756    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-etc-sysconfig\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.321209 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.319828    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/077f7485-8962-4195-b5a1-26f4e3b1c3e0-host\") pod \"node-ca-bphvc\" (UID: \"077f7485-8962-4195-b5a1-26f4e3b1c3e0\") " pod="openshift-image-registry/node-ca-bphvc"
Jul 06 01:26:34.321209 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.319886    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-etc-systemd\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.321209 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.320168    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-var-lib-kubelet\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.321209 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.320175    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3f407833-2077-45ce-85d9-dbb45b639be0-konnectivity-ca\") pod \"konnectivity-agent-wkxsp\" (UID: \"3f407833-2077-45ce-85d9-dbb45b639be0\") " pod="kube-system/konnectivity-agent-wkxsp"
Jul 06 01:26:34.321209 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.320181    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3f01121e-88d5-4f62-bae1-6957d6f8969a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9qmzt\" (UID: \"3f01121e-88d5-4f62-bae1-6957d6f8969a\") " pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.321992 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.320288    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-etc-kubernetes\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.321992 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.320336    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-etc-sysctl-conf\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.321992 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.320362    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-etc-modprobe-d\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.321992 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.320387    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-sys\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.321992 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.320411    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a357dec8-e2fb-4fd2-bea2-5f16400a0aef-tmp-dir\") pod \"node-resolver-zzmqr\" (UID: \"a357dec8-e2fb-4fd2-bea2-5f16400a0aef\") " pod="openshift-dns/node-resolver-zzmqr"
Jul 06 01:26:34.321992 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.320445    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/80aef9e5-5abe-4811-aeed-121974d1e798-iptables-alerter-script\") pod \"iptables-alerter-9fkfs\" (UID: \"80aef9e5-5abe-4811-aeed-121974d1e798\") " pod="openshift-network-operator/iptables-alerter-9fkfs"
Jul 06 01:26:34.321992 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.320494    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0a61dd74-ba03-41b4-a076-771a636d7538-lib-modules\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.321992 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.320872    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3f01121e-88d5-4f62-bae1-6957d6f8969a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9qmzt\" (UID: \"3f01121e-88d5-4f62-bae1-6957d6f8969a\") " pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.321992 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.321025    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f01121e-88d5-4f62-bae1-6957d6f8969a-cni-binary-copy\") pod \"multus-additional-cni-plugins-9qmzt\" (UID: \"3f01121e-88d5-4f62-bae1-6957d6f8969a\") " pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.322471 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.322117    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 01:26:34.322925 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.322902    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a61dd74-ba03-41b4-a076-771a636d7538-tmp\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.323070 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.323048    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0a61dd74-ba03-41b4-a076-771a636d7538-etc-tuned\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.323353 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.323326    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3f407833-2077-45ce-85d9-dbb45b639be0-agent-certs\") pod \"konnectivity-agent-wkxsp\" (UID: \"3f407833-2077-45ce-85d9-dbb45b639be0\") " pod="kube-system/konnectivity-agent-wkxsp"
Jul 06 01:26:34.328970 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.328841    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4vl9\" (UniqueName: \"kubernetes.io/projected/80aef9e5-5abe-4811-aeed-121974d1e798-kube-api-access-s4vl9\") pod \"iptables-alerter-9fkfs\" (UID: \"80aef9e5-5abe-4811-aeed-121974d1e798\") " pod="openshift-network-operator/iptables-alerter-9fkfs"
Jul 06 01:26:34.330078 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.329987    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58jbv\" (UniqueName: \"kubernetes.io/projected/077f7485-8962-4195-b5a1-26f4e3b1c3e0-kube-api-access-58jbv\") pod \"node-ca-bphvc\" (UID: \"077f7485-8962-4195-b5a1-26f4e3b1c3e0\") " pod="openshift-image-registry/node-ca-bphvc"
Jul 06 01:26:34.333070 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.332397    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2zkf\" (UniqueName: \"kubernetes.io/projected/a357dec8-e2fb-4fd2-bea2-5f16400a0aef-kube-api-access-m2zkf\") pod \"node-resolver-zzmqr\" (UID: \"a357dec8-e2fb-4fd2-bea2-5f16400a0aef\") " pod="openshift-dns/node-resolver-zzmqr"
Jul 06 01:26:34.333070 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.332416    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk6gb\" (UniqueName: \"kubernetes.io/projected/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-kube-api-access-fk6gb\") pod \"network-metrics-daemon-7fkg2\" (UID: \"d05d6ef9-2d73-4ab9-b875-7d121bd89c4d\") " pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:26:34.333525 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.333492    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzrdd\" (UniqueName: \"kubernetes.io/projected/0a61dd74-ba03-41b4-a076-771a636d7538-kube-api-access-kzrdd\") pod \"tuned-th2j5\" (UID: \"0a61dd74-ba03-41b4-a076-771a636d7538\") " pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.334062 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.334034    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc8bv\" (UniqueName: \"kubernetes.io/projected/3f01121e-88d5-4f62-bae1-6957d6f8969a-kube-api-access-kc8bv\") pod \"multus-additional-cni-plugins-9qmzt\" (UID: \"3f01121e-88d5-4f62-bae1-6957d6f8969a\") " pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.342236 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.342189    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-99689"
Jul 06 01:26:34.349640 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.349588    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-99689"
Jul 06 01:26:34.420301 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420254    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-host-kubelet\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.420301 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420305    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-multus-cni-dir\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.420546 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420352    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-os-release\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.420546 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420381    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-kubelet-config\") pod \"global-pull-secret-syncer-tx6kv\" (UID: \"1d0e1c2f-f2d9-4114-b29f-eae649ac05fc\") " pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:34.420546 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420385    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-host-kubelet\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.420546 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420406    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w54xw\" (UniqueName: \"kubernetes.io/projected/35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc-kube-api-access-w54xw\") pod \"aws-ebs-csi-driver-node-zltx6\" (UID: \"35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6"
Jul 06 01:26:34.420546 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420428    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-multus-conf-dir\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.420546 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420449    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-dbus\") pod \"global-pull-secret-syncer-tx6kv\" (UID: \"1d0e1c2f-f2d9-4114-b29f-eae649ac05fc\") " pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:34.420546 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420472    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-host-var-lib-cni-multus\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.420546 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420474    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-kubelet-config\") pod \"global-pull-secret-syncer-tx6kv\" (UID: \"1d0e1c2f-f2d9-4114-b29f-eae649ac05fc\") " pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:34.420546 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420489    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-os-release\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.420546 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420499    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc-registration-dir\") pod \"aws-ebs-csi-driver-node-zltx6\" (UID: \"35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6"
Jul 06 01:26:34.420546 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420518    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-multus-conf-dir\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.420546 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420522    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpwp8\" (UniqueName: \"kubernetes.io/projected/afe45663-750d-40c6-aae9-69a91e054d7f-kube-api-access-jpwp8\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.420546 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420534    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-multus-cni-dir\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.420546 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420546    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-var-lib-openvswitch\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.420546 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420548    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-host-var-lib-cni-multus\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.421281 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420572    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.421281 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420591    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc-registration-dir\") pod \"aws-ebs-csi-driver-node-zltx6\" (UID: \"35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6"
Jul 06 01:26:34.421281 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420601    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/07c965a6-ea92-4d74-b540-92e2d82572da-ovn-node-metrics-cert\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.421281 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420636    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-var-lib-openvswitch\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.421281 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420657    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.421281 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420602    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-dbus\") pod \"global-pull-secret-syncer-tx6kv\" (UID: \"1d0e1c2f-f2d9-4114-b29f-eae649ac05fc\") " pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:34.421281 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420724    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpjcr\" (UniqueName: \"kubernetes.io/projected/07c965a6-ea92-4d74-b540-92e2d82572da-kube-api-access-cpjcr\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.421281 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420766    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-host-run-netns\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.421281 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420791    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t884s\" (UniqueName: \"kubernetes.io/projected/a8f3b161-3401-49ab-9dd4-f7b921a569e1-kube-api-access-t884s\") pod \"network-check-target-9kj2t\" (UID: \"a8f3b161-3401-49ab-9dd4-f7b921a569e1\") " pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:26:34.421281 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420812    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-host-run-ovn-kubernetes\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.421281 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420841    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-etc-kubernetes\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.421281 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420848    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-host-run-netns\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.421281 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420868    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-original-pull-secret\") pod \"global-pull-secret-syncer-tx6kv\" (UID: \"1d0e1c2f-f2d9-4114-b29f-eae649ac05fc\") " pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:34.421281 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420892    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-host-slash\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.421281 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420898    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-host-run-ovn-kubernetes\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.421281 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420917    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-host-run-k8s-cni-cncf-io\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.421281 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420945    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc-socket-dir\") pod \"aws-ebs-csi-driver-node-zltx6\" (UID: \"35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6"
Jul 06 01:26:34.422061 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.420967    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-system-cni-dir\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.422061 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421006    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc-etc-selinux\") pod \"aws-ebs-csi-driver-node-zltx6\" (UID: \"35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6"
Jul 06 01:26:34.422061 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421012    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-host-slash\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.422061 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421048    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-host-run-k8s-cni-cncf-io\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.422061 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421068    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-etc-kubernetes\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.422061 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421093    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-log-socket\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.422061 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421123    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/07c965a6-ea92-4d74-b540-92e2d82572da-ovnkube-script-lib\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.422061 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421134    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-system-cni-dir\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.422061 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421146    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc-etc-selinux\") pod \"aws-ebs-csi-driver-node-zltx6\" (UID: \"35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6"
Jul 06 01:26:34.422061 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421151    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/afe45663-750d-40c6-aae9-69a91e054d7f-multus-daemon-config\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.422061 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421160    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc-socket-dir\") pod \"aws-ebs-csi-driver-node-zltx6\" (UID: \"35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6"
Jul 06 01:26:34.422061 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:34.421169    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 01:26:34.422061 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421177    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-etc-openvswitch\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.422061 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421202    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-run-ovn\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.422061 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:34.421238    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-original-pull-secret podName:1d0e1c2f-f2d9-4114-b29f-eae649ac05fc nodeName:}" failed. No retries permitted until 2026-07-06 01:26:34.921210817 +0000 UTC m=+3.162978666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-original-pull-secret") pod "global-pull-secret-syncer-tx6kv" (UID: "1d0e1c2f-f2d9-4114-b29f-eae649ac05fc") : object "kube-system"/"original-pull-secret" not registered
Jul 06 01:26:34.422061 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421240    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-run-ovn\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.422061 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421171    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-log-socket\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.422847 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421258    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-node-log\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.422847 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421286    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-etc-openvswitch\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.422847 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421291    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc-device-dir\") pod \"aws-ebs-csi-driver-node-zltx6\" (UID: \"35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6"
Jul 06 01:26:34.422847 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421331    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc-device-dir\") pod \"aws-ebs-csi-driver-node-zltx6\" (UID: \"35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6"
Jul 06 01:26:34.422847 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421334    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-run-systemd\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.422847 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421363    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-run-systemd\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.422847 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421373    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-host-cni-bin\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.422847 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421399    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc-sys-fs\") pod \"aws-ebs-csi-driver-node-zltx6\" (UID: \"35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6"
Jul 06 01:26:34.422847 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421407    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-node-log\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.422847 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421425    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-host-cni-bin\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.422847 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421424    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-host-var-lib-kubelet\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.422847 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421456    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-hostroot\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.422847 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421456    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-host-var-lib-kubelet\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.422847 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421461    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc-sys-fs\") pod \"aws-ebs-csi-driver-node-zltx6\" (UID: \"35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6"
Jul 06 01:26:34.422847 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421481    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-hostroot\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.422847 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421484    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-systemd-units\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.422847 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421504    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-systemd-units\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.422847 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421508    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-host-run-netns\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.423736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421528    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-host-run-netns\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.423736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421530    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-host-cni-netd\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.423736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421553    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/07c965a6-ea92-4d74-b540-92e2d82572da-ovnkube-config\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.423736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421578    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-multus-socket-dir-parent\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.423736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421603    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-host-var-lib-cni-bin\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.423736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421637    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/afe45663-750d-40c6-aae9-69a91e054d7f-multus-daemon-config\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.423736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421660    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-multus-socket-dir-parent\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.423736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421668    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-host-var-lib-cni-bin\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.423736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421700    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-host-run-multus-certs\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.423736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421725    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/07c965a6-ea92-4d74-b540-92e2d82572da-env-overrides\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.423736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421739    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-host-cni-netd\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.423736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421754    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/07c965a6-ea92-4d74-b540-92e2d82572da-ovnkube-script-lib\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.423736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421758    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-cnibin\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.423736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421799    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-cnibin\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.423736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421804    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/afe45663-750d-40c6-aae9-69a91e054d7f-cni-binary-copy\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.423736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421839    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-run-openvswitch\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.423736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421863    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zltx6\" (UID: \"35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6"
Jul 06 01:26:34.423736 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421838    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/afe45663-750d-40c6-aae9-69a91e054d7f-host-run-multus-certs\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.424569 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421913    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07c965a6-ea92-4d74-b540-92e2d82572da-run-openvswitch\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.424569 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.421934    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zltx6\" (UID: \"35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6"
Jul 06 01:26:34.424569 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.422150    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/07c965a6-ea92-4d74-b540-92e2d82572da-ovnkube-config\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.424569 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.422303    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/afe45663-750d-40c6-aae9-69a91e054d7f-cni-binary-copy\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.424569 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.422490    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/07c965a6-ea92-4d74-b540-92e2d82572da-env-overrides\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.424569 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.424196    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/07c965a6-ea92-4d74-b540-92e2d82572da-ovn-node-metrics-cert\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.427600 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:34.427572    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 01:26:34.427762 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:34.427605    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 01:26:34.427762 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:34.427635    2584 projected.go:196] Error preparing data for projected volume kube-api-access-t884s for pod openshift-network-diagnostics/network-check-target-9kj2t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 01:26:34.427762 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:34.427707    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8f3b161-3401-49ab-9dd4-f7b921a569e1-kube-api-access-t884s podName:a8f3b161-3401-49ab-9dd4-f7b921a569e1 nodeName:}" failed. No retries permitted until 2026-07-06 01:26:34.927684655 +0000 UTC m=+3.169452527 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-t884s" (UniqueName: "kubernetes.io/projected/a8f3b161-3401-49ab-9dd4-f7b921a569e1-kube-api-access-t884s") pod "network-check-target-9kj2t" (UID: "a8f3b161-3401-49ab-9dd4-f7b921a569e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 01:26:34.428973 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.428941    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpwp8\" (UniqueName: \"kubernetes.io/projected/afe45663-750d-40c6-aae9-69a91e054d7f-kube-api-access-jpwp8\") pod \"multus-5gfv5\" (UID: \"afe45663-750d-40c6-aae9-69a91e054d7f\") " pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.430860 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.430839    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w54xw\" (UniqueName: \"kubernetes.io/projected/35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc-kube-api-access-w54xw\") pod \"aws-ebs-csi-driver-node-zltx6\" (UID: \"35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6"
Jul 06 01:26:34.431028 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.430991    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpjcr\" (UniqueName: \"kubernetes.io/projected/07c965a6-ea92-4d74-b540-92e2d82572da-kube-api-access-cpjcr\") pod \"ovnkube-node-mnnbg\" (UID: \"07c965a6-ea92-4d74-b540-92e2d82572da\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.506160 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.506121    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9fkfs"
Jul 06 01:26:34.512737 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.512710    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zzmqr"
Jul 06 01:26:34.518663 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:34.518614    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80aef9e5_5abe_4811_aeed_121974d1e798.slice/crio-8abb5c907f4dd7139eb18cebe9697b9b44333997201d9461a5ba256aebc3a228 WatchSource:0}: Error finding container 8abb5c907f4dd7139eb18cebe9697b9b44333997201d9461a5ba256aebc3a228: Status 404 returned error can't find the container with id 8abb5c907f4dd7139eb18cebe9697b9b44333997201d9461a5ba256aebc3a228
Jul 06 01:26:34.522584 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.522563    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-th2j5"
Jul 06 01:26:34.526041 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.526015    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bphvc"
Jul 06 01:26:34.528091 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:34.528062    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda357dec8_e2fb_4fd2_bea2_5f16400a0aef.slice/crio-9c212aa71994394799cea82dcf8fd7f7fd318eeaae702b44fc4a9b9c51a6d3c8 WatchSource:0}: Error finding container 9c212aa71994394799cea82dcf8fd7f7fd318eeaae702b44fc4a9b9c51a6d3c8: Status 404 returned error can't find the container with id 9c212aa71994394799cea82dcf8fd7f7fd318eeaae702b44fc4a9b9c51a6d3c8
Jul 06 01:26:34.532725 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.532699    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9qmzt"
Jul 06 01:26:34.538660 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:34.538558    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a61dd74_ba03_41b4_a076_771a636d7538.slice/crio-5b08bf0f4e92f8b34f12b1fe3f9e4131d7b7cb2d04a8954b4431a3952f20f4d2 WatchSource:0}: Error finding container 5b08bf0f4e92f8b34f12b1fe3f9e4131d7b7cb2d04a8954b4431a3952f20f4d2: Status 404 returned error can't find the container with id 5b08bf0f4e92f8b34f12b1fe3f9e4131d7b7cb2d04a8954b4431a3952f20f4d2
Jul 06 01:26:34.540173 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.540148    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wkxsp"
Jul 06 01:26:34.547313 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.547284    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5gfv5"
Jul 06 01:26:34.549932 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:34.549049    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod077f7485_8962_4195_b5a1_26f4e3b1c3e0.slice/crio-a6a26f69e677cd5eb6eb638326322862a27675a06a1ebebe75875cd5e5897e2e WatchSource:0}: Error finding container a6a26f69e677cd5eb6eb638326322862a27675a06a1ebebe75875cd5e5897e2e: Status 404 returned error can't find the container with id a6a26f69e677cd5eb6eb638326322862a27675a06a1ebebe75875cd5e5897e2e
Jul 06 01:26:34.551723 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:34.551686    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f01121e_88d5_4f62_bae1_6957d6f8969a.slice/crio-a1508df03ec7605c874bbfe68d2e679090ac9c7743cba9785a3a8e9a6d0a3b99 WatchSource:0}: Error finding container a1508df03ec7605c874bbfe68d2e679090ac9c7743cba9785a3a8e9a6d0a3b99: Status 404 returned error can't find the container with id a1508df03ec7605c874bbfe68d2e679090ac9c7743cba9785a3a8e9a6d0a3b99
Jul 06 01:26:34.554125 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:34.554098    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f407833_2077_45ce_85d9_dbb45b639be0.slice/crio-13f22b013e826990511f5637a741f2a736a8cd0b856b0d583bab874bbe4a0559 WatchSource:0}: Error finding container 13f22b013e826990511f5637a741f2a736a8cd0b856b0d583bab874bbe4a0559: Status 404 returned error can't find the container with id 13f22b013e826990511f5637a741f2a736a8cd0b856b0d583bab874bbe4a0559
Jul 06 01:26:34.557008 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.556803    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:26:34.561514 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:34.561484    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe45663_750d_40c6_aae9_69a91e054d7f.slice/crio-f6375bc899fc6a1be9b1db19760bb54d499c1cbb31d5baef182d367516e317f6 WatchSource:0}: Error finding container f6375bc899fc6a1be9b1db19760bb54d499c1cbb31d5baef182d367516e317f6: Status 404 returned error can't find the container with id f6375bc899fc6a1be9b1db19760bb54d499c1cbb31d5baef182d367516e317f6
Jul 06 01:26:34.563004 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.562976    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6"
Jul 06 01:26:34.572957 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:34.572915    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07c965a6_ea92_4d74_b540_92e2d82572da.slice/crio-f7162093c75bb9fea4a5471605836ea8e26465225b576dbdd3b938cce08e0b8a WatchSource:0}: Error finding container f7162093c75bb9fea4a5471605836ea8e26465225b576dbdd3b938cce08e0b8a: Status 404 returned error can't find the container with id f7162093c75bb9fea4a5471605836ea8e26465225b576dbdd3b938cce08e0b8a
Jul 06 01:26:34.578746 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:26:34.578716    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35b20e23_0cb9_4a29_b2fe_e3ecdd1efecc.slice/crio-d2937b6234bc803bbb9866c635806113707db806f18f6a12a75ac0c29f87d013 WatchSource:0}: Error finding container d2937b6234bc803bbb9866c635806113707db806f18f6a12a75ac0c29f87d013: Status 404 returned error can't find the container with id d2937b6234bc803bbb9866c635806113707db806f18f6a12a75ac0c29f87d013
Jul 06 01:26:34.614998 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.614934    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bphvc" event={"ID":"077f7485-8962-4195-b5a1-26f4e3b1c3e0","Type":"ContainerStarted","Data":"a6a26f69e677cd5eb6eb638326322862a27675a06a1ebebe75875cd5e5897e2e"}
Jul 06 01:26:34.616425 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.616340    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9fkfs" event={"ID":"80aef9e5-5abe-4811-aeed-121974d1e798","Type":"ContainerStarted","Data":"8abb5c907f4dd7139eb18cebe9697b9b44333997201d9461a5ba256aebc3a228"}
Jul 06 01:26:34.617654 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.617613    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-8.ec2.internal" event={"ID":"a39d0d7260635ade2bf76fa6546e26a1","Type":"ContainerStarted","Data":"61f78f8ab0adb6b12c24bd58cd20e83860ab344ad22a37d8fe62075fead62f24"}
Jul 06 01:26:34.619035 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.619004    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal" event={"ID":"71f330f0340bfbcab58413a81f320c47","Type":"ContainerStarted","Data":"f670d7726e689aec5806a9b0c7c025f9be7bfc53cfb88192e00f1d2561b6c13b"}
Jul 06 01:26:34.620362 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.620326    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6" event={"ID":"35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc","Type":"ContainerStarted","Data":"d2937b6234bc803bbb9866c635806113707db806f18f6a12a75ac0c29f87d013"}
Jul 06 01:26:34.621789 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.621751    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5gfv5" event={"ID":"afe45663-750d-40c6-aae9-69a91e054d7f","Type":"ContainerStarted","Data":"f6375bc899fc6a1be9b1db19760bb54d499c1cbb31d5baef182d367516e317f6"}
Jul 06 01:26:34.623073 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.623048    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wkxsp" event={"ID":"3f407833-2077-45ce-85d9-dbb45b639be0","Type":"ContainerStarted","Data":"13f22b013e826990511f5637a741f2a736a8cd0b856b0d583bab874bbe4a0559"}
Jul 06 01:26:34.624488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.624463    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-th2j5" event={"ID":"0a61dd74-ba03-41b4-a076-771a636d7538","Type":"ContainerStarted","Data":"5b08bf0f4e92f8b34f12b1fe3f9e4131d7b7cb2d04a8954b4431a3952f20f4d2"}
Jul 06 01:26:34.625681 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.625653    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zzmqr" event={"ID":"a357dec8-e2fb-4fd2-bea2-5f16400a0aef","Type":"ContainerStarted","Data":"9c212aa71994394799cea82dcf8fd7f7fd318eeaae702b44fc4a9b9c51a6d3c8"}
Jul 06 01:26:34.627141 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.627116    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg" event={"ID":"07c965a6-ea92-4d74-b540-92e2d82572da","Type":"ContainerStarted","Data":"f7162093c75bb9fea4a5471605836ea8e26465225b576dbdd3b938cce08e0b8a"}
Jul 06 01:26:34.628365 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.628342    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qmzt" event={"ID":"3f01121e-88d5-4f62-bae1-6957d6f8969a","Type":"ContainerStarted","Data":"a1508df03ec7605c874bbfe68d2e679090ac9c7743cba9785a3a8e9a6d0a3b99"}
Jul 06 01:26:34.824094 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.823975    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs\") pod \"network-metrics-daemon-7fkg2\" (UID: \"d05d6ef9-2d73-4ab9-b875-7d121bd89c4d\") " pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:26:34.824244 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:34.824114    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 01:26:34.824244 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:34.824199    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs podName:d05d6ef9-2d73-4ab9-b875-7d121bd89c4d nodeName:}" failed. No retries permitted until 2026-07-06 01:26:35.824176791 +0000 UTC m=+4.065944653 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs") pod "network-metrics-daemon-7fkg2" (UID: "d05d6ef9-2d73-4ab9-b875-7d121bd89c4d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 01:26:34.925097 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:34.925057    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-original-pull-secret\") pod \"global-pull-secret-syncer-tx6kv\" (UID: \"1d0e1c2f-f2d9-4114-b29f-eae649ac05fc\") " pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:34.925295 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:34.925237    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 01:26:34.925358 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:34.925320    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-original-pull-secret podName:1d0e1c2f-f2d9-4114-b29f-eae649ac05fc nodeName:}" failed. No retries permitted until 2026-07-06 01:26:35.925298789 +0000 UTC m=+4.167066651 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-original-pull-secret") pod "global-pull-secret-syncer-tx6kv" (UID: "1d0e1c2f-f2d9-4114-b29f-eae649ac05fc") : object "kube-system"/"original-pull-secret" not registered
Jul 06 01:26:35.025872 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:35.025832    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t884s\" (UniqueName: \"kubernetes.io/projected/a8f3b161-3401-49ab-9dd4-f7b921a569e1-kube-api-access-t884s\") pod \"network-check-target-9kj2t\" (UID: \"a8f3b161-3401-49ab-9dd4-f7b921a569e1\") " pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:26:35.026033 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:35.025988    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 01:26:35.026033 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:35.026012    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 01:26:35.026033 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:35.026022    2584 projected.go:196] Error preparing data for projected volume kube-api-access-t884s for pod openshift-network-diagnostics/network-check-target-9kj2t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 01:26:35.026129 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:35.026074    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8f3b161-3401-49ab-9dd4-f7b921a569e1-kube-api-access-t884s podName:a8f3b161-3401-49ab-9dd4-f7b921a569e1 nodeName:}" failed. No retries permitted until 2026-07-06 01:26:36.026060956 +0000 UTC m=+4.267828816 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-t884s" (UniqueName: "kubernetes.io/projected/a8f3b161-3401-49ab-9dd4-f7b921a569e1-kube-api-access-t884s") pod "network-check-target-9kj2t" (UID: "a8f3b161-3401-49ab-9dd4-f7b921a569e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 01:26:35.355094 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:35.355048    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 01:21:34 +0000 UTC" deadline="2028-01-04 15:17:33.188862439 +0000 UTC"
Jul 06 01:26:35.355094 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:35.355092    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13141h50m57.833774489s"
Jul 06 01:26:35.609788 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:35.608976    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:26:35.609788 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:35.609123    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fkg2" podUID="d05d6ef9-2d73-4ab9-b875-7d121bd89c4d"
Jul 06 01:26:35.609788 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:35.609554    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:35.609788 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:35.609682    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tx6kv" podUID="1d0e1c2f-f2d9-4114-b29f-eae649ac05fc"
Jul 06 01:26:35.832338 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:35.832292    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs\") pod \"network-metrics-daemon-7fkg2\" (UID: \"d05d6ef9-2d73-4ab9-b875-7d121bd89c4d\") " pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:26:35.832537 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:35.832448    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 01:26:35.832537 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:35.832528    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs podName:d05d6ef9-2d73-4ab9-b875-7d121bd89c4d nodeName:}" failed. No retries permitted until 2026-07-06 01:26:37.832497427 +0000 UTC m=+6.074265290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs") pod "network-metrics-daemon-7fkg2" (UID: "d05d6ef9-2d73-4ab9-b875-7d121bd89c4d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 01:26:35.932813 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:35.932720    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-original-pull-secret\") pod \"global-pull-secret-syncer-tx6kv\" (UID: \"1d0e1c2f-f2d9-4114-b29f-eae649ac05fc\") " pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:35.932983 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:35.932896    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 01:26:35.932983 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:35.932963    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-original-pull-secret podName:1d0e1c2f-f2d9-4114-b29f-eae649ac05fc nodeName:}" failed. No retries permitted until 2026-07-06 01:26:37.932942697 +0000 UTC m=+6.174710544 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-original-pull-secret") pod "global-pull-secret-syncer-tx6kv" (UID: "1d0e1c2f-f2d9-4114-b29f-eae649ac05fc") : object "kube-system"/"original-pull-secret" not registered
Jul 06 01:26:36.033988 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:36.033948    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t884s\" (UniqueName: \"kubernetes.io/projected/a8f3b161-3401-49ab-9dd4-f7b921a569e1-kube-api-access-t884s\") pod \"network-check-target-9kj2t\" (UID: \"a8f3b161-3401-49ab-9dd4-f7b921a569e1\") " pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:26:36.034159 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:36.034137    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 01:26:36.034159 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:36.034157    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 01:26:36.034280 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:36.034171    2584 projected.go:196] Error preparing data for projected volume kube-api-access-t884s for pod openshift-network-diagnostics/network-check-target-9kj2t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 01:26:36.034280 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:36.034243    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8f3b161-3401-49ab-9dd4-f7b921a569e1-kube-api-access-t884s podName:a8f3b161-3401-49ab-9dd4-f7b921a569e1 nodeName:}" failed. No retries permitted until 2026-07-06 01:26:38.03421666 +0000 UTC m=+6.275984519 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-t884s" (UniqueName: "kubernetes.io/projected/a8f3b161-3401-49ab-9dd4-f7b921a569e1-kube-api-access-t884s") pod "network-check-target-9kj2t" (UID: "a8f3b161-3401-49ab-9dd4-f7b921a569e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 01:26:36.355355 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:36.355262    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 01:21:34 +0000 UTC" deadline="2028-02-27 01:03:39.423329628 +0000 UTC"
Jul 06 01:26:36.355355 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:36.355307    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14423h37m3.068028073s"
Jul 06 01:26:36.611842 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:36.609716    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:26:36.611842 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:36.609851    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kj2t" podUID="a8f3b161-3401-49ab-9dd4-f7b921a569e1"
Jul 06 01:26:37.609135 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:37.609094    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:26:37.609737 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:37.609253    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fkg2" podUID="d05d6ef9-2d73-4ab9-b875-7d121bd89c4d"
Jul 06 01:26:37.609737 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:37.609708    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:37.609850 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:37.609819    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tx6kv" podUID="1d0e1c2f-f2d9-4114-b29f-eae649ac05fc"
Jul 06 01:26:37.643725 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:37.643689    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-8.ec2.internal" event={"ID":"a39d0d7260635ade2bf76fa6546e26a1","Type":"ContainerStarted","Data":"f86a5d765b666513546c27488170da3f2f89ae5301b69a3a510cc316a93e6220"}
Jul 06 01:26:37.647760 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:37.647727    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal" event={"ID":"71f330f0340bfbcab58413a81f320c47","Type":"ContainerStarted","Data":"af435b5f7239151ae901e9bc1d9e57588d4c0a961e9cc5565ab1e2ec9973a811"}
Jul 06 01:26:37.673205 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:37.673086    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-8.ec2.internal" podStartSLOduration=4.673061691 podStartE2EDuration="4.673061691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:26:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:26:37.658242849 +0000 UTC m=+5.900010717" watchObservedRunningTime="2026-07-06 01:26:37.673061691 +0000 UTC m=+5.914829562"
Jul 06 01:26:37.849999 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:37.849069    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs\") pod \"network-metrics-daemon-7fkg2\" (UID: \"d05d6ef9-2d73-4ab9-b875-7d121bd89c4d\") " pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:26:37.849999 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:37.849205    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 01:26:37.849999 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:37.849353    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs podName:d05d6ef9-2d73-4ab9-b875-7d121bd89c4d nodeName:}" failed. No retries permitted until 2026-07-06 01:26:41.849269135 +0000 UTC m=+10.091036983 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs") pod "network-metrics-daemon-7fkg2" (UID: "d05d6ef9-2d73-4ab9-b875-7d121bd89c4d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 01:26:37.950740 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:37.949749    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-original-pull-secret\") pod \"global-pull-secret-syncer-tx6kv\" (UID: \"1d0e1c2f-f2d9-4114-b29f-eae649ac05fc\") " pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:37.950740 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:37.949914    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 01:26:37.950740 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:37.949985    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-original-pull-secret podName:1d0e1c2f-f2d9-4114-b29f-eae649ac05fc nodeName:}" failed. No retries permitted until 2026-07-06 01:26:41.949963382 +0000 UTC m=+10.191731233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-original-pull-secret") pod "global-pull-secret-syncer-tx6kv" (UID: "1d0e1c2f-f2d9-4114-b29f-eae649ac05fc") : object "kube-system"/"original-pull-secret" not registered
Jul 06 01:26:38.051184 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:38.050544    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t884s\" (UniqueName: \"kubernetes.io/projected/a8f3b161-3401-49ab-9dd4-f7b921a569e1-kube-api-access-t884s\") pod \"network-check-target-9kj2t\" (UID: \"a8f3b161-3401-49ab-9dd4-f7b921a569e1\") " pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:26:38.051184 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:38.050751    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 01:26:38.051184 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:38.050774    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 01:26:38.051184 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:38.050786    2584 projected.go:196] Error preparing data for projected volume kube-api-access-t884s for pod openshift-network-diagnostics/network-check-target-9kj2t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 01:26:38.051184 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:38.050843    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8f3b161-3401-49ab-9dd4-f7b921a569e1-kube-api-access-t884s podName:a8f3b161-3401-49ab-9dd4-f7b921a569e1 nodeName:}" failed. No retries permitted until 2026-07-06 01:26:42.050825902 +0000 UTC m=+10.292593750 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-t884s" (UniqueName: "kubernetes.io/projected/a8f3b161-3401-49ab-9dd4-f7b921a569e1-kube-api-access-t884s") pod "network-check-target-9kj2t" (UID: "a8f3b161-3401-49ab-9dd4-f7b921a569e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 01:26:38.610266 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:38.609756    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:26:38.610266 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:38.609895    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kj2t" podUID="a8f3b161-3401-49ab-9dd4-f7b921a569e1"
Jul 06 01:26:39.608955 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:39.608914    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:39.609159 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:39.609052    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tx6kv" podUID="1d0e1c2f-f2d9-4114-b29f-eae649ac05fc"
Jul 06 01:26:39.609587 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:39.609435    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:26:39.609587 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:39.609548    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fkg2" podUID="d05d6ef9-2d73-4ab9-b875-7d121bd89c4d"
Jul 06 01:26:39.653816 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:39.653760    2584 generic.go:356] "Generic (PLEG): container finished" podID="71f330f0340bfbcab58413a81f320c47" containerID="af435b5f7239151ae901e9bc1d9e57588d4c0a961e9cc5565ab1e2ec9973a811" exitCode=0
Jul 06 01:26:39.654273 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:39.653825    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal" event={"ID":"71f330f0340bfbcab58413a81f320c47","Type":"ContainerDied","Data":"af435b5f7239151ae901e9bc1d9e57588d4c0a961e9cc5565ab1e2ec9973a811"}
Jul 06 01:26:40.609687 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:40.609556    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:26:40.609867 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:40.609720    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kj2t" podUID="a8f3b161-3401-49ab-9dd4-f7b921a569e1"
Jul 06 01:26:41.610011 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:41.609973    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:26:41.610464 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:41.609974    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:41.610464 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:41.610137    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fkg2" podUID="d05d6ef9-2d73-4ab9-b875-7d121bd89c4d"
Jul 06 01:26:41.610464 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:41.610253    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tx6kv" podUID="1d0e1c2f-f2d9-4114-b29f-eae649ac05fc"
Jul 06 01:26:41.885852 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:41.885762    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs\") pod \"network-metrics-daemon-7fkg2\" (UID: \"d05d6ef9-2d73-4ab9-b875-7d121bd89c4d\") " pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:26:41.886004 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:41.885954    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 01:26:41.886052 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:41.886042    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs podName:d05d6ef9-2d73-4ab9-b875-7d121bd89c4d nodeName:}" failed. No retries permitted until 2026-07-06 01:26:49.886019717 +0000 UTC m=+18.127787585 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs") pod "network-metrics-daemon-7fkg2" (UID: "d05d6ef9-2d73-4ab9-b875-7d121bd89c4d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 01:26:41.987063 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:41.986838    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-original-pull-secret\") pod \"global-pull-secret-syncer-tx6kv\" (UID: \"1d0e1c2f-f2d9-4114-b29f-eae649ac05fc\") " pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:41.987063 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:41.987049    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 01:26:41.987303 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:41.987118    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-original-pull-secret podName:1d0e1c2f-f2d9-4114-b29f-eae649ac05fc nodeName:}" failed. No retries permitted until 2026-07-06 01:26:49.987099565 +0000 UTC m=+18.228867416 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-original-pull-secret") pod "global-pull-secret-syncer-tx6kv" (UID: "1d0e1c2f-f2d9-4114-b29f-eae649ac05fc") : object "kube-system"/"original-pull-secret" not registered
Jul 06 01:26:42.087722 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:42.087595    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t884s\" (UniqueName: \"kubernetes.io/projected/a8f3b161-3401-49ab-9dd4-f7b921a569e1-kube-api-access-t884s\") pod \"network-check-target-9kj2t\" (UID: \"a8f3b161-3401-49ab-9dd4-f7b921a569e1\") " pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:26:42.087891 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:42.087775    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 01:26:42.087891 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:42.087802    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 01:26:42.087891 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:42.087820    2584 projected.go:196] Error preparing data for projected volume kube-api-access-t884s for pod openshift-network-diagnostics/network-check-target-9kj2t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 01:26:42.087891 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:42.087888    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8f3b161-3401-49ab-9dd4-f7b921a569e1-kube-api-access-t884s podName:a8f3b161-3401-49ab-9dd4-f7b921a569e1 nodeName:}" failed. No retries permitted until 2026-07-06 01:26:50.087866864 +0000 UTC m=+18.329634712 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-t884s" (UniqueName: "kubernetes.io/projected/a8f3b161-3401-49ab-9dd4-f7b921a569e1-kube-api-access-t884s") pod "network-check-target-9kj2t" (UID: "a8f3b161-3401-49ab-9dd4-f7b921a569e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 01:26:42.610106 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:42.610074    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:26:42.610557 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:42.610193    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kj2t" podUID="a8f3b161-3401-49ab-9dd4-f7b921a569e1"
Jul 06 01:26:43.609705 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:43.609666    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:43.609885 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:43.609810    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tx6kv" podUID="1d0e1c2f-f2d9-4114-b29f-eae649ac05fc"
Jul 06 01:26:43.610203 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:43.610182    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:26:43.610552 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:43.610293    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fkg2" podUID="d05d6ef9-2d73-4ab9-b875-7d121bd89c4d"
Jul 06 01:26:44.609860 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:44.609805    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:26:44.610040 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:44.609940    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kj2t" podUID="a8f3b161-3401-49ab-9dd4-f7b921a569e1"
Jul 06 01:26:45.609976 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:45.609934    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:45.610438 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:45.609934    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:26:45.610438 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:45.610073    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tx6kv" podUID="1d0e1c2f-f2d9-4114-b29f-eae649ac05fc"
Jul 06 01:26:45.610438 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:45.610211    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fkg2" podUID="d05d6ef9-2d73-4ab9-b875-7d121bd89c4d"
Jul 06 01:26:46.609659 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:46.609612    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:26:46.609854 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:46.609755    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kj2t" podUID="a8f3b161-3401-49ab-9dd4-f7b921a569e1"
Jul 06 01:26:47.609315 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:47.609279    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:26:47.609791 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:47.609279    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:47.609791 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:47.609429    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fkg2" podUID="d05d6ef9-2d73-4ab9-b875-7d121bd89c4d"
Jul 06 01:26:47.609791 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:47.609466    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tx6kv" podUID="1d0e1c2f-f2d9-4114-b29f-eae649ac05fc"
Jul 06 01:26:48.609168 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:48.609126    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:26:48.609364 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:48.609271    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kj2t" podUID="a8f3b161-3401-49ab-9dd4-f7b921a569e1"
Jul 06 01:26:49.609715 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:49.609674    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:49.610228 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:49.609674    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:26:49.610228 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:49.609801    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tx6kv" podUID="1d0e1c2f-f2d9-4114-b29f-eae649ac05fc"
Jul 06 01:26:49.610228 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:49.609907    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fkg2" podUID="d05d6ef9-2d73-4ab9-b875-7d121bd89c4d"
Jul 06 01:26:49.945303 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:49.945216    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs\") pod \"network-metrics-daemon-7fkg2\" (UID: \"d05d6ef9-2d73-4ab9-b875-7d121bd89c4d\") " pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:26:49.945455 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:49.945342    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 01:26:49.945455 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:49.945400    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs podName:d05d6ef9-2d73-4ab9-b875-7d121bd89c4d nodeName:}" failed. No retries permitted until 2026-07-06 01:27:05.945385534 +0000 UTC m=+34.187153379 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs") pod "network-metrics-daemon-7fkg2" (UID: "d05d6ef9-2d73-4ab9-b875-7d121bd89c4d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 01:26:50.046294 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:50.046254    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-original-pull-secret\") pod \"global-pull-secret-syncer-tx6kv\" (UID: \"1d0e1c2f-f2d9-4114-b29f-eae649ac05fc\") " pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:50.046484 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:50.046428    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 01:26:50.046549 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:50.046509    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-original-pull-secret podName:1d0e1c2f-f2d9-4114-b29f-eae649ac05fc nodeName:}" failed. No retries permitted until 2026-07-06 01:27:06.04648979 +0000 UTC m=+34.288257638 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-original-pull-secret") pod "global-pull-secret-syncer-tx6kv" (UID: "1d0e1c2f-f2d9-4114-b29f-eae649ac05fc") : object "kube-system"/"original-pull-secret" not registered
Jul 06 01:26:50.147304 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:50.147247    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t884s\" (UniqueName: \"kubernetes.io/projected/a8f3b161-3401-49ab-9dd4-f7b921a569e1-kube-api-access-t884s\") pod \"network-check-target-9kj2t\" (UID: \"a8f3b161-3401-49ab-9dd4-f7b921a569e1\") " pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:26:50.147470 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:50.147450    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 01:26:50.147509 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:50.147475    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 01:26:50.147509 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:50.147490    2584 projected.go:196] Error preparing data for projected volume kube-api-access-t884s for pod openshift-network-diagnostics/network-check-target-9kj2t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 01:26:50.147589 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:50.147565    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8f3b161-3401-49ab-9dd4-f7b921a569e1-kube-api-access-t884s podName:a8f3b161-3401-49ab-9dd4-f7b921a569e1 nodeName:}" failed. No retries permitted until 2026-07-06 01:27:06.147538497 +0000 UTC m=+34.389306356 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-t884s" (UniqueName: "kubernetes.io/projected/a8f3b161-3401-49ab-9dd4-f7b921a569e1-kube-api-access-t884s") pod "network-check-target-9kj2t" (UID: "a8f3b161-3401-49ab-9dd4-f7b921a569e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 01:26:50.609400 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:50.609366    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:26:50.609587 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:50.609489    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kj2t" podUID="a8f3b161-3401-49ab-9dd4-f7b921a569e1"
Jul 06 01:26:51.608990 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:51.608958    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:26:51.609464 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:51.609097    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fkg2" podUID="d05d6ef9-2d73-4ab9-b875-7d121bd89c4d"
Jul 06 01:26:51.609464 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:51.609112    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:51.609464 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:51.609222    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tx6kv" podUID="1d0e1c2f-f2d9-4114-b29f-eae649ac05fc"
Jul 06 01:26:52.610672 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:52.610616    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:26:52.611104 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:52.610758    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kj2t" podUID="a8f3b161-3401-49ab-9dd4-f7b921a569e1"
Jul 06 01:26:53.609669 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:53.609633    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:26:53.609669 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:53.609678    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:53.609878 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:53.609756    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fkg2" podUID="d05d6ef9-2d73-4ab9-b875-7d121bd89c4d"
Jul 06 01:26:53.609922 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:53.609891    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tx6kv" podUID="1d0e1c2f-f2d9-4114-b29f-eae649ac05fc"
Jul 06 01:26:54.609250 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:54.609040    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:26:54.610081 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:54.609353    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kj2t" podUID="a8f3b161-3401-49ab-9dd4-f7b921a569e1"
Jul 06 01:26:54.684178 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:54.684143    2584 generic.go:356] "Generic (PLEG): container finished" podID="3f01121e-88d5-4f62-bae1-6957d6f8969a" containerID="f1dd20f08dd6afe5dc266f8a13700ac08646fe5ef3190599cf8f51837788b5a0" exitCode=0
Jul 06 01:26:54.684349 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:54.684246    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qmzt" event={"ID":"3f01121e-88d5-4f62-bae1-6957d6f8969a","Type":"ContainerDied","Data":"f1dd20f08dd6afe5dc266f8a13700ac08646fe5ef3190599cf8f51837788b5a0"}
Jul 06 01:26:54.686051 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:54.686025    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bphvc" event={"ID":"077f7485-8962-4195-b5a1-26f4e3b1c3e0","Type":"ContainerStarted","Data":"577998af22c6772504569e9ee956b238dfb248b575abfd3f95f4e81f1b134133"}
Jul 06 01:26:54.688165 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:54.688137    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal" event={"ID":"71f330f0340bfbcab58413a81f320c47","Type":"ContainerStarted","Data":"a168030064fdc15593583b7b347e413e42c0f18ad2bbc2fd66864cf9a15e974b"}
Jul 06 01:26:54.689804 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:54.689777    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6" event={"ID":"35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc","Type":"ContainerStarted","Data":"9234abe4ee4811fbcf9cb03ce59c200573488559deb931cbdcb90cddc4d31da4"}
Jul 06 01:26:54.691449 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:54.691422    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5gfv5" event={"ID":"afe45663-750d-40c6-aae9-69a91e054d7f","Type":"ContainerStarted","Data":"0a5218bc1e3e442f48a6c75dc6e63526cc32e55e5b4f3b5bf4911640d97a0823"}
Jul 06 01:26:54.693293 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:54.693260    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wkxsp" event={"ID":"3f407833-2077-45ce-85d9-dbb45b639be0","Type":"ContainerStarted","Data":"941b1ff8b07510e07a9f0489afc7b7b7f959c2087a20f567aec544a0e7b74050"}
Jul 06 01:26:54.694757 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:54.694733    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-th2j5" event={"ID":"0a61dd74-ba03-41b4-a076-771a636d7538","Type":"ContainerStarted","Data":"3d9e6ace1427c6dd6ac700ef2657db0b62c8ed5b1470916056f7ce02f30a3466"}
Jul 06 01:26:54.696193 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:54.696168    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zzmqr" event={"ID":"a357dec8-e2fb-4fd2-bea2-5f16400a0aef","Type":"ContainerStarted","Data":"2335dce605c6ff1b8f80bfecd0e1d42d269487c89cdafd66fe3cee24d50d7eb1"}
Jul 06 01:26:54.699696 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:54.699673    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg" event={"ID":"07c965a6-ea92-4d74-b540-92e2d82572da","Type":"ContainerStarted","Data":"69a8dad021328e5f1beb4a2a4f50412406e47238310219ecdb79890a0e7c1bc2"}
Jul 06 01:26:54.699837 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:54.699736    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg" event={"ID":"07c965a6-ea92-4d74-b540-92e2d82572da","Type":"ContainerStarted","Data":"5e1e3d5cc0f04297c58034b77ff250ab8b7007c05bfcbb6fc8ad850903366fe1"}
Jul 06 01:26:54.699837 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:54.699767    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg" event={"ID":"07c965a6-ea92-4d74-b540-92e2d82572da","Type":"ContainerStarted","Data":"bc8b8bb6a0b24a8a24263ef157b9b24b1ca6527e324329c665be148fef6d9bdb"}
Jul 06 01:26:54.699837 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:54.699796    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg" event={"ID":"07c965a6-ea92-4d74-b540-92e2d82572da","Type":"ContainerStarted","Data":"2ec1609a8f70452496d5512f590f93713f1d33b96d9c48dbfc758d590623e9dd"}
Jul 06 01:26:54.699837 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:54.699826    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg" event={"ID":"07c965a6-ea92-4d74-b540-92e2d82572da","Type":"ContainerStarted","Data":"dbe5adaf72c574677b9b02abf5633e62bc33ecccf867a0a8d70d9b227ec1c228"}
Jul 06 01:26:54.700049 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:54.699851    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg" event={"ID":"07c965a6-ea92-4d74-b540-92e2d82572da","Type":"ContainerStarted","Data":"afefd570298de767ac85ea03c5b36860df014ccef99fc349d7396c0f123d0847"}
Jul 06 01:26:54.719160 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:54.719088    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zzmqr" podStartSLOduration=3.422622785 podStartE2EDuration="22.719067456s" totalImagesPullingTime="19.296444671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:26:54.718593411 +0000 UTC m=+22.960361281" watchObservedRunningTime="2026-07-06 01:26:54.719067456 +0000 UTC m=+22.960835325"
Jul 06 01:26:54.734587 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:54.734535    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-th2j5" podStartSLOduration=3.448018081 podStartE2EDuration="22.734516855s" totalImagesPullingTime="19.286498774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:26:54.734240069 +0000 UTC m=+22.976007937" watchObservedRunningTime="2026-07-06 01:26:54.734516855 +0000 UTC m=+22.976284724"
Jul 06 01:26:54.748346 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:54.748283    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bphvc" podStartSLOduration=3.502992928 podStartE2EDuration="22.748267133s" totalImagesPullingTime="19.245274205s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:26:54.7476864 +0000 UTC m=+22.989454269" watchObservedRunningTime="2026-07-06 01:26:54.748267133 +0000 UTC m=+22.990034999"
Jul 06 01:26:54.794308 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:54.794256    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-8.ec2.internal" podStartSLOduration=21.794237855 podStartE2EDuration="21.794237855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:26:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:26:54.794195859 +0000 UTC m=+23.035963741" watchObservedRunningTime="2026-07-06 01:26:54.794237855 +0000 UTC m=+23.036005721"
Jul 06 01:26:54.794931 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:54.794896    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wkxsp" podStartSLOduration=3.525287575 podStartE2EDuration="22.794887551s" totalImagesPullingTime="19.269599976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:26:54.773310243 +0000 UTC m=+23.015078111" watchObservedRunningTime="2026-07-06 01:26:54.794887551 +0000 UTC m=+23.036655418"
Jul 06 01:26:54.819110 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:54.819009    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5gfv5" podStartSLOduration=3.549296672 podStartE2EDuration="22.81898788s" totalImagesPullingTime="19.269691208s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:26:54.818363952 +0000 UTC m=+23.060131822" watchObservedRunningTime="2026-07-06 01:26:54.81898788 +0000 UTC m=+23.060755747"
Jul 06 01:26:55.424212 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:55.424176    2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 01:26:55.591071 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:55.590917    2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T01:26:55.424205551Z","UUID":"32ae7842-4e48-4940-8cd9-694c02539f51","Handler":null,"Name":"","Endpoint":""}
Jul 06 01:26:55.592283 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:55.592264    2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 01:26:55.592391 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:55.592302    2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 01:26:55.609547 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:55.609515    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:26:55.609547 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:55.609541    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:55.610014 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:55.609659    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fkg2" podUID="d05d6ef9-2d73-4ab9-b875-7d121bd89c4d"
Jul 06 01:26:55.610014 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:55.609738    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tx6kv" podUID="1d0e1c2f-f2d9-4114-b29f-eae649ac05fc"
Jul 06 01:26:55.703941 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:55.703899    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6" event={"ID":"35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc","Type":"ContainerStarted","Data":"11f5c64709d43b7c94a8c890631b075516f6f9683b770112a8210f2fadae7f1a"}
Jul 06 01:26:55.705587 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:55.705553    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9fkfs" event={"ID":"80aef9e5-5abe-4811-aeed-121974d1e798","Type":"ContainerStarted","Data":"84e96acc2adbd98bd58d6b9b8d028da54cb1bd79b6abacba0cc796b9069efc3f"}
Jul 06 01:26:56.609663 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:56.609610    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:26:56.610262 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:56.609741    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kj2t" podUID="a8f3b161-3401-49ab-9dd4-f7b921a569e1"
Jul 06 01:26:57.609646 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:57.609601    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:57.609913 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:57.609735    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tx6kv" podUID="1d0e1c2f-f2d9-4114-b29f-eae649ac05fc"
Jul 06 01:26:57.609913 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:57.609780    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:26:57.610289 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:57.609909    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fkg2" podUID="d05d6ef9-2d73-4ab9-b875-7d121bd89c4d"
Jul 06 01:26:57.713306 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:57.713267    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6" event={"ID":"35b20e23-0cb9-4a29-b2fe-e3ecdd1efecc","Type":"ContainerStarted","Data":"0c22d3aee6a51a6454a4a7441ecc0203405dd3053d361987e2f513f5e766c5df"}
Jul 06 01:26:57.717206 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:57.717175    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg" event={"ID":"07c965a6-ea92-4d74-b540-92e2d82572da","Type":"ContainerStarted","Data":"1c8460a2d17a683625b809c373fb531728a6aea38d5b48a055c507e0f8a2a7b0"}
Jul 06 01:26:57.730855 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:57.730796    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9fkfs" podStartSLOduration=6.425171932 podStartE2EDuration="25.730773079s" totalImagesPullingTime="19.305601147s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:26:55.720983517 +0000 UTC m=+23.962751386" watchObservedRunningTime="2026-07-06 01:26:57.730773079 +0000 UTC m=+25.972540944"
Jul 06 01:26:57.731587 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:57.731549    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zltx6" podStartSLOduration=11.627487389 podStartE2EDuration="24.731527681s" totalImagesPullingTime="13.104040292s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:26:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:26:57.731096746 +0000 UTC m=+25.972864612" watchObservedRunningTime="2026-07-06 01:26:57.731527681 +0000 UTC m=+25.973295549"
Jul 06 01:26:58.311338 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:58.311148    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wkxsp"
Jul 06 01:26:58.609620 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:58.609530    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:26:58.609824 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:58.609692    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kj2t" podUID="a8f3b161-3401-49ab-9dd4-f7b921a569e1"
Jul 06 01:26:58.866814 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:58.866728    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wkxsp"
Jul 06 01:26:58.867453 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:58.867433    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wkxsp"
Jul 06 01:26:59.609117 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:59.609073    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:26:59.609180 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:59.609116    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:26:59.609397 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:59.609215    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tx6kv" podUID="1d0e1c2f-f2d9-4114-b29f-eae649ac05fc"
Jul 06 01:26:59.609397 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:26:59.609365    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fkg2" podUID="d05d6ef9-2d73-4ab9-b875-7d121bd89c4d"
Jul 06 01:26:59.726231 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:59.725866    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg" event={"ID":"07c965a6-ea92-4d74-b540-92e2d82572da","Type":"ContainerStarted","Data":"84117318e665f81af0fb136e258cfccc48d9dc5ef351b451d6211c1aa1a188ac"}
Jul 06 01:26:59.726721 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:59.726696    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wkxsp"
Jul 06 01:26:59.752566 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:26:59.752495    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg" podStartSLOduration=7.319788663 podStartE2EDuration="26.752471857s" totalImagesPullingTime="19.432683194s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:26:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:26:59.751989383 +0000 UTC m=+27.993757261" watchObservedRunningTime="2026-07-06 01:26:59.752471857 +0000 UTC m=+27.994239727"
Jul 06 01:27:00.609757 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:00.609723    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:27:00.610541 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:00.609843    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kj2t" podUID="a8f3b161-3401-49ab-9dd4-f7b921a569e1"
Jul 06 01:27:00.730364 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:00.730325    2584 generic.go:356] "Generic (PLEG): container finished" podID="3f01121e-88d5-4f62-bae1-6957d6f8969a" containerID="68bd36a5c4a8dd49208f4a5bb602809703c64bad6469eb1123c73713a53a97cc" exitCode=0
Jul 06 01:27:00.730597 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:00.730426    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qmzt" event={"ID":"3f01121e-88d5-4f62-bae1-6957d6f8969a","Type":"ContainerDied","Data":"68bd36a5c4a8dd49208f4a5bb602809703c64bad6469eb1123c73713a53a97cc"}
Jul 06 01:27:00.730597 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:00.730515    2584 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 01:27:00.730998 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:00.730973    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:27:00.735185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:00.731487    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:27:00.755337 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:00.755229    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:27:00.756116 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:00.756080    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:27:01.609499 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:01.609156    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:27:01.609499 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:01.609308    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fkg2" podUID="d05d6ef9-2d73-4ab9-b875-7d121bd89c4d"
Jul 06 01:27:01.609734 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:01.609532    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:27:01.609734 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:01.609654    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tx6kv" podUID="1d0e1c2f-f2d9-4114-b29f-eae649ac05fc"
Jul 06 01:27:01.735023 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:01.734972    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qmzt" event={"ID":"3f01121e-88d5-4f62-bae1-6957d6f8969a","Type":"ContainerStarted","Data":"2c717ff433948d16e825efacb858cdb313aca1b8782a2906a38083e8389e4a16"}
Jul 06 01:27:01.735023 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:01.735006    2584 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 01:27:01.760428 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:01.760377    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tx6kv"]
Jul 06 01:27:01.760582 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:01.760506    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:27:01.760675 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:01.760643    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tx6kv" podUID="1d0e1c2f-f2d9-4114-b29f-eae649ac05fc"
Jul 06 01:27:01.760997 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:01.760968    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7fkg2"]
Jul 06 01:27:01.761124 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:01.761071    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:27:01.761201 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:01.761180    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fkg2" podUID="d05d6ef9-2d73-4ab9-b875-7d121bd89c4d"
Jul 06 01:27:01.771571 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:01.771541    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9kj2t"]
Jul 06 01:27:01.771725 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:01.771692    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:27:01.771821 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:01.771799    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kj2t" podUID="a8f3b161-3401-49ab-9dd4-f7b921a569e1"
Jul 06 01:27:02.739419 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:02.739376    2584 generic.go:356] "Generic (PLEG): container finished" podID="3f01121e-88d5-4f62-bae1-6957d6f8969a" containerID="2c717ff433948d16e825efacb858cdb313aca1b8782a2906a38083e8389e4a16" exitCode=0
Jul 06 01:27:02.739821 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:02.739458    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qmzt" event={"ID":"3f01121e-88d5-4f62-bae1-6957d6f8969a","Type":"ContainerDied","Data":"2c717ff433948d16e825efacb858cdb313aca1b8782a2906a38083e8389e4a16"}
Jul 06 01:27:02.739821 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:02.739540    2584 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 01:27:03.609376 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:03.609187    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:27:03.609608 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:03.609246    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:27:03.609608 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:03.609482    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tx6kv" podUID="1d0e1c2f-f2d9-4114-b29f-eae649ac05fc"
Jul 06 01:27:03.609608 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:03.609246    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:27:03.609608 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:03.609556    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kj2t" podUID="a8f3b161-3401-49ab-9dd4-f7b921a569e1"
Jul 06 01:27:03.609827 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:03.609663    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fkg2" podUID="d05d6ef9-2d73-4ab9-b875-7d121bd89c4d"
Jul 06 01:27:03.852916 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:03.852799    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:27:04.746226 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:04.746192    2584 generic.go:356] "Generic (PLEG): container finished" podID="3f01121e-88d5-4f62-bae1-6957d6f8969a" containerID="90d8c0119ad845ce2a7fc06f7bfc00295be50b6373a04119a8fa90d3be6333d8" exitCode=0
Jul 06 01:27:04.746419 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:04.746245    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qmzt" event={"ID":"3f01121e-88d5-4f62-bae1-6957d6f8969a","Type":"ContainerDied","Data":"90d8c0119ad845ce2a7fc06f7bfc00295be50b6373a04119a8fa90d3be6333d8"}
Jul 06 01:27:05.609068 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:05.608968    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:27:05.609068 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:05.608984    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:27:05.609541 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:05.609085    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:27:05.609541 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:05.609085    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9kj2t" podUID="a8f3b161-3401-49ab-9dd4-f7b921a569e1"
Jul 06 01:27:05.609541 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:05.609157    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tx6kv" podUID="1d0e1c2f-f2d9-4114-b29f-eae649ac05fc"
Jul 06 01:27:05.609541 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:05.609252    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fkg2" podUID="d05d6ef9-2d73-4ab9-b875-7d121bd89c4d"
Jul 06 01:27:05.972488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:05.972404    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs\") pod \"network-metrics-daemon-7fkg2\" (UID: \"d05d6ef9-2d73-4ab9-b875-7d121bd89c4d\") " pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:27:05.972709 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:05.972537    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 01:27:05.972709 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:05.972595    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs podName:d05d6ef9-2d73-4ab9-b875-7d121bd89c4d nodeName:}" failed. No retries permitted until 2026-07-06 01:27:37.972578745 +0000 UTC m=+66.214346613 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs") pod "network-metrics-daemon-7fkg2" (UID: "d05d6ef9-2d73-4ab9-b875-7d121bd89c4d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 01:27:06.073636 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.073596    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-original-pull-secret\") pod \"global-pull-secret-syncer-tx6kv\" (UID: \"1d0e1c2f-f2d9-4114-b29f-eae649ac05fc\") " pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:27:06.073821 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:06.073742    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 01:27:06.073821 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:06.073819    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-original-pull-secret podName:1d0e1c2f-f2d9-4114-b29f-eae649ac05fc nodeName:}" failed. No retries permitted until 2026-07-06 01:27:38.073799399 +0000 UTC m=+66.315567246 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-original-pull-secret") pod "global-pull-secret-syncer-tx6kv" (UID: "1d0e1c2f-f2d9-4114-b29f-eae649ac05fc") : object "kube-system"/"original-pull-secret" not registered
Jul 06 01:27:06.174297 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.174259    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t884s\" (UniqueName: \"kubernetes.io/projected/a8f3b161-3401-49ab-9dd4-f7b921a569e1-kube-api-access-t884s\") pod \"network-check-target-9kj2t\" (UID: \"a8f3b161-3401-49ab-9dd4-f7b921a569e1\") " pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:27:06.174479 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:06.174440    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 01:27:06.174479 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:06.174460    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 01:27:06.174479 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:06.174471    2584 projected.go:196] Error preparing data for projected volume kube-api-access-t884s for pod openshift-network-diagnostics/network-check-target-9kj2t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 01:27:06.174657 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:06.174539    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8f3b161-3401-49ab-9dd4-f7b921a569e1-kube-api-access-t884s podName:a8f3b161-3401-49ab-9dd4-f7b921a569e1 nodeName:}" failed. No retries permitted until 2026-07-06 01:27:38.174518611 +0000 UTC m=+66.416286472 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-t884s" (UniqueName: "kubernetes.io/projected/a8f3b161-3401-49ab-9dd4-f7b921a569e1-kube-api-access-t884s") pod "network-check-target-9kj2t" (UID: "a8f3b161-3401-49ab-9dd4-f7b921a569e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 01:27:06.551817 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.551783    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-8.ec2.internal" event="NodeReady"
Jul 06 01:27:06.552005 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.551942    2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 01:27:06.588373 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.588338    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq"]
Jul 06 01:27:06.592502 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.592477    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq"
Jul 06 01:27:06.594323 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.594297    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-69788b8597-tt6ch"]
Jul 06 01:27:06.596018 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.595783    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 06 01:27:06.596018 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.595861    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4r7xt\""
Jul 06 01:27:06.596018 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.595999    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 06 01:27:06.598132 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.598111    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:06.601651 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.601580    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 01:27:06.602019 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.601997    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qzthl\""
Jul 06 01:27:06.602690 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.602213    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 01:27:06.602690 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.602523    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 01:27:06.603484 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.603462    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq"]
Jul 06 01:27:06.608226 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.608194    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n968n"]
Jul 06 01:27:06.608389 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.608342    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 01:27:06.613095 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.612713    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8fc8h"]
Jul 06 01:27:06.613554 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.613199    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n968n"
Jul 06 01:27:06.617043 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.617017    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 01:27:06.617200 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.617182    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:27:06.617267 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.617021    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 01:27:06.617319 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.617159    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 01:27:06.617372 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.617054    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bszxs\""
Jul 06 01:27:06.621513 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.620980    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 01:27:06.621513 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.621273    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 01:27:06.622059 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.622038    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-58ndz\""
Jul 06 01:27:06.625140 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.624995    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69788b8597-tt6ch"]
Jul 06 01:27:06.625140 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.625053    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n968n"]
Jul 06 01:27:06.625140 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.625076    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8fc8h"]
Jul 06 01:27:06.678505 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.678383    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91217fbf-2d05-4fea-a848-ce72d151cd49-ca-trust-extracted\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:06.678505 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.678460    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-certificates\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:06.678505 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.678499    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-pxfqq\" (UID: \"066f3b60-6fb4-4d35-8fc8-9ed67cbd937d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq"
Jul 06 01:27:06.678796 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.678529    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-bound-sa-token\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:06.678796 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.678558    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr5mz\" (UniqueName: \"kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-kube-api-access-xr5mz\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:06.678796 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.678577    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91217fbf-2d05-4fea-a848-ce72d151cd49-trusted-ca\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:06.678796 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.678597    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-pxfqq\" (UID: \"066f3b60-6fb4-4d35-8fc8-9ed67cbd937d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq"
Jul 06 01:27:06.678796 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.678661    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91217fbf-2d05-4fea-a848-ce72d151cd49-image-registry-private-configuration\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:06.678796 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.678689    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91217fbf-2d05-4fea-a848-ce72d151cd49-installation-pull-secrets\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:06.678796 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.678722    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:06.779200 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.779166    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-certificates\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:06.779200 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.779205    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-config-volume\") pod \"dns-default-8fc8h\" (UID: \"a1f9d1bf-1910-4c4b-be53-9b51824e21c0\") " pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:27:06.779442 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.779229    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-pxfqq\" (UID: \"066f3b60-6fb4-4d35-8fc8-9ed67cbd937d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq"
Jul 06 01:27:06.779442 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.779249    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr9sm\" (UniqueName: \"kubernetes.io/projected/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-kube-api-access-tr9sm\") pod \"dns-default-8fc8h\" (UID: \"a1f9d1bf-1910-4c4b-be53-9b51824e21c0\") " pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:27:06.779442 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:06.779368    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 01:27:06.779442 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.779367    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-bound-sa-token\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:06.780236 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:06.779447    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert podName:066f3b60-6fb4-4d35-8fc8-9ed67cbd937d nodeName:}" failed. No retries permitted until 2026-07-06 01:27:07.279420104 +0000 UTC m=+35.521187952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-pxfqq" (UID: "066f3b60-6fb4-4d35-8fc8-9ed67cbd937d") : secret "networking-console-plugin-cert" not found
Jul 06 01:27:06.780236 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.779495    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr5mz\" (UniqueName: \"kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-kube-api-access-xr5mz\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:06.780236 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.779540    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91217fbf-2d05-4fea-a848-ce72d151cd49-trusted-ca\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:06.780236 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.779567    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-pxfqq\" (UID: \"066f3b60-6fb4-4d35-8fc8-9ed67cbd937d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq"
Jul 06 01:27:06.780236 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.779595    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91217fbf-2d05-4fea-a848-ce72d151cd49-image-registry-private-configuration\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:06.780236 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.779641    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f669e88b-69be-4f0d-91c4-afadc96a25b7-cert\") pod \"ingress-canary-n968n\" (UID: \"f669e88b-69be-4f0d-91c4-afadc96a25b7\") " pod="openshift-ingress-canary/ingress-canary-n968n"
Jul 06 01:27:06.780236 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.779671    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91217fbf-2d05-4fea-a848-ce72d151cd49-installation-pull-secrets\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:06.780236 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.779695    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4454k\" (UniqueName: \"kubernetes.io/projected/f669e88b-69be-4f0d-91c4-afadc96a25b7-kube-api-access-4454k\") pod \"ingress-canary-n968n\" (UID: \"f669e88b-69be-4f0d-91c4-afadc96a25b7\") " pod="openshift-ingress-canary/ingress-canary-n968n"
Jul 06 01:27:06.780236 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.779739    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:06.780236 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.779764    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls\") pod \"dns-default-8fc8h\" (UID: \"a1f9d1bf-1910-4c4b-be53-9b51824e21c0\") " pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:27:06.780236 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:06.779819    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 01:27:06.780236 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:06.779835    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69788b8597-tt6ch: secret "image-registry-tls" not found
Jul 06 01:27:06.780236 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.779833    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91217fbf-2d05-4fea-a848-ce72d151cd49-ca-trust-extracted\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:06.780236 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:06.779894    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls podName:91217fbf-2d05-4fea-a848-ce72d151cd49 nodeName:}" failed. No retries permitted until 2026-07-06 01:27:07.279876869 +0000 UTC m=+35.521644715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls") pod "image-registry-69788b8597-tt6ch" (UID: "91217fbf-2d05-4fea-a848-ce72d151cd49") : secret "image-registry-tls" not found
Jul 06 01:27:06.780236 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.779950    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-tmp-dir\") pod \"dns-default-8fc8h\" (UID: \"a1f9d1bf-1910-4c4b-be53-9b51824e21c0\") " pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:27:06.780236 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.780117    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-certificates\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:06.781254 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.780171    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91217fbf-2d05-4fea-a848-ce72d151cd49-ca-trust-extracted\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:06.781254 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.780368    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-pxfqq\" (UID: \"066f3b60-6fb4-4d35-8fc8-9ed67cbd937d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq"
Jul 06 01:27:06.781254 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.780592    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91217fbf-2d05-4fea-a848-ce72d151cd49-trusted-ca\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:06.784435 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.784407    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91217fbf-2d05-4fea-a848-ce72d151cd49-installation-pull-secrets\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:06.784435 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.784429    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91217fbf-2d05-4fea-a848-ce72d151cd49-image-registry-private-configuration\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:06.789033 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.789000    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-bound-sa-token\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:06.789266 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.789231    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr5mz\" (UniqueName: \"kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-kube-api-access-xr5mz\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:06.880926 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.880887    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr9sm\" (UniqueName: \"kubernetes.io/projected/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-kube-api-access-tr9sm\") pod \"dns-default-8fc8h\" (UID: \"a1f9d1bf-1910-4c4b-be53-9b51824e21c0\") " pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:27:06.881103 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.880946    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f669e88b-69be-4f0d-91c4-afadc96a25b7-cert\") pod \"ingress-canary-n968n\" (UID: \"f669e88b-69be-4f0d-91c4-afadc96a25b7\") " pod="openshift-ingress-canary/ingress-canary-n968n"
Jul 06 01:27:06.881223 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.881205    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4454k\" (UniqueName: \"kubernetes.io/projected/f669e88b-69be-4f0d-91c4-afadc96a25b7-kube-api-access-4454k\") pod \"ingress-canary-n968n\" (UID: \"f669e88b-69be-4f0d-91c4-afadc96a25b7\") " pod="openshift-ingress-canary/ingress-canary-n968n"
Jul 06 01:27:06.881302 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.881264    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls\") pod \"dns-default-8fc8h\" (UID: \"a1f9d1bf-1910-4c4b-be53-9b51824e21c0\") " pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:27:06.881357 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.881324    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-tmp-dir\") pod \"dns-default-8fc8h\" (UID: \"a1f9d1bf-1910-4c4b-be53-9b51824e21c0\") " pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:27:06.881390 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.881357    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-config-volume\") pod \"dns-default-8fc8h\" (UID: \"a1f9d1bf-1910-4c4b-be53-9b51824e21c0\") " pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:27:06.881441 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:06.881420    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 01:27:06.881597 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:06.881486    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls podName:a1f9d1bf-1910-4c4b-be53-9b51824e21c0 nodeName:}" failed. No retries permitted until 2026-07-06 01:27:07.381467745 +0000 UTC m=+35.623235603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls") pod "dns-default-8fc8h" (UID: "a1f9d1bf-1910-4c4b-be53-9b51824e21c0") : secret "dns-default-metrics-tls" not found
Jul 06 01:27:06.881796 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.881744    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-tmp-dir\") pod \"dns-default-8fc8h\" (UID: \"a1f9d1bf-1910-4c4b-be53-9b51824e21c0\") " pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:27:06.882113 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.882093    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-config-volume\") pod \"dns-default-8fc8h\" (UID: \"a1f9d1bf-1910-4c4b-be53-9b51824e21c0\") " pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:27:06.884002 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.883978    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f669e88b-69be-4f0d-91c4-afadc96a25b7-cert\") pod \"ingress-canary-n968n\" (UID: \"f669e88b-69be-4f0d-91c4-afadc96a25b7\") " pod="openshift-ingress-canary/ingress-canary-n968n"
Jul 06 01:27:06.890389 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.890361    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr9sm\" (UniqueName: \"kubernetes.io/projected/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-kube-api-access-tr9sm\") pod \"dns-default-8fc8h\" (UID: \"a1f9d1bf-1910-4c4b-be53-9b51824e21c0\") " pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:27:06.890549 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.890453    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4454k\" (UniqueName: \"kubernetes.io/projected/f669e88b-69be-4f0d-91c4-afadc96a25b7-kube-api-access-4454k\") pod \"ingress-canary-n968n\" (UID: \"f669e88b-69be-4f0d-91c4-afadc96a25b7\") " pod="openshift-ingress-canary/ingress-canary-n968n"
Jul 06 01:27:06.926509 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:06.926471    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n968n"
Jul 06 01:27:07.073896 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:07.073725    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n968n"]
Jul 06 01:27:07.077843 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:27:07.077809    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf669e88b_69be_4f0d_91c4_afadc96a25b7.slice/crio-e5114f2ee5ed859fbd79c0e0950d90b8a8c16b2bb8a2452e557f9dbcf2dc226e WatchSource:0}: Error finding container e5114f2ee5ed859fbd79c0e0950d90b8a8c16b2bb8a2452e557f9dbcf2dc226e: Status 404 returned error can't find the container with id e5114f2ee5ed859fbd79c0e0950d90b8a8c16b2bb8a2452e557f9dbcf2dc226e
Jul 06 01:27:07.284967 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:07.284839    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-pxfqq\" (UID: \"066f3b60-6fb4-4d35-8fc8-9ed67cbd937d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq"
Jul 06 01:27:07.284967 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:07.284930    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:07.285166 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:07.284981    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 01:27:07.285166 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:07.285052    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 01:27:07.285166 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:07.285066    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69788b8597-tt6ch: secret "image-registry-tls" not found
Jul 06 01:27:07.285166 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:07.285065    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert podName:066f3b60-6fb4-4d35-8fc8-9ed67cbd937d nodeName:}" failed. No retries permitted until 2026-07-06 01:27:08.285044098 +0000 UTC m=+36.526811957 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-pxfqq" (UID: "066f3b60-6fb4-4d35-8fc8-9ed67cbd937d") : secret "networking-console-plugin-cert" not found
Jul 06 01:27:07.285166 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:07.285109    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls podName:91217fbf-2d05-4fea-a848-ce72d151cd49 nodeName:}" failed. No retries permitted until 2026-07-06 01:27:08.285097287 +0000 UTC m=+36.526865138 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls") pod "image-registry-69788b8597-tt6ch" (UID: "91217fbf-2d05-4fea-a848-ce72d151cd49") : secret "image-registry-tls" not found
Jul 06 01:27:07.386214 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:07.386180    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls\") pod \"dns-default-8fc8h\" (UID: \"a1f9d1bf-1910-4c4b-be53-9b51824e21c0\") " pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:27:07.386399 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:07.386348    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 01:27:07.386451 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:07.386434    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls podName:a1f9d1bf-1910-4c4b-be53-9b51824e21c0 nodeName:}" failed. No retries permitted until 2026-07-06 01:27:08.386415358 +0000 UTC m=+36.628183207 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls") pod "dns-default-8fc8h" (UID: "a1f9d1bf-1910-4c4b-be53-9b51824e21c0") : secret "dns-default-metrics-tls" not found
Jul 06 01:27:07.609209 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:07.609169    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:27:07.609436 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:07.609216    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:27:07.609436 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:07.609216    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:27:07.612250 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:07.612215    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 01:27:07.613444 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:07.613421    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qszpf\""
Jul 06 01:27:07.613946 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:07.613659    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 01:27:07.613946 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:07.613698    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 01:27:07.613946 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:07.613727    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n24x9\""
Jul 06 01:27:07.613946 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:07.613768    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 01:27:07.754939 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:07.754894    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n968n" event={"ID":"f669e88b-69be-4f0d-91c4-afadc96a25b7","Type":"ContainerStarted","Data":"e5114f2ee5ed859fbd79c0e0950d90b8a8c16b2bb8a2452e557f9dbcf2dc226e"}
Jul 06 01:27:08.292988 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:08.292927    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-pxfqq\" (UID: \"066f3b60-6fb4-4d35-8fc8-9ed67cbd937d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq"
Jul 06 01:27:08.293160 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:08.293111    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:08.293259 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:08.293231    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 01:27:08.293352 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:08.293249    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 01:27:08.293352 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:08.293347    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert podName:066f3b60-6fb4-4d35-8fc8-9ed67cbd937d nodeName:}" failed. No retries permitted until 2026-07-06 01:27:10.293326219 +0000 UTC m=+38.535094065 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-pxfqq" (UID: "066f3b60-6fb4-4d35-8fc8-9ed67cbd937d") : secret "networking-console-plugin-cert" not found
Jul 06 01:27:08.293465 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:08.293357    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69788b8597-tt6ch: secret "image-registry-tls" not found
Jul 06 01:27:08.293465 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:08.293407    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls podName:91217fbf-2d05-4fea-a848-ce72d151cd49 nodeName:}" failed. No retries permitted until 2026-07-06 01:27:10.293391352 +0000 UTC m=+38.535159212 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls") pod "image-registry-69788b8597-tt6ch" (UID: "91217fbf-2d05-4fea-a848-ce72d151cd49") : secret "image-registry-tls" not found
Jul 06 01:27:08.393885 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:08.393845    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls\") pod \"dns-default-8fc8h\" (UID: \"a1f9d1bf-1910-4c4b-be53-9b51824e21c0\") " pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:27:08.394059 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:08.394015    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 01:27:08.394116 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:08.394099    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls podName:a1f9d1bf-1910-4c4b-be53-9b51824e21c0 nodeName:}" failed. No retries permitted until 2026-07-06 01:27:10.394075939 +0000 UTC m=+38.635843784 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls") pod "dns-default-8fc8h" (UID: "a1f9d1bf-1910-4c4b-be53-9b51824e21c0") : secret "dns-default-metrics-tls" not found
Jul 06 01:27:10.312513 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:10.312473    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:10.313021 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:10.312577    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-pxfqq\" (UID: \"066f3b60-6fb4-4d35-8fc8-9ed67cbd937d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq"
Jul 06 01:27:10.313021 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:10.312680    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 01:27:10.313021 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:10.312704    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69788b8597-tt6ch: secret "image-registry-tls" not found
Jul 06 01:27:10.313021 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:10.312740    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 01:27:10.313021 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:10.312780    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls podName:91217fbf-2d05-4fea-a848-ce72d151cd49 nodeName:}" failed. No retries permitted until 2026-07-06 01:27:14.312758083 +0000 UTC m=+42.554525940 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls") pod "image-registry-69788b8597-tt6ch" (UID: "91217fbf-2d05-4fea-a848-ce72d151cd49") : secret "image-registry-tls" not found
Jul 06 01:27:10.313021 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:10.312806    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert podName:066f3b60-6fb4-4d35-8fc8-9ed67cbd937d nodeName:}" failed. No retries permitted until 2026-07-06 01:27:14.312786668 +0000 UTC m=+42.554554518 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-pxfqq" (UID: "066f3b60-6fb4-4d35-8fc8-9ed67cbd937d") : secret "networking-console-plugin-cert" not found
Jul 06 01:27:10.413405 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:10.413354    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls\") pod \"dns-default-8fc8h\" (UID: \"a1f9d1bf-1910-4c4b-be53-9b51824e21c0\") " pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:27:10.413595 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:10.413577    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 01:27:10.413700 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:10.413685    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls podName:a1f9d1bf-1910-4c4b-be53-9b51824e21c0 nodeName:}" failed. No retries permitted until 2026-07-06 01:27:14.41366087 +0000 UTC m=+42.655428731 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls") pod "dns-default-8fc8h" (UID: "a1f9d1bf-1910-4c4b-be53-9b51824e21c0") : secret "dns-default-metrics-tls" not found
Jul 06 01:27:11.768287 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:11.768256    2584 generic.go:356] "Generic (PLEG): container finished" podID="3f01121e-88d5-4f62-bae1-6957d6f8969a" containerID="e76b384bd9e3073e13ee21afd54588c4e01a799f3d56d9d5c81cd45ecff6a143" exitCode=0
Jul 06 01:27:11.768732 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:11.768342    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qmzt" event={"ID":"3f01121e-88d5-4f62-bae1-6957d6f8969a","Type":"ContainerDied","Data":"e76b384bd9e3073e13ee21afd54588c4e01a799f3d56d9d5c81cd45ecff6a143"}
Jul 06 01:27:11.769849 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:11.769823    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n968n" event={"ID":"f669e88b-69be-4f0d-91c4-afadc96a25b7","Type":"ContainerStarted","Data":"eb925e5a5d58cb76a89ea1e898d29ae7b5890c1c4e959a3b1aac9105fe60e2ba"}
Jul 06 01:27:11.803942 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:11.803894    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n968n" podStartSLOduration=1.96959046 podStartE2EDuration="5.803876847s" totalImagesPullingTime="3.834286387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:27:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:27:11.803227244 +0000 UTC m=+40.044995111" watchObservedRunningTime="2026-07-06 01:27:11.803876847 +0000 UTC m=+40.045644715"
Jul 06 01:27:12.775274 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:12.775240    2584 generic.go:356] "Generic (PLEG): container finished" podID="3f01121e-88d5-4f62-bae1-6957d6f8969a" containerID="3749db895d67940fa11bcbc53c9d9849a43e0937388b88b8492d5782ff8e1114" exitCode=0
Jul 06 01:27:12.775753 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:12.775327    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qmzt" event={"ID":"3f01121e-88d5-4f62-bae1-6957d6f8969a","Type":"ContainerDied","Data":"3749db895d67940fa11bcbc53c9d9849a43e0937388b88b8492d5782ff8e1114"}
Jul 06 01:27:13.781102 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:13.781059    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qmzt" event={"ID":"3f01121e-88d5-4f62-bae1-6957d6f8969a","Type":"ContainerStarted","Data":"6766b03c2a87da799a7b7db8078d6bfc4c1d54a7330d933931b8cb8e55afe8be"}
Jul 06 01:27:13.808438 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:13.808386    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9qmzt" podStartSLOduration=9.584224889 podStartE2EDuration="41.80836845s" totalImagesPullingTime="32.224143561s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:26:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:27:13.80813533 +0000 UTC m=+42.049903196" watchObservedRunningTime="2026-07-06 01:27:13.80836845 +0000 UTC m=+42.050136316"
Jul 06 01:27:14.347801 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:14.347759    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-pxfqq\" (UID: \"066f3b60-6fb4-4d35-8fc8-9ed67cbd937d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq"
Jul 06 01:27:14.347969 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:14.347820    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:14.347969 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:14.347901    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 01:27:14.347969 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:14.347925    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 01:27:14.347969 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:14.347935    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69788b8597-tt6ch: secret "image-registry-tls" not found
Jul 06 01:27:14.348128 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:14.347972    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert podName:066f3b60-6fb4-4d35-8fc8-9ed67cbd937d nodeName:}" failed. No retries permitted until 2026-07-06 01:27:22.347955292 +0000 UTC m=+50.589723138 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-pxfqq" (UID: "066f3b60-6fb4-4d35-8fc8-9ed67cbd937d") : secret "networking-console-plugin-cert" not found
Jul 06 01:27:14.348128 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:14.347986    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls podName:91217fbf-2d05-4fea-a848-ce72d151cd49 nodeName:}" failed. No retries permitted until 2026-07-06 01:27:22.347980529 +0000 UTC m=+50.589748374 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls") pod "image-registry-69788b8597-tt6ch" (UID: "91217fbf-2d05-4fea-a848-ce72d151cd49") : secret "image-registry-tls" not found
Jul 06 01:27:14.448653 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:14.448602    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls\") pod \"dns-default-8fc8h\" (UID: \"a1f9d1bf-1910-4c4b-be53-9b51824e21c0\") " pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:27:14.448827 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:14.448752    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 01:27:14.448827 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:14.448815    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls podName:a1f9d1bf-1910-4c4b-be53-9b51824e21c0 nodeName:}" failed. No retries permitted until 2026-07-06 01:27:22.448799295 +0000 UTC m=+50.690567139 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls") pod "dns-default-8fc8h" (UID: "a1f9d1bf-1910-4c4b-be53-9b51824e21c0") : secret "dns-default-metrics-tls" not found
Jul 06 01:27:22.408747 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:22.408699    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:22.409220 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:22.408789    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-pxfqq\" (UID: \"066f3b60-6fb4-4d35-8fc8-9ed67cbd937d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq"
Jul 06 01:27:22.409220 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:22.408834    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 01:27:22.409220 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:22.408853    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69788b8597-tt6ch: secret "image-registry-tls" not found
Jul 06 01:27:22.409220 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:22.408877    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 01:27:22.409220 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:22.408912    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls podName:91217fbf-2d05-4fea-a848-ce72d151cd49 nodeName:}" failed. No retries permitted until 2026-07-06 01:27:38.408895778 +0000 UTC m=+66.650663623 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls") pod "image-registry-69788b8597-tt6ch" (UID: "91217fbf-2d05-4fea-a848-ce72d151cd49") : secret "image-registry-tls" not found
Jul 06 01:27:22.409220 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:22.408926    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert podName:066f3b60-6fb4-4d35-8fc8-9ed67cbd937d nodeName:}" failed. No retries permitted until 2026-07-06 01:27:38.40891967 +0000 UTC m=+66.650687515 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-pxfqq" (UID: "066f3b60-6fb4-4d35-8fc8-9ed67cbd937d") : secret "networking-console-plugin-cert" not found
Jul 06 01:27:22.509261 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:22.509226    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls\") pod \"dns-default-8fc8h\" (UID: \"a1f9d1bf-1910-4c4b-be53-9b51824e21c0\") " pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:27:22.509416 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:22.509370    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 01:27:22.509461 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:22.509432    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls podName:a1f9d1bf-1910-4c4b-be53-9b51824e21c0 nodeName:}" failed. No retries permitted until 2026-07-06 01:27:38.50941627 +0000 UTC m=+66.751184116 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls") pod "dns-default-8fc8h" (UID: "a1f9d1bf-1910-4c4b-be53-9b51824e21c0") : secret "dns-default-metrics-tls" not found
Jul 06 01:27:33.863959 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:33.863928    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mnnbg"
Jul 06 01:27:38.017404 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:38.017366    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs\") pod \"network-metrics-daemon-7fkg2\" (UID: \"d05d6ef9-2d73-4ab9-b875-7d121bd89c4d\") " pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:27:38.020211 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:38.020188    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 01:27:38.028386 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:38.028354    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 01:27:38.028509 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:38.028431    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs podName:d05d6ef9-2d73-4ab9-b875-7d121bd89c4d nodeName:}" failed. No retries permitted until 2026-07-06 01:28:42.02841205 +0000 UTC m=+130.270179895 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs") pod "network-metrics-daemon-7fkg2" (UID: "d05d6ef9-2d73-4ab9-b875-7d121bd89c4d") : secret "metrics-daemon-secret" not found
Jul 06 01:27:38.117975 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:38.117943    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-original-pull-secret\") pod \"global-pull-secret-syncer-tx6kv\" (UID: \"1d0e1c2f-f2d9-4114-b29f-eae649ac05fc\") " pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:27:38.121178 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:38.121156    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 01:27:38.132280 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:38.132247    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d0e1c2f-f2d9-4114-b29f-eae649ac05fc-original-pull-secret\") pod \"global-pull-secret-syncer-tx6kv\" (UID: \"1d0e1c2f-f2d9-4114-b29f-eae649ac05fc\") " pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:27:38.218621 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:38.218582    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t884s\" (UniqueName: \"kubernetes.io/projected/a8f3b161-3401-49ab-9dd4-f7b921a569e1-kube-api-access-t884s\") pod \"network-check-target-9kj2t\" (UID: \"a8f3b161-3401-49ab-9dd4-f7b921a569e1\") " pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:27:38.221316 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:38.221294    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 01:27:38.231992 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:38.231965    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 01:27:38.242298 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:38.242268    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tx6kv"
Jul 06 01:27:38.243238 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:38.243220    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t884s\" (UniqueName: \"kubernetes.io/projected/a8f3b161-3401-49ab-9dd4-f7b921a569e1-kube-api-access-t884s\") pod \"network-check-target-9kj2t\" (UID: \"a8f3b161-3401-49ab-9dd4-f7b921a569e1\") " pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:27:38.367401 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:38.367364    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tx6kv"]
Jul 06 01:27:38.371200 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:27:38.371175    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d0e1c2f_f2d9_4114_b29f_eae649ac05fc.slice/crio-0edafb923fb696438ab219ce22ebdaba3a2a7bda05f2bca1b8b3f62747908674 WatchSource:0}: Error finding container 0edafb923fb696438ab219ce22ebdaba3a2a7bda05f2bca1b8b3f62747908674: Status 404 returned error can't find the container with id 0edafb923fb696438ab219ce22ebdaba3a2a7bda05f2bca1b8b3f62747908674
Jul 06 01:27:38.420717 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:38.420678    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-pxfqq\" (UID: \"066f3b60-6fb4-4d35-8fc8-9ed67cbd937d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq"
Jul 06 01:27:38.420717 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:38.420731    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:27:38.420929 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:38.420838    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 01:27:38.420929 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:38.420850    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 01:27:38.420929 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:38.420866    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69788b8597-tt6ch: secret "image-registry-tls" not found
Jul 06 01:27:38.420929 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:38.420922    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls podName:91217fbf-2d05-4fea-a848-ce72d151cd49 nodeName:}" failed. No retries permitted until 2026-07-06 01:28:10.420899802 +0000 UTC m=+98.662667652 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls") pod "image-registry-69788b8597-tt6ch" (UID: "91217fbf-2d05-4fea-a848-ce72d151cd49") : secret "image-registry-tls" not found
Jul 06 01:27:38.421056 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:38.420939    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert podName:066f3b60-6fb4-4d35-8fc8-9ed67cbd937d nodeName:}" failed. No retries permitted until 2026-07-06 01:28:10.420930692 +0000 UTC m=+98.662698537 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-pxfqq" (UID: "066f3b60-6fb4-4d35-8fc8-9ed67cbd937d") : secret "networking-console-plugin-cert" not found
Jul 06 01:27:38.521485 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:38.521448    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls\") pod \"dns-default-8fc8h\" (UID: \"a1f9d1bf-1910-4c4b-be53-9b51824e21c0\") " pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:27:38.521661 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:38.521598    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 01:27:38.521712 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:27:38.521682    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls podName:a1f9d1bf-1910-4c4b-be53-9b51824e21c0 nodeName:}" failed. No retries permitted until 2026-07-06 01:28:10.521661995 +0000 UTC m=+98.763429842 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls") pod "dns-default-8fc8h" (UID: "a1f9d1bf-1910-4c4b-be53-9b51824e21c0") : secret "dns-default-metrics-tls" not found
Jul 06 01:27:38.528039 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:38.528017    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n24x9\""
Jul 06 01:27:38.536266 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:38.536234    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:27:38.664336 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:38.664305    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9kj2t"]
Jul 06 01:27:38.667458 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:27:38.667432    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8f3b161_3401_49ab_9dd4_f7b921a569e1.slice/crio-517a8945c22e668fbdf50db000009e27f319fc8c3a2726a509b884ddcaa6eb87 WatchSource:0}: Error finding container 517a8945c22e668fbdf50db000009e27f319fc8c3a2726a509b884ddcaa6eb87: Status 404 returned error can't find the container with id 517a8945c22e668fbdf50db000009e27f319fc8c3a2726a509b884ddcaa6eb87
Jul 06 01:27:38.843223 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:38.843179    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tx6kv" event={"ID":"1d0e1c2f-f2d9-4114-b29f-eae649ac05fc","Type":"ContainerStarted","Data":"0edafb923fb696438ab219ce22ebdaba3a2a7bda05f2bca1b8b3f62747908674"}
Jul 06 01:27:38.844251 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:38.844223    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9kj2t" event={"ID":"a8f3b161-3401-49ab-9dd4-f7b921a569e1","Type":"ContainerStarted","Data":"517a8945c22e668fbdf50db000009e27f319fc8c3a2726a509b884ddcaa6eb87"}
Jul 06 01:27:43.861199 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:43.861161    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tx6kv" event={"ID":"1d0e1c2f-f2d9-4114-b29f-eae649ac05fc","Type":"ContainerStarted","Data":"a20a3eeed1e06b3e508078ac2b160bdfe98e38dbcf3c02a4713bb77717853c7b"}
Jul 06 01:27:43.862636 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:43.862600    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9kj2t" event={"ID":"a8f3b161-3401-49ab-9dd4-f7b921a569e1","Type":"ContainerStarted","Data":"5b903d367af65ec63bef240748dd907964f4b6fa1450105064ab4416e2deef72"}
Jul 06 01:27:43.862726 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:43.862675    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:27:43.876620 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:43.876565    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tx6kv" podStartSLOduration=65.776968297 podStartE2EDuration="1m10.876549644s" totalImagesPullingTime="5.099581347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:26:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:27:43.875823507 +0000 UTC m=+72.117591374" watchObservedRunningTime="2026-07-06 01:27:43.876549644 +0000 UTC m=+72.118317511"
Jul 06 01:27:43.889646 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:27:43.889579    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9kj2t" podStartSLOduration=66.092210706 podStartE2EDuration="1m10.889562543s" totalImagesPullingTime="4.797351837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:26:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:27:43.889077131 +0000 UTC m=+72.130845000" watchObservedRunningTime="2026-07-06 01:27:43.889562543 +0000 UTC m=+72.131330410"
Jul 06 01:28:10.451930 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:28:10.451885    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-pxfqq\" (UID: \"066f3b60-6fb4-4d35-8fc8-9ed67cbd937d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq"
Jul 06 01:28:10.452414 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:28:10.451947    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:28:10.452414 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:28:10.452054    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 01:28:10.452414 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:28:10.452118    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert podName:066f3b60-6fb4-4d35-8fc8-9ed67cbd937d nodeName:}" failed. No retries permitted until 2026-07-06 01:29:14.452102958 +0000 UTC m=+162.693870808 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-pxfqq" (UID: "066f3b60-6fb4-4d35-8fc8-9ed67cbd937d") : secret "networking-console-plugin-cert" not found
Jul 06 01:28:10.452414 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:28:10.452057    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 01:28:10.452414 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:28:10.452161    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69788b8597-tt6ch: secret "image-registry-tls" not found
Jul 06 01:28:10.452414 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:28:10.452213    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls podName:91217fbf-2d05-4fea-a848-ce72d151cd49 nodeName:}" failed. No retries permitted until 2026-07-06 01:29:14.452201499 +0000 UTC m=+162.693969344 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls") pod "image-registry-69788b8597-tt6ch" (UID: "91217fbf-2d05-4fea-a848-ce72d151cd49") : secret "image-registry-tls" not found
Jul 06 01:28:10.552940 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:28:10.552910    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls\") pod \"dns-default-8fc8h\" (UID: \"a1f9d1bf-1910-4c4b-be53-9b51824e21c0\") " pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:28:10.553081 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:28:10.553062    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 01:28:10.553135 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:28:10.553126    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls podName:a1f9d1bf-1910-4c4b-be53-9b51824e21c0 nodeName:}" failed. No retries permitted until 2026-07-06 01:29:14.553110792 +0000 UTC m=+162.794878637 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls") pod "dns-default-8fc8h" (UID: "a1f9d1bf-1910-4c4b-be53-9b51824e21c0") : secret "dns-default-metrics-tls" not found
Jul 06 01:28:14.867772 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:28:14.867740    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9kj2t"
Jul 06 01:28:42.087934 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:28:42.087891    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs\") pod \"network-metrics-daemon-7fkg2\" (UID: \"d05d6ef9-2d73-4ab9-b875-7d121bd89c4d\") " pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:28:42.088415 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:28:42.088057    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 01:28:42.088415 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:28:42.088119    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs podName:d05d6ef9-2d73-4ab9-b875-7d121bd89c4d nodeName:}" failed. No retries permitted until 2026-07-06 01:30:44.088104019 +0000 UTC m=+252.329871865 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs") pod "network-metrics-daemon-7fkg2" (UID: "d05d6ef9-2d73-4ab9-b875-7d121bd89c4d") : secret "metrics-daemon-secret" not found
Jul 06 01:29:09.606107 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:29:09.606054    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq" podUID="066f3b60-6fb4-4d35-8fc8-9ed67cbd937d"
Jul 06 01:29:09.613348 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:29:09.613321    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-69788b8597-tt6ch" podUID="91217fbf-2d05-4fea-a848-ce72d151cd49"
Jul 06 01:29:09.632508 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:29:09.632478    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8fc8h" podUID="a1f9d1bf-1910-4c4b-be53-9b51824e21c0"
Jul 06 01:29:10.065827 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:29:10.065733    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq"
Jul 06 01:29:10.065827 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:29:10.065733    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:29:10.066043 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:29:10.065733    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:29:10.634390 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:29:10.634323    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7fkg2" podUID="d05d6ef9-2d73-4ab9-b875-7d121bd89c4d"
Jul 06 01:29:14.517704 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:29:14.517655    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:29:14.518138 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:29:14.517734    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-pxfqq\" (UID: \"066f3b60-6fb4-4d35-8fc8-9ed67cbd937d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq"
Jul 06 01:29:14.518138 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:29:14.517797    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 01:29:14.518138 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:29:14.517818    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69788b8597-tt6ch: secret "image-registry-tls" not found
Jul 06 01:29:14.518138 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:29:14.517826    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 01:29:14.518138 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:29:14.517875    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls podName:91217fbf-2d05-4fea-a848-ce72d151cd49 nodeName:}" failed. No retries permitted until 2026-07-06 01:31:16.517859239 +0000 UTC m=+284.759627088 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls") pod "image-registry-69788b8597-tt6ch" (UID: "91217fbf-2d05-4fea-a848-ce72d151cd49") : secret "image-registry-tls" not found
Jul 06 01:29:14.518138 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:29:14.517888    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert podName:066f3b60-6fb4-4d35-8fc8-9ed67cbd937d nodeName:}" failed. No retries permitted until 2026-07-06 01:31:16.517882328 +0000 UTC m=+284.759650172 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-pxfqq" (UID: "066f3b60-6fb4-4d35-8fc8-9ed67cbd937d") : secret "networking-console-plugin-cert" not found
Jul 06 01:29:14.618984 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:29:14.618945    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls\") pod \"dns-default-8fc8h\" (UID: \"a1f9d1bf-1910-4c4b-be53-9b51824e21c0\") " pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:29:14.619168 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:29:14.619073    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 01:29:14.619168 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:29:14.619146    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls podName:a1f9d1bf-1910-4c4b-be53-9b51824e21c0 nodeName:}" failed. No retries permitted until 2026-07-06 01:31:16.619125094 +0000 UTC m=+284.860892954 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls") pod "dns-default-8fc8h" (UID: "a1f9d1bf-1910-4c4b-be53-9b51824e21c0") : secret "dns-default-metrics-tls" not found
Jul 06 01:29:25.609273 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:29:25.609180    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:30:44.160368 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:44.160300    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs\") pod \"network-metrics-daemon-7fkg2\" (UID: \"d05d6ef9-2d73-4ab9-b875-7d121bd89c4d\") " pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:30:44.160983 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:44.160492    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 01:30:44.160983 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:44.160582    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs podName:d05d6ef9-2d73-4ab9-b875-7d121bd89c4d nodeName:}" failed. No retries permitted until 2026-07-06 01:32:46.16056028 +0000 UTC m=+374.402328370 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs") pod "network-metrics-daemon-7fkg2" (UID: "d05d6ef9-2d73-4ab9-b875-7d121bd89c4d") : secret "metrics-daemon-secret" not found
Jul 06 01:30:54.208937 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.208900    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-b7ltw"]
Jul 06 01:30:54.211798 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.211771    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-b7ltw"
Jul 06 01:30:54.213252 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.213214    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-98vmn"]
Jul 06 01:30:54.214807 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.214787    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-2tjqm\""
Jul 06 01:30:54.216135 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.216113    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nm48x"]
Jul 06 01:30:54.216224 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.216210    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-98vmn"
Jul 06 01:30:54.219127 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.219079    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nm48x"
Jul 06 01:30:54.219415 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.219395    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 01:30:54.220910 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.220886    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 01:30:54.221024 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.220913    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 06 01:30:54.221173 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.221152    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mfcbt\""
Jul 06 01:30:54.221305 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.221202    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 06 01:30:54.222159 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.222138    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-b7ltw"]
Jul 06 01:30:54.222348 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.222322    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fhqfh\""
Jul 06 01:30:54.222442 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.222332    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 06 01:30:54.222442 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.222332    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 06 01:30:54.222442 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.222367    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 06 01:30:54.222442 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.222367    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 06 01:30:54.231555 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.231521    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nm48x"]
Jul 06 01:30:54.233558 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.233527    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf4jt\" (UniqueName: \"kubernetes.io/projected/7a7e13be-4e2d-4ee6-838a-4507db79883a-kube-api-access-sf4jt\") pod \"kube-storage-version-migrator-operator-846bf668f7-nm48x\" (UID: \"7a7e13be-4e2d-4ee6-838a-4507db79883a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nm48x"
Jul 06 01:30:54.233690 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.233576    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e934bf1-908b-4a86-8147-c066b499862f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-98vmn\" (UID: \"6e934bf1-908b-4a86-8147-c066b499862f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-98vmn"
Jul 06 01:30:54.233690 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.233614    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt6h6\" (UniqueName: \"kubernetes.io/projected/6e934bf1-908b-4a86-8147-c066b499862f-kube-api-access-kt6h6\") pod \"cluster-monitoring-operator-64786d9cbb-98vmn\" (UID: \"6e934bf1-908b-4a86-8147-c066b499862f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-98vmn"
Jul 06 01:30:54.233815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.233721    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6e934bf1-908b-4a86-8147-c066b499862f-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-98vmn\" (UID: \"6e934bf1-908b-4a86-8147-c066b499862f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-98vmn"
Jul 06 01:30:54.233815 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.233800    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxjrb\" (UniqueName: \"kubernetes.io/projected/01f12d53-2369-460d-8588-76fd5d1430f2-kube-api-access-vxjrb\") pod \"network-check-source-989f8b8dc-b7ltw\" (UID: \"01f12d53-2369-460d-8588-76fd5d1430f2\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-b7ltw"
Jul 06 01:30:54.233970 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.233835    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a7e13be-4e2d-4ee6-838a-4507db79883a-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-nm48x\" (UID: \"7a7e13be-4e2d-4ee6-838a-4507db79883a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nm48x"
Jul 06 01:30:54.233970 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.233870    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a7e13be-4e2d-4ee6-838a-4507db79883a-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-nm48x\" (UID: \"7a7e13be-4e2d-4ee6-838a-4507db79883a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nm48x"
Jul 06 01:30:54.236830 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.236801    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-98vmn"]
Jul 06 01:30:54.302715 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.302664    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-msdjx"]
Jul 06 01:30:54.305745 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.305718    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-msdjx"
Jul 06 01:30:54.305894 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.305776    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k54wm"]
Jul 06 01:30:54.308558 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.308538    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k54wm"
Jul 06 01:30:54.310384 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.310363    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 06 01:30:54.310893 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.310875    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 06 01:30:54.310985 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.310890    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-msrt8"]
Jul 06 01:30:54.311208 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.311162    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 06 01:30:54.311349 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.311320    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 06 01:30:54.311508 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.311492    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-r5v8x\""
Jul 06 01:30:54.311577 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.311498    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 06 01:30:54.311863 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.311846    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 06 01:30:54.313118 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.313099    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-s2ck4\""
Jul 06 01:30:54.313993 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.313972    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-msrt8"
Jul 06 01:30:54.316964 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.316896    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 06 01:30:54.316964 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.316949    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-brwpv\""
Jul 06 01:30:54.317135 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.317067    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 06 01:30:54.317208 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.317190    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 06 01:30:54.319569 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.319545    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-msdjx"]
Jul 06 01:30:54.320552 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.320532    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k54wm"]
Jul 06 01:30:54.328989 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.328938    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-msrt8"]
Jul 06 01:30:54.334822 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.334793    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e934bf1-908b-4a86-8147-c066b499862f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-98vmn\" (UID: \"6e934bf1-908b-4a86-8147-c066b499862f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-98vmn"
Jul 06 01:30:54.335023 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.334834    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/83c4a860-31f6-41d4-85ca-36c8fdfcc7f7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-msrt8\" (UID: \"83c4a860-31f6-41d4-85ca-36c8fdfcc7f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-msrt8"
Jul 06 01:30:54.335023 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.334883    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxjrb\" (UniqueName: \"kubernetes.io/projected/01f12d53-2369-460d-8588-76fd5d1430f2-kube-api-access-vxjrb\") pod \"network-check-source-989f8b8dc-b7ltw\" (UID: \"01f12d53-2369-460d-8588-76fd5d1430f2\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-b7ltw"
Jul 06 01:30:54.335023 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:54.334918    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 01:30:54.335023 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.334924    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf4jt\" (UniqueName: \"kubernetes.io/projected/7a7e13be-4e2d-4ee6-838a-4507db79883a-kube-api-access-sf4jt\") pod \"kube-storage-version-migrator-operator-846bf668f7-nm48x\" (UID: \"7a7e13be-4e2d-4ee6-838a-4507db79883a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nm48x"
Jul 06 01:30:54.335023 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:54.335000    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e934bf1-908b-4a86-8147-c066b499862f-cluster-monitoring-operator-tls podName:6e934bf1-908b-4a86-8147-c066b499862f nodeName:}" failed. No retries permitted until 2026-07-06 01:30:54.834985081 +0000 UTC m=+263.076752926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6e934bf1-908b-4a86-8147-c066b499862f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-98vmn" (UID: "6e934bf1-908b-4a86-8147-c066b499862f") : secret "cluster-monitoring-operator-tls" not found
Jul 06 01:30:54.335255 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.335038    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a7e13be-4e2d-4ee6-838a-4507db79883a-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-nm48x\" (UID: \"7a7e13be-4e2d-4ee6-838a-4507db79883a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nm48x"
Jul 06 01:30:54.335255 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.335079    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b959825-a5f6-42c8-b8fa-c1228e63563b-config\") pod \"service-ca-operator-5d46d9ffd4-msdjx\" (UID: \"5b959825-a5f6-42c8-b8fa-c1228e63563b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-msdjx"
Jul 06 01:30:54.335255 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.335116    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt6h6\" (UniqueName: \"kubernetes.io/projected/6e934bf1-908b-4a86-8147-c066b499862f-kube-api-access-kt6h6\") pod \"cluster-monitoring-operator-64786d9cbb-98vmn\" (UID: \"6e934bf1-908b-4a86-8147-c066b499862f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-98vmn"
Jul 06 01:30:54.335255 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.335143    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b959825-a5f6-42c8-b8fa-c1228e63563b-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-msdjx\" (UID: \"5b959825-a5f6-42c8-b8fa-c1228e63563b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-msdjx"
Jul 06 01:30:54.335255 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.335203    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6e934bf1-908b-4a86-8147-c066b499862f-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-98vmn\" (UID: \"6e934bf1-908b-4a86-8147-c066b499862f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-98vmn"
Jul 06 01:30:54.335535 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.335260    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rgpk\" (UniqueName: \"kubernetes.io/projected/a8c26804-a48d-467f-aece-eb93d957bcde-kube-api-access-6rgpk\") pod \"volume-data-source-validator-5d456fdbcd-k54wm\" (UID: \"a8c26804-a48d-467f-aece-eb93d957bcde\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k54wm"
Jul 06 01:30:54.335535 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.335314    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a7e13be-4e2d-4ee6-838a-4507db79883a-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-nm48x\" (UID: \"7a7e13be-4e2d-4ee6-838a-4507db79883a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nm48x"
Jul 06 01:30:54.335535 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.335343    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kh89\" (UniqueName: \"kubernetes.io/projected/83c4a860-31f6-41d4-85ca-36c8fdfcc7f7-kube-api-access-4kh89\") pod \"cluster-samples-operator-56fcf86bf-msrt8\" (UID: \"83c4a860-31f6-41d4-85ca-36c8fdfcc7f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-msrt8"
Jul 06 01:30:54.335535 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.335376    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tdsk\" (UniqueName: \"kubernetes.io/projected/5b959825-a5f6-42c8-b8fa-c1228e63563b-kube-api-access-6tdsk\") pod \"service-ca-operator-5d46d9ffd4-msdjx\" (UID: \"5b959825-a5f6-42c8-b8fa-c1228e63563b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-msdjx"
Jul 06 01:30:54.336247 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.335948    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a7e13be-4e2d-4ee6-838a-4507db79883a-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-nm48x\" (UID: \"7a7e13be-4e2d-4ee6-838a-4507db79883a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nm48x"
Jul 06 01:30:54.336247 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.336173    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6e934bf1-908b-4a86-8147-c066b499862f-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-98vmn\" (UID: \"6e934bf1-908b-4a86-8147-c066b499862f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-98vmn"
Jul 06 01:30:54.340549 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.340520    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a7e13be-4e2d-4ee6-838a-4507db79883a-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-nm48x\" (UID: \"7a7e13be-4e2d-4ee6-838a-4507db79883a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nm48x"
Jul 06 01:30:54.351799 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.351766    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf4jt\" (UniqueName: \"kubernetes.io/projected/7a7e13be-4e2d-4ee6-838a-4507db79883a-kube-api-access-sf4jt\") pod \"kube-storage-version-migrator-operator-846bf668f7-nm48x\" (UID: \"7a7e13be-4e2d-4ee6-838a-4507db79883a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nm48x"
Jul 06 01:30:54.351965 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.351842    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxjrb\" (UniqueName: \"kubernetes.io/projected/01f12d53-2369-460d-8588-76fd5d1430f2-kube-api-access-vxjrb\") pod \"network-check-source-989f8b8dc-b7ltw\" (UID: \"01f12d53-2369-460d-8588-76fd5d1430f2\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-b7ltw"
Jul 06 01:30:54.351965 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.351842    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt6h6\" (UniqueName: \"kubernetes.io/projected/6e934bf1-908b-4a86-8147-c066b499862f-kube-api-access-kt6h6\") pod \"cluster-monitoring-operator-64786d9cbb-98vmn\" (UID: \"6e934bf1-908b-4a86-8147-c066b499862f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-98vmn"
Jul 06 01:30:54.436058 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.436009    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b959825-a5f6-42c8-b8fa-c1228e63563b-config\") pod \"service-ca-operator-5d46d9ffd4-msdjx\" (UID: \"5b959825-a5f6-42c8-b8fa-c1228e63563b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-msdjx"
Jul 06 01:30:54.436058 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.436063    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b959825-a5f6-42c8-b8fa-c1228e63563b-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-msdjx\" (UID: \"5b959825-a5f6-42c8-b8fa-c1228e63563b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-msdjx"
Jul 06 01:30:54.436314 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.436102    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rgpk\" (UniqueName: \"kubernetes.io/projected/a8c26804-a48d-467f-aece-eb93d957bcde-kube-api-access-6rgpk\") pod \"volume-data-source-validator-5d456fdbcd-k54wm\" (UID: \"a8c26804-a48d-467f-aece-eb93d957bcde\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k54wm"
Jul 06 01:30:54.436314 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.436143    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kh89\" (UniqueName: \"kubernetes.io/projected/83c4a860-31f6-41d4-85ca-36c8fdfcc7f7-kube-api-access-4kh89\") pod \"cluster-samples-operator-56fcf86bf-msrt8\" (UID: \"83c4a860-31f6-41d4-85ca-36c8fdfcc7f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-msrt8"
Jul 06 01:30:54.436314 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.436168    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tdsk\" (UniqueName: \"kubernetes.io/projected/5b959825-a5f6-42c8-b8fa-c1228e63563b-kube-api-access-6tdsk\") pod \"service-ca-operator-5d46d9ffd4-msdjx\" (UID: \"5b959825-a5f6-42c8-b8fa-c1228e63563b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-msdjx"
Jul 06 01:30:54.436446 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.436330    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/83c4a860-31f6-41d4-85ca-36c8fdfcc7f7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-msrt8\" (UID: \"83c4a860-31f6-41d4-85ca-36c8fdfcc7f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-msrt8"
Jul 06 01:30:54.436446 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:54.436431    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 01:30:54.436535 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:54.436520    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83c4a860-31f6-41d4-85ca-36c8fdfcc7f7-samples-operator-tls podName:83c4a860-31f6-41d4-85ca-36c8fdfcc7f7 nodeName:}" failed. No retries permitted until 2026-07-06 01:30:54.936491022 +0000 UTC m=+263.178258884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/83c4a860-31f6-41d4-85ca-36c8fdfcc7f7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-msrt8" (UID: "83c4a860-31f6-41d4-85ca-36c8fdfcc7f7") : secret "samples-operator-tls" not found
Jul 06 01:30:54.436668 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.436650    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b959825-a5f6-42c8-b8fa-c1228e63563b-config\") pod \"service-ca-operator-5d46d9ffd4-msdjx\" (UID: \"5b959825-a5f6-42c8-b8fa-c1228e63563b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-msdjx"
Jul 06 01:30:54.438380 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.438359    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b959825-a5f6-42c8-b8fa-c1228e63563b-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-msdjx\" (UID: \"5b959825-a5f6-42c8-b8fa-c1228e63563b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-msdjx"
Jul 06 01:30:54.444571 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.444541    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rgpk\" (UniqueName: \"kubernetes.io/projected/a8c26804-a48d-467f-aece-eb93d957bcde-kube-api-access-6rgpk\") pod \"volume-data-source-validator-5d456fdbcd-k54wm\" (UID: \"a8c26804-a48d-467f-aece-eb93d957bcde\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k54wm"
Jul 06 01:30:54.449796 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.449773    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tdsk\" (UniqueName: \"kubernetes.io/projected/5b959825-a5f6-42c8-b8fa-c1228e63563b-kube-api-access-6tdsk\") pod \"service-ca-operator-5d46d9ffd4-msdjx\" (UID: \"5b959825-a5f6-42c8-b8fa-c1228e63563b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-msdjx"
Jul 06 01:30:54.449934 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.449836    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kh89\" (UniqueName: \"kubernetes.io/projected/83c4a860-31f6-41d4-85ca-36c8fdfcc7f7-kube-api-access-4kh89\") pod \"cluster-samples-operator-56fcf86bf-msrt8\" (UID: \"83c4a860-31f6-41d4-85ca-36c8fdfcc7f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-msrt8"
Jul 06 01:30:54.524039 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.523947    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-b7ltw"
Jul 06 01:30:54.536928 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.536896    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nm48x"
Jul 06 01:30:54.616666 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.616618    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-msdjx"
Jul 06 01:30:54.624744 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.624713    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k54wm"
Jul 06 01:30:54.663865 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.663752    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-b7ltw"]
Jul 06 01:30:54.669576 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:30:54.669536    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01f12d53_2369_460d_8588_76fd5d1430f2.slice/crio-ba29c86c510341eb5261a9731921860506413c46619c81af217e27fdb77dd7d9 WatchSource:0}: Error finding container ba29c86c510341eb5261a9731921860506413c46619c81af217e27fdb77dd7d9: Status 404 returned error can't find the container with id ba29c86c510341eb5261a9731921860506413c46619c81af217e27fdb77dd7d9
Jul 06 01:30:54.687686 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.687583    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nm48x"]
Jul 06 01:30:54.695805 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:30:54.695764    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a7e13be_4e2d_4ee6_838a_4507db79883a.slice/crio-374e9e2d67cc5c76062d01e35a5b7d5da774e7fafe826d4ba339f4f7d801813b WatchSource:0}: Error finding container 374e9e2d67cc5c76062d01e35a5b7d5da774e7fafe826d4ba339f4f7d801813b: Status 404 returned error can't find the container with id 374e9e2d67cc5c76062d01e35a5b7d5da774e7fafe826d4ba339f4f7d801813b
Jul 06 01:30:54.768741 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.768701    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-msdjx"]
Jul 06 01:30:54.772181 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:30:54.772150    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b959825_a5f6_42c8_b8fa_c1228e63563b.slice/crio-eddd45ad49f87fdbc2ed5f16f7b6efe7362f2bf6f0983487608bde57cfa3f92b WatchSource:0}: Error finding container eddd45ad49f87fdbc2ed5f16f7b6efe7362f2bf6f0983487608bde57cfa3f92b: Status 404 returned error can't find the container with id eddd45ad49f87fdbc2ed5f16f7b6efe7362f2bf6f0983487608bde57cfa3f92b
Jul 06 01:30:54.781395 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.781364    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k54wm"]
Jul 06 01:30:54.785565 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:30:54.785538    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8c26804_a48d_467f_aece_eb93d957bcde.slice/crio-c1cccdec7d5c4f607cf86b5bb4fc3fcfae0c4825a753d9507828404dbd959338 WatchSource:0}: Error finding container c1cccdec7d5c4f607cf86b5bb4fc3fcfae0c4825a753d9507828404dbd959338: Status 404 returned error can't find the container with id c1cccdec7d5c4f607cf86b5bb4fc3fcfae0c4825a753d9507828404dbd959338
Jul 06 01:30:54.840444 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.840408    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e934bf1-908b-4a86-8147-c066b499862f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-98vmn\" (UID: \"6e934bf1-908b-4a86-8147-c066b499862f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-98vmn"
Jul 06 01:30:54.840691 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:54.840575    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 01:30:54.840691 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:54.840678    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e934bf1-908b-4a86-8147-c066b499862f-cluster-monitoring-operator-tls podName:6e934bf1-908b-4a86-8147-c066b499862f nodeName:}" failed. No retries permitted until 2026-07-06 01:30:55.840654916 +0000 UTC m=+264.082422773 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6e934bf1-908b-4a86-8147-c066b499862f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-98vmn" (UID: "6e934bf1-908b-4a86-8147-c066b499862f") : secret "cluster-monitoring-operator-tls" not found
Jul 06 01:30:54.941387 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:54.941347    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/83c4a860-31f6-41d4-85ca-36c8fdfcc7f7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-msrt8\" (UID: \"83c4a860-31f6-41d4-85ca-36c8fdfcc7f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-msrt8"
Jul 06 01:30:54.941566 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:54.941503    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 01:30:54.941606 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:54.941573    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83c4a860-31f6-41d4-85ca-36c8fdfcc7f7-samples-operator-tls podName:83c4a860-31f6-41d4-85ca-36c8fdfcc7f7 nodeName:}" failed. No retries permitted until 2026-07-06 01:30:55.941557061 +0000 UTC m=+264.183324906 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/83c4a860-31f6-41d4-85ca-36c8fdfcc7f7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-msrt8" (UID: "83c4a860-31f6-41d4-85ca-36c8fdfcc7f7") : secret "samples-operator-tls" not found
Jul 06 01:30:55.322440 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:55.322401    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-msdjx" event={"ID":"5b959825-a5f6-42c8-b8fa-c1228e63563b","Type":"ContainerStarted","Data":"eddd45ad49f87fdbc2ed5f16f7b6efe7362f2bf6f0983487608bde57cfa3f92b"}
Jul 06 01:30:55.323569 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:55.323539    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k54wm" event={"ID":"a8c26804-a48d-467f-aece-eb93d957bcde","Type":"ContainerStarted","Data":"c1cccdec7d5c4f607cf86b5bb4fc3fcfae0c4825a753d9507828404dbd959338"}
Jul 06 01:30:55.324591 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:55.324568    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nm48x" event={"ID":"7a7e13be-4e2d-4ee6-838a-4507db79883a","Type":"ContainerStarted","Data":"374e9e2d67cc5c76062d01e35a5b7d5da774e7fafe826d4ba339f4f7d801813b"}
Jul 06 01:30:55.326021 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:55.325995    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-b7ltw" event={"ID":"01f12d53-2369-460d-8588-76fd5d1430f2","Type":"ContainerStarted","Data":"711db6d137efe87c14792003bc007c4160705d27f5920957fb14e9e4e3d9c59c"}
Jul 06 01:30:55.326111 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:55.326036    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-b7ltw" event={"ID":"01f12d53-2369-460d-8588-76fd5d1430f2","Type":"ContainerStarted","Data":"ba29c86c510341eb5261a9731921860506413c46619c81af217e27fdb77dd7d9"}
Jul 06 01:30:55.341443 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:55.341373    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-b7ltw" podStartSLOduration=1.3413503900000001 podStartE2EDuration="1.34135039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:30:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:30:55.341304814 +0000 UTC m=+263.583072681" watchObservedRunningTime="2026-07-06 01:30:55.34135039 +0000 UTC m=+263.583118259"
Jul 06 01:30:55.848468 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:55.848417    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e934bf1-908b-4a86-8147-c066b499862f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-98vmn\" (UID: \"6e934bf1-908b-4a86-8147-c066b499862f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-98vmn"
Jul 06 01:30:55.848666 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:55.848587    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 01:30:55.848744 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:55.848682    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e934bf1-908b-4a86-8147-c066b499862f-cluster-monitoring-operator-tls podName:6e934bf1-908b-4a86-8147-c066b499862f nodeName:}" failed. No retries permitted until 2026-07-06 01:30:57.848660027 +0000 UTC m=+266.090427872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6e934bf1-908b-4a86-8147-c066b499862f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-98vmn" (UID: "6e934bf1-908b-4a86-8147-c066b499862f") : secret "cluster-monitoring-operator-tls" not found
Jul 06 01:30:55.949540 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:55.949500    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/83c4a860-31f6-41d4-85ca-36c8fdfcc7f7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-msrt8\" (UID: \"83c4a860-31f6-41d4-85ca-36c8fdfcc7f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-msrt8"
Jul 06 01:30:55.949757 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:55.949736    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 01:30:55.949825 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:55.949809    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83c4a860-31f6-41d4-85ca-36c8fdfcc7f7-samples-operator-tls podName:83c4a860-31f6-41d4-85ca-36c8fdfcc7f7 nodeName:}" failed. No retries permitted until 2026-07-06 01:30:57.949788789 +0000 UTC m=+266.191556639 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/83c4a860-31f6-41d4-85ca-36c8fdfcc7f7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-msrt8" (UID: "83c4a860-31f6-41d4-85ca-36c8fdfcc7f7") : secret "samples-operator-tls" not found
Jul 06 01:30:56.330495 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:56.330457    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k54wm" event={"ID":"a8c26804-a48d-467f-aece-eb93d957bcde","Type":"ContainerStarted","Data":"b29a3aa18e428c117643f56e3da62fe1af4e7ed74f79555f35e19f5ecd8ced10"}
Jul 06 01:30:56.344744 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:56.344687    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k54wm" podStartSLOduration=0.9378814 podStartE2EDuration="2.344667753s" totalImagesPullingTime="1.406786353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:30:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:30:56.34409513 +0000 UTC m=+264.585863000" watchObservedRunningTime="2026-07-06 01:30:56.344667753 +0000 UTC m=+264.586435611"
Jul 06 01:30:57.865009 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:57.864963    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e934bf1-908b-4a86-8147-c066b499862f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-98vmn\" (UID: \"6e934bf1-908b-4a86-8147-c066b499862f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-98vmn"
Jul 06 01:30:57.865423 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:57.865140    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 01:30:57.865423 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:57.865222    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e934bf1-908b-4a86-8147-c066b499862f-cluster-monitoring-operator-tls podName:6e934bf1-908b-4a86-8147-c066b499862f nodeName:}" failed. No retries permitted until 2026-07-06 01:31:01.865199537 +0000 UTC m=+270.106967386 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6e934bf1-908b-4a86-8147-c066b499862f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-98vmn" (UID: "6e934bf1-908b-4a86-8147-c066b499862f") : secret "cluster-monitoring-operator-tls" not found
Jul 06 01:30:57.966196 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:57.966153    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/83c4a860-31f6-41d4-85ca-36c8fdfcc7f7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-msrt8\" (UID: \"83c4a860-31f6-41d4-85ca-36c8fdfcc7f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-msrt8"
Jul 06 01:30:57.966367 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:57.966329    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 01:30:57.966439 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:57.966410    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83c4a860-31f6-41d4-85ca-36c8fdfcc7f7-samples-operator-tls podName:83c4a860-31f6-41d4-85ca-36c8fdfcc7f7 nodeName:}" failed. No retries permitted until 2026-07-06 01:31:01.96638779 +0000 UTC m=+270.208155639 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/83c4a860-31f6-41d4-85ca-36c8fdfcc7f7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-msrt8" (UID: "83c4a860-31f6-41d4-85ca-36c8fdfcc7f7") : secret "samples-operator-tls" not found
Jul 06 01:30:58.304987 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.304896    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vt7b6"]
Jul 06 01:30:58.313514 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.313486    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:30:58.317401 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.317371    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 01:30:58.317401 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.317371    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 01:30:58.317665 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.317414    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 01:30:58.318115 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.318098    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 01:30:58.318218 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.318197    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9xpc9\""
Jul 06 01:30:58.331939 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.331908    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vt7b6"]
Jul 06 01:30:58.338805 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.338763    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nm48x" event={"ID":"7a7e13be-4e2d-4ee6-838a-4507db79883a","Type":"ContainerStarted","Data":"484e28bf3469667d13ceb15743930d3f0bc75bf2052d450cee9a40484d159e3a"}
Jul 06 01:30:58.343166 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.343127    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-msdjx" event={"ID":"5b959825-a5f6-42c8-b8fa-c1228e63563b","Type":"ContainerStarted","Data":"8609285782e8e2cdfeb23999d1ef8988a2faacad6dc56899fcd9f2b7bc68a975"}
Jul 06 01:30:58.370233 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.370190    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm92b\" (UniqueName: \"kubernetes.io/projected/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-kube-api-access-qm92b\") pod \"insights-runtime-extractor-vt7b6\" (UID: \"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59\") " pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:30:58.370401 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.370250    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vt7b6\" (UID: \"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59\") " pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:30:58.370401 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.370339    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-data-volume\") pod \"insights-runtime-extractor-vt7b6\" (UID: \"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59\") " pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:30:58.370501 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.370453    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-crio-socket\") pod \"insights-runtime-extractor-vt7b6\" (UID: \"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59\") " pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:30:58.370581 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.370540    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vt7b6\" (UID: \"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59\") " pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:30:58.375716 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.375659    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nm48x" podStartSLOduration=1.5434033889999998 podStartE2EDuration="4.375605285s" totalImagesPullingTime="2.832201896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:30:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:30:58.373788875 +0000 UTC m=+266.615556733" watchObservedRunningTime="2026-07-06 01:30:58.375605285 +0000 UTC m=+266.617373155"
Jul 06 01:30:58.395426 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.395354    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-msdjx" podStartSLOduration=1.635530859 podStartE2EDuration="4.39533148s" totalImagesPullingTime="2.759800621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:30:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:30:58.393714171 +0000 UTC m=+266.635482039" watchObservedRunningTime="2026-07-06 01:30:58.39533148 +0000 UTC m=+266.637099347"
Jul 06 01:30:58.471109 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.471047    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vt7b6\" (UID: \"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59\") " pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:30:58.471333 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.471156    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-data-volume\") pod \"insights-runtime-extractor-vt7b6\" (UID: \"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59\") " pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:30:58.471333 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:58.471184    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 01:30:58.471333 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.471261    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-crio-socket\") pod \"insights-runtime-extractor-vt7b6\" (UID: \"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59\") " pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:30:58.471333 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:58.471276    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-kube-rbac-proxy-cm podName:7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59 nodeName:}" failed. No retries permitted until 2026-07-06 01:30:58.971254453 +0000 UTC m=+267.213022298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vt7b6" (UID: "7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59") : configmap "kube-rbac-proxy" not found
Jul 06 01:30:58.471333 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.471196    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-crio-socket\") pod \"insights-runtime-extractor-vt7b6\" (UID: \"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59\") " pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:30:58.471598 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.471335    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vt7b6\" (UID: \"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59\") " pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:30:58.471598 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.471390    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm92b\" (UniqueName: \"kubernetes.io/projected/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-kube-api-access-qm92b\") pod \"insights-runtime-extractor-vt7b6\" (UID: \"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59\") " pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:30:58.471598 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:58.471487    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 01:30:58.471598 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.471560    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-data-volume\") pod \"insights-runtime-extractor-vt7b6\" (UID: \"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59\") " pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:30:58.471598 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:58.471577    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-insights-runtime-extractor-tls podName:7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59 nodeName:}" failed. No retries permitted until 2026-07-06 01:30:58.97155985 +0000 UTC m=+267.213327698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vt7b6" (UID: "7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59") : secret "insights-runtime-extractor-tls" not found
Jul 06 01:30:58.484295 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.484260    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm92b\" (UniqueName: \"kubernetes.io/projected/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-kube-api-access-qm92b\") pod \"insights-runtime-extractor-vt7b6\" (UID: \"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59\") " pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:30:58.866324 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.866278    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-8xfzg"]
Jul 06 01:30:58.869809 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.869781    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-8xfzg"
Jul 06 01:30:58.873935 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.873908    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 06 01:30:58.874080 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.873962    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-7w9nm\""
Jul 06 01:30:58.875185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.875163    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 06 01:30:58.880761 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.880733    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-8xfzg"]
Jul 06 01:30:58.974987 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.974938    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vt7b6\" (UID: \"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59\") " pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:30:58.975196 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.975097    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vt7b6\" (UID: \"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59\") " pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:30:58.975196 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:58.975130    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtfpz\" (UniqueName: \"kubernetes.io/projected/09d08232-f56e-4207-b158-eb2ee43beb03-kube-api-access-vtfpz\") pod \"migrator-d57d58cc9-8xfzg\" (UID: \"09d08232-f56e-4207-b158-eb2ee43beb03\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-8xfzg"
Jul 06 01:30:58.975305 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:58.975261    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 01:30:58.975374 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:58.975355    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-kube-rbac-proxy-cm podName:7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59 nodeName:}" failed. No retries permitted until 2026-07-06 01:30:59.975335723 +0000 UTC m=+268.217103582 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vt7b6" (UID: "7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59") : configmap "kube-rbac-proxy" not found
Jul 06 01:30:58.975845 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:58.975816    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 01:30:58.975968 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:58.975880    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-insights-runtime-extractor-tls podName:7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59 nodeName:}" failed. No retries permitted until 2026-07-06 01:30:59.97586644 +0000 UTC m=+268.217634289 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vt7b6" (UID: "7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59") : secret "insights-runtime-extractor-tls" not found
Jul 06 01:30:59.076027 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:59.075983    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtfpz\" (UniqueName: \"kubernetes.io/projected/09d08232-f56e-4207-b158-eb2ee43beb03-kube-api-access-vtfpz\") pod \"migrator-d57d58cc9-8xfzg\" (UID: \"09d08232-f56e-4207-b158-eb2ee43beb03\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-8xfzg"
Jul 06 01:30:59.085937 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:59.085906    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtfpz\" (UniqueName: \"kubernetes.io/projected/09d08232-f56e-4207-b158-eb2ee43beb03-kube-api-access-vtfpz\") pod \"migrator-d57d58cc9-8xfzg\" (UID: \"09d08232-f56e-4207-b158-eb2ee43beb03\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-8xfzg"
Jul 06 01:30:59.181958 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:59.181858    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-8xfzg"
Jul 06 01:30:59.313808 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:59.313768    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-8xfzg"]
Jul 06 01:30:59.317054 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:30:59.317023    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09d08232_f56e_4207_b158_eb2ee43beb03.slice/crio-8571fc523eaf76144d722e9aa0310d90fe04acebed71ec0e515289d60ed834f1 WatchSource:0}: Error finding container 8571fc523eaf76144d722e9aa0310d90fe04acebed71ec0e515289d60ed834f1: Status 404 returned error can't find the container with id 8571fc523eaf76144d722e9aa0310d90fe04acebed71ec0e515289d60ed834f1
Jul 06 01:30:59.347618 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:59.347573    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-8xfzg" event={"ID":"09d08232-f56e-4207-b158-eb2ee43beb03","Type":"ContainerStarted","Data":"8571fc523eaf76144d722e9aa0310d90fe04acebed71ec0e515289d60ed834f1"}
Jul 06 01:30:59.982518 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:59.982479    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vt7b6\" (UID: \"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59\") " pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:30:59.983085 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:30:59.982547    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vt7b6\" (UID: \"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59\") " pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:30:59.983085 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:59.982636    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 01:30:59.983085 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:59.982672    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 01:30:59.983085 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:59.982703    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-kube-rbac-proxy-cm podName:7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59 nodeName:}" failed. No retries permitted until 2026-07-06 01:31:01.98268701 +0000 UTC m=+270.224454855 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vt7b6" (UID: "7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59") : configmap "kube-rbac-proxy" not found
Jul 06 01:30:59.983085 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:30:59.982747    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-insights-runtime-extractor-tls podName:7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59 nodeName:}" failed. No retries permitted until 2026-07-06 01:31:01.982728754 +0000 UTC m=+270.224496599 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vt7b6" (UID: "7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59") : secret "insights-runtime-extractor-tls" not found
Jul 06 01:31:00.490236 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:00.490204    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zzmqr_a357dec8-e2fb-4fd2-bea2-5f16400a0aef/dns-node-resolver/0.log"
Jul 06 01:31:01.311563 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:01.311522    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-6xmpj"]
Jul 06 01:31:01.315317 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:01.315256    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-6xmpj"
Jul 06 01:31:01.318159 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:01.318136    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 06 01:31:01.318159 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:01.318153    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-7qmfk\""
Jul 06 01:31:01.318159 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:01.318136    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 06 01:31:01.319439 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:01.319413    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 06 01:31:01.319899 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:01.319876    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 06 01:31:01.321282 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:01.321261    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-6xmpj"]
Jul 06 01:31:01.357980 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:01.357940    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-8xfzg" event={"ID":"09d08232-f56e-4207-b158-eb2ee43beb03","Type":"ContainerStarted","Data":"6c794d2433e66367fbbb1a19d11d25374985fc57b30ed04c7f88ff7ac74bc1b7"}
Jul 06 01:31:01.358160 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:01.357999    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-8xfzg" event={"ID":"09d08232-f56e-4207-b158-eb2ee43beb03","Type":"ContainerStarted","Data":"88c18d3b04bd2e185ecf88209aad16cbfc6b157d471e79466d83b94e56bdeeb3"}
Jul 06 01:31:01.374085 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:01.374022    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-8xfzg" podStartSLOduration=2.103194386 podStartE2EDuration="3.374002798s" totalImagesPullingTime="1.270808412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:31:01.372895555 +0000 UTC m=+269.614663425" watchObservedRunningTime="2026-07-06 01:31:01.374002798 +0000 UTC m=+269.615770664"
Jul 06 01:31:01.394796 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:01.394754    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6ad81cca-5864-4f22-a43e-f5ee03e6ee18-signing-key\") pod \"service-ca-758f599c5-6xmpj\" (UID: \"6ad81cca-5864-4f22-a43e-f5ee03e6ee18\") " pod="openshift-service-ca/service-ca-758f599c5-6xmpj"
Jul 06 01:31:01.394968 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:01.394892    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6ad81cca-5864-4f22-a43e-f5ee03e6ee18-signing-cabundle\") pod \"service-ca-758f599c5-6xmpj\" (UID: \"6ad81cca-5864-4f22-a43e-f5ee03e6ee18\") " pod="openshift-service-ca/service-ca-758f599c5-6xmpj"
Jul 06 01:31:01.394968 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:01.394920    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64szl\" (UniqueName: \"kubernetes.io/projected/6ad81cca-5864-4f22-a43e-f5ee03e6ee18-kube-api-access-64szl\") pod \"service-ca-758f599c5-6xmpj\" (UID: \"6ad81cca-5864-4f22-a43e-f5ee03e6ee18\") " pod="openshift-service-ca/service-ca-758f599c5-6xmpj"
Jul 06 01:31:01.490000 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:01.489973    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bphvc_077f7485-8962-4195-b5a1-26f4e3b1c3e0/node-ca/0.log"
Jul 06 01:31:01.496309 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:01.496282    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6ad81cca-5864-4f22-a43e-f5ee03e6ee18-signing-key\") pod \"service-ca-758f599c5-6xmpj\" (UID: \"6ad81cca-5864-4f22-a43e-f5ee03e6ee18\") " pod="openshift-service-ca/service-ca-758f599c5-6xmpj"
Jul 06 01:31:01.496411 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:01.496358    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6ad81cca-5864-4f22-a43e-f5ee03e6ee18-signing-cabundle\") pod \"service-ca-758f599c5-6xmpj\" (UID: \"6ad81cca-5864-4f22-a43e-f5ee03e6ee18\") " pod="openshift-service-ca/service-ca-758f599c5-6xmpj"
Jul 06 01:31:01.496411 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:01.496376    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64szl\" (UniqueName: \"kubernetes.io/projected/6ad81cca-5864-4f22-a43e-f5ee03e6ee18-kube-api-access-64szl\") pod \"service-ca-758f599c5-6xmpj\" (UID: \"6ad81cca-5864-4f22-a43e-f5ee03e6ee18\") " pod="openshift-service-ca/service-ca-758f599c5-6xmpj"
Jul 06 01:31:01.497129 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:01.497104    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6ad81cca-5864-4f22-a43e-f5ee03e6ee18-signing-cabundle\") pod \"service-ca-758f599c5-6xmpj\" (UID: \"6ad81cca-5864-4f22-a43e-f5ee03e6ee18\") " pod="openshift-service-ca/service-ca-758f599c5-6xmpj"
Jul 06 01:31:01.498766 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:01.498739    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6ad81cca-5864-4f22-a43e-f5ee03e6ee18-signing-key\") pod \"service-ca-758f599c5-6xmpj\" (UID: \"6ad81cca-5864-4f22-a43e-f5ee03e6ee18\") " pod="openshift-service-ca/service-ca-758f599c5-6xmpj"
Jul 06 01:31:01.505260 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:01.505232    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64szl\" (UniqueName: \"kubernetes.io/projected/6ad81cca-5864-4f22-a43e-f5ee03e6ee18-kube-api-access-64szl\") pod \"service-ca-758f599c5-6xmpj\" (UID: \"6ad81cca-5864-4f22-a43e-f5ee03e6ee18\") " pod="openshift-service-ca/service-ca-758f599c5-6xmpj"
Jul 06 01:31:01.624680 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:01.624619    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-6xmpj"
Jul 06 01:31:01.756417 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:01.756382    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-6xmpj"]
Jul 06 01:31:01.759495 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:31:01.759464    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ad81cca_5864_4f22_a43e_f5ee03e6ee18.slice/crio-741120dca9e39a5e2796c3ab17855b28167d4d08da93f2ed8a83045a3cc966dc WatchSource:0}: Error finding container 741120dca9e39a5e2796c3ab17855b28167d4d08da93f2ed8a83045a3cc966dc: Status 404 returned error can't find the container with id 741120dca9e39a5e2796c3ab17855b28167d4d08da93f2ed8a83045a3cc966dc
Jul 06 01:31:01.899938 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:01.899843    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e934bf1-908b-4a86-8147-c066b499862f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-98vmn\" (UID: \"6e934bf1-908b-4a86-8147-c066b499862f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-98vmn"
Jul 06 01:31:01.900089 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:31:01.899977    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 01:31:01.900089 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:31:01.900036    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e934bf1-908b-4a86-8147-c066b499862f-cluster-monitoring-operator-tls podName:6e934bf1-908b-4a86-8147-c066b499862f nodeName:}" failed. No retries permitted until 2026-07-06 01:31:09.900020324 +0000 UTC m=+278.141788188 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6e934bf1-908b-4a86-8147-c066b499862f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-98vmn" (UID: "6e934bf1-908b-4a86-8147-c066b499862f") : secret "cluster-monitoring-operator-tls" not found
Jul 06 01:31:02.000646 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:02.000569    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vt7b6\" (UID: \"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59\") " pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:31:02.000830 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:02.000680    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vt7b6\" (UID: \"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59\") " pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:31:02.000830 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:02.000712    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/83c4a860-31f6-41d4-85ca-36c8fdfcc7f7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-msrt8\" (UID: \"83c4a860-31f6-41d4-85ca-36c8fdfcc7f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-msrt8"
Jul 06 01:31:02.000830 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:31:02.000741    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 01:31:02.000830 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:31:02.000797    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 01:31:02.000830 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:31:02.000825    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 01:31:02.001009 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:31:02.000804    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-insights-runtime-extractor-tls podName:7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59 nodeName:}" failed. No retries permitted until 2026-07-06 01:31:06.000788481 +0000 UTC m=+274.242556346 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vt7b6" (UID: "7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59") : secret "insights-runtime-extractor-tls" not found
Jul 06 01:31:02.001009 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:31:02.000873    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-kube-rbac-proxy-cm podName:7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59 nodeName:}" failed. No retries permitted until 2026-07-06 01:31:06.000846987 +0000 UTC m=+274.242614858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vt7b6" (UID: "7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59") : configmap "kube-rbac-proxy" not found
Jul 06 01:31:02.001009 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:31:02.000895    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83c4a860-31f6-41d4-85ca-36c8fdfcc7f7-samples-operator-tls podName:83c4a860-31f6-41d4-85ca-36c8fdfcc7f7 nodeName:}" failed. No retries permitted until 2026-07-06 01:31:10.000884998 +0000 UTC m=+278.242652862 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/83c4a860-31f6-41d4-85ca-36c8fdfcc7f7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-msrt8" (UID: "83c4a860-31f6-41d4-85ca-36c8fdfcc7f7") : secret "samples-operator-tls" not found
Jul 06 01:31:02.090793 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:02.090761    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n968n_f669e88b-69be-4f0d-91c4-afadc96a25b7/serve-healthcheck-canary/0.log"
Jul 06 01:31:02.362283 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:02.362239    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-6xmpj" event={"ID":"6ad81cca-5864-4f22-a43e-f5ee03e6ee18","Type":"ContainerStarted","Data":"22c6056c803d15f23d1d4d38200aa8b7e9beb48a8a8b441eeafc21308d826e66"}
Jul 06 01:31:02.362720 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:02.362308    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-6xmpj" event={"ID":"6ad81cca-5864-4f22-a43e-f5ee03e6ee18","Type":"ContainerStarted","Data":"741120dca9e39a5e2796c3ab17855b28167d4d08da93f2ed8a83045a3cc966dc"}
Jul 06 01:31:02.381239 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:02.381186    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-6xmpj" podStartSLOduration=1.3811671620000001 podStartE2EDuration="1.381167162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:31:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:31:02.380368689 +0000 UTC m=+270.622136559" watchObservedRunningTime="2026-07-06 01:31:02.381167162 +0000 UTC m=+270.622935028"
Jul 06 01:31:06.036719 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:06.036676    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vt7b6\" (UID: \"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59\") " pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:31:06.037218 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:31:06.036810    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 01:31:06.037218 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:06.036824    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vt7b6\" (UID: \"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59\") " pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:31:06.037218 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:31:06.036891    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-kube-rbac-proxy-cm podName:7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59 nodeName:}" failed. No retries permitted until 2026-07-06 01:31:14.036872266 +0000 UTC m=+282.278640124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vt7b6" (UID: "7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59") : configmap "kube-rbac-proxy" not found
Jul 06 01:31:06.037218 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:31:06.036946    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 01:31:06.037218 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:31:06.037000    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-insights-runtime-extractor-tls podName:7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59 nodeName:}" failed. No retries permitted until 2026-07-06 01:31:14.036988815 +0000 UTC m=+282.278756665 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vt7b6" (UID: "7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59") : secret "insights-runtime-extractor-tls" not found
Jul 06 01:31:09.972312 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:09.972270    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e934bf1-908b-4a86-8147-c066b499862f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-98vmn\" (UID: \"6e934bf1-908b-4a86-8147-c066b499862f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-98vmn"
Jul 06 01:31:09.972715 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:31:09.972425    2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 01:31:09.972715 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:31:09.972521    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e934bf1-908b-4a86-8147-c066b499862f-cluster-monitoring-operator-tls podName:6e934bf1-908b-4a86-8147-c066b499862f nodeName:}" failed. No retries permitted until 2026-07-06 01:31:25.972503346 +0000 UTC m=+294.214271192 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6e934bf1-908b-4a86-8147-c066b499862f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-98vmn" (UID: "6e934bf1-908b-4a86-8147-c066b499862f") : secret "cluster-monitoring-operator-tls" not found
Jul 06 01:31:10.073505 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:10.073460    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/83c4a860-31f6-41d4-85ca-36c8fdfcc7f7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-msrt8\" (UID: \"83c4a860-31f6-41d4-85ca-36c8fdfcc7f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-msrt8"
Jul 06 01:31:10.075923 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:10.075894    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/83c4a860-31f6-41d4-85ca-36c8fdfcc7f7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-msrt8\" (UID: \"83c4a860-31f6-41d4-85ca-36c8fdfcc7f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-msrt8"
Jul 06 01:31:10.230037 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:10.229959    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-msrt8"
Jul 06 01:31:10.368602 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:10.368573    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-msrt8"]
Jul 06 01:31:11.393398 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:11.393359    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-msrt8" event={"ID":"83c4a860-31f6-41d4-85ca-36c8fdfcc7f7","Type":"ContainerStarted","Data":"e87a2a830868a5ef9e3351aec5da1c6a90dfe8f5521251e84746072b4f1c6bf9"}
Jul 06 01:31:12.398089 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:12.398060    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-msrt8" event={"ID":"83c4a860-31f6-41d4-85ca-36c8fdfcc7f7","Type":"ContainerStarted","Data":"591b8e362da59c5af88d0eaee0e8da2b2c5ac289a448ffac05a0a4cacd587b77"}
Jul 06 01:31:13.066528 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:31:13.066483    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq" podUID="066f3b60-6fb4-4d35-8fc8-9ed67cbd937d"
Jul 06 01:31:13.066528 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:31:13.066485    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8fc8h" podUID="a1f9d1bf-1910-4c4b-be53-9b51824e21c0"
Jul 06 01:31:13.066528 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:31:13.066483    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-69788b8597-tt6ch" podUID="91217fbf-2d05-4fea-a848-ce72d151cd49"
Jul 06 01:31:13.402753 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:13.402721    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:31:13.403198 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:13.402766    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-msrt8" event={"ID":"83c4a860-31f6-41d4-85ca-36c8fdfcc7f7","Type":"ContainerStarted","Data":"b96963c04d08d3cd277e0917988198d0bc139c14625825556c28f6f5b54e58fb"}
Jul 06 01:31:13.403198 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:13.402954    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:31:13.403198 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:13.403134    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq"
Jul 06 01:31:13.419292 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:13.419234    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-msrt8" podStartSLOduration=17.524968546 podStartE2EDuration="19.419215277s" totalImagesPullingTime="1.894246731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:30:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:31:13.418401494 +0000 UTC m=+281.660169362" watchObservedRunningTime="2026-07-06 01:31:13.419215277 +0000 UTC m=+281.660983145"
Jul 06 01:31:14.109266 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:14.109226    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vt7b6\" (UID: \"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59\") " pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:31:14.109440 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:14.109334    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vt7b6\" (UID: \"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59\") " pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:31:14.109804 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:14.109785    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vt7b6\" (UID: \"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59\") " pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:31:14.111573 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:14.111555    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vt7b6\" (UID: \"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59\") " pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:31:14.224939 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:14.224898    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vt7b6"
Jul 06 01:31:14.360201 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:14.360121    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vt7b6"]
Jul 06 01:31:14.363304 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:31:14.363268    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b8c86a2_9ffe_42b0_bcf3_0f062c0f6c59.slice/crio-c84cbb028271c5a29031479b7975266a95e2c527da51245c9a2a2c0273226b20 WatchSource:0}: Error finding container c84cbb028271c5a29031479b7975266a95e2c527da51245c9a2a2c0273226b20: Status 404 returned error can't find the container with id c84cbb028271c5a29031479b7975266a95e2c527da51245c9a2a2c0273226b20
Jul 06 01:31:14.406978 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:14.406942    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vt7b6" event={"ID":"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59","Type":"ContainerStarted","Data":"c84cbb028271c5a29031479b7975266a95e2c527da51245c9a2a2c0273226b20"}
Jul 06 01:31:16.528014 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:16.527970    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-pxfqq\" (UID: \"066f3b60-6fb4-4d35-8fc8-9ed67cbd937d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq"
Jul 06 01:31:16.528513 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:16.528062    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:31:16.530841 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:16.530810    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls\") pod \"image-registry-69788b8597-tt6ch\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") " pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:31:16.530980 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:16.530813    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/066f3b60-6fb4-4d35-8fc8-9ed67cbd937d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-pxfqq\" (UID: \"066f3b60-6fb4-4d35-8fc8-9ed67cbd937d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq"
Jul 06 01:31:16.629156 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:16.629109    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls\") pod \"dns-default-8fc8h\" (UID: \"a1f9d1bf-1910-4c4b-be53-9b51824e21c0\") " pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:31:16.631771 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:16.631743    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1f9d1bf-1910-4c4b-be53-9b51824e21c0-metrics-tls\") pod \"dns-default-8fc8h\" (UID: \"a1f9d1bf-1910-4c4b-be53-9b51824e21c0\") " pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:31:16.707828 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:16.707770    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-58ndz\""
Jul 06 01:31:16.707828 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:16.707793    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4r7xt\""
Jul 06 01:31:16.707828 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:16.707770    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qzthl\""
Jul 06 01:31:16.714194 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:16.714162    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:31:16.714362 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:16.714200    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:31:16.714362 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:16.714168    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq"
Jul 06 01:31:18.231574 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:18.231497    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69788b8597-tt6ch"]
Jul 06 01:31:18.234368 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:31:18.234322    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91217fbf_2d05_4fea_a848_ce72d151cd49.slice/crio-d64b3900343b150782f54aa2113cf2404ed43372bdb9c01f372696729bc4876a WatchSource:0}: Error finding container d64b3900343b150782f54aa2113cf2404ed43372bdb9c01f372696729bc4876a: Status 404 returned error can't find the container with id d64b3900343b150782f54aa2113cf2404ed43372bdb9c01f372696729bc4876a
Jul 06 01:31:18.249764 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:18.249737    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8fc8h"]
Jul 06 01:31:18.254082 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:31:18.254032    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1f9d1bf_1910_4c4b_be53_9b51824e21c0.slice/crio-3348409b06a01402fc022983783e82b14e99beb751bba9f14b295efce909c6b0 WatchSource:0}: Error finding container 3348409b06a01402fc022983783e82b14e99beb751bba9f14b295efce909c6b0: Status 404 returned error can't find the container with id 3348409b06a01402fc022983783e82b14e99beb751bba9f14b295efce909c6b0
Jul 06 01:31:18.423371 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:18.423329    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vt7b6" event={"ID":"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59","Type":"ContainerStarted","Data":"66e90487828b55756660e99b5ccbc64ddea1ef7f29642942ecb6bff81603ca5a"}
Jul 06 01:31:18.424691 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:18.424664    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8fc8h" event={"ID":"a1f9d1bf-1910-4c4b-be53-9b51824e21c0","Type":"ContainerStarted","Data":"3348409b06a01402fc022983783e82b14e99beb751bba9f14b295efce909c6b0"}
Jul 06 01:31:18.426259 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:18.426223    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69788b8597-tt6ch" event={"ID":"91217fbf-2d05-4fea-a848-ce72d151cd49","Type":"ContainerStarted","Data":"1ae57045a3d329a8763c17b8dbf4792e1237fa0200869038bcd9ec67279384f5"}
Jul 06 01:31:18.426379 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:18.426282    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69788b8597-tt6ch" event={"ID":"91217fbf-2d05-4fea-a848-ce72d151cd49","Type":"ContainerStarted","Data":"d64b3900343b150782f54aa2113cf2404ed43372bdb9c01f372696729bc4876a"}
Jul 06 01:31:18.426379 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:18.426363    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:31:18.448855 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:18.448801    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-69788b8597-tt6ch" podStartSLOduration=285.44878497 podStartE2EDuration="4m45.44878497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:26:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:31:18.447354485 +0000 UTC m=+286.689122354" watchObservedRunningTime="2026-07-06 01:31:18.44878497 +0000 UTC m=+286.690552827"
Jul 06 01:31:18.451973 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:18.451942    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq"]
Jul 06 01:31:18.454983 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:31:18.454953    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod066f3b60_6fb4_4d35_8fc8_9ed67cbd937d.slice/crio-886052cea3fe806aa39add46def6a0ed68147f3bd2a51b1cb5f6044fccf4d584 WatchSource:0}: Error finding container 886052cea3fe806aa39add46def6a0ed68147f3bd2a51b1cb5f6044fccf4d584: Status 404 returned error can't find the container with id 886052cea3fe806aa39add46def6a0ed68147f3bd2a51b1cb5f6044fccf4d584
Jul 06 01:31:19.432040 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:19.431992    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vt7b6" event={"ID":"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59","Type":"ContainerStarted","Data":"c3b72c4ca0788d0a040a627a3c3c80e0948f2cc2ed22b59b42ffe745c7b0666d"}
Jul 06 01:31:19.433380 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:19.433341    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq" event={"ID":"066f3b60-6fb4-4d35-8fc8-9ed67cbd937d","Type":"ContainerStarted","Data":"886052cea3fe806aa39add46def6a0ed68147f3bd2a51b1cb5f6044fccf4d584"}
Jul 06 01:31:22.448258 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:22.448219    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8fc8h" event={"ID":"a1f9d1bf-1910-4c4b-be53-9b51824e21c0","Type":"ContainerStarted","Data":"67bdb6f744173f7bbee090418095727954b125ffd89a8a0449f2d618e7032ea5"}
Jul 06 01:31:22.448716 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:22.448320    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:31:22.448716 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:22.448346    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8fc8h" event={"ID":"a1f9d1bf-1910-4c4b-be53-9b51824e21c0","Type":"ContainerStarted","Data":"6feabc8d9ff1c4d60330ba54a27748398b8dff2d5c2741eba2057d1bdbd3e0b5"}
Jul 06 01:31:22.450206 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:22.450178    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vt7b6" event={"ID":"7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59","Type":"ContainerStarted","Data":"c5e17f28276f7afc9d184081f32b42a7f3c8e413b5884af9c6ed229f6b9ede9f"}
Jul 06 01:31:22.451447 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:22.451417    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq" event={"ID":"066f3b60-6fb4-4d35-8fc8-9ed67cbd937d","Type":"ContainerStarted","Data":"3c407c7468e0111e3d5be68eb7217ad95fa0147c90020095030a4a441e5cb01d"}
Jul 06 01:31:22.466341 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:22.466288    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8fc8h" podStartSLOduration=253.098833363 podStartE2EDuration="4m16.466270199s" totalImagesPullingTime="3.367436836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:27:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:31:22.465179298 +0000 UTC m=+290.706947166" watchObservedRunningTime="2026-07-06 01:31:22.466270199 +0000 UTC m=+290.708038120"
Jul 06 01:31:22.481182 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:22.481132    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-pxfqq" podStartSLOduration=263.31399807 podStartE2EDuration="4m26.481115057s" totalImagesPullingTime="3.167116987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:26:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:31:22.480533753 +0000 UTC m=+290.722301620" watchObservedRunningTime="2026-07-06 01:31:22.481115057 +0000 UTC m=+290.722882924"
Jul 06 01:31:22.497469 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:22.497410    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vt7b6" podStartSLOduration=17.366065251 podStartE2EDuration="24.497392462s" totalImagesPullingTime="7.131327211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:30:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:31:22.496249572 +0000 UTC m=+290.738017457" watchObservedRunningTime="2026-07-06 01:31:22.497392462 +0000 UTC m=+290.739160329"
Jul 06 01:31:26.008928 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:26.008869    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e934bf1-908b-4a86-8147-c066b499862f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-98vmn\" (UID: \"6e934bf1-908b-4a86-8147-c066b499862f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-98vmn"
Jul 06 01:31:26.011339 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:26.011306    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6e934bf1-908b-4a86-8147-c066b499862f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-98vmn\" (UID: \"6e934bf1-908b-4a86-8147-c066b499862f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-98vmn"
Jul 06 01:31:26.029188 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:26.029138    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-98vmn"
Jul 06 01:31:26.163698 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:26.163667    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-98vmn"]
Jul 06 01:31:26.167196 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:31:26.167166    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e934bf1_908b_4a86_8147_c066b499862f.slice/crio-612bf621c57394e8b538af9b421d76db8ceee67cbddb915e8969a474d2db3ff5 WatchSource:0}: Error finding container 612bf621c57394e8b538af9b421d76db8ceee67cbddb915e8969a474d2db3ff5: Status 404 returned error can't find the container with id 612bf621c57394e8b538af9b421d76db8ceee67cbddb915e8969a474d2db3ff5
Jul 06 01:31:26.468135 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:26.468101    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-98vmn" event={"ID":"6e934bf1-908b-4a86-8147-c066b499862f","Type":"ContainerStarted","Data":"612bf621c57394e8b538af9b421d76db8ceee67cbddb915e8969a474d2db3ff5"}
Jul 06 01:31:28.478689 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:28.478591    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-98vmn" event={"ID":"6e934bf1-908b-4a86-8147-c066b499862f","Type":"ContainerStarted","Data":"1a3a349765dbaeda5050809f465263e8f9f812c7bfbfc96cabf93ec07696f29b"}
Jul 06 01:31:28.506477 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:28.506422    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-98vmn" podStartSLOduration=32.462715642 podStartE2EDuration="34.506406785s" totalImagesPullingTime="2.043691143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:30:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:31:28.506245569 +0000 UTC m=+296.748013437" watchObservedRunningTime="2026-07-06 01:31:28.506406785 +0000 UTC m=+296.748174651"
Jul 06 01:31:28.609862 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:31:28.609810    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7fkg2" podUID="d05d6ef9-2d73-4ab9-b875-7d121bd89c4d"
Jul 06 01:31:28.732107 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:28.732023    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-l7d4h"]
Jul 06 01:31:28.735144 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:28.735125    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-l7d4h"
Jul 06 01:31:28.737553 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:28.737536    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 06 01:31:28.737661 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:28.737592    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gdwlf\""
Jul 06 01:31:28.743918 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:28.743888    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-l7d4h"]
Jul 06 01:31:28.830391 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:28.830352    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4474038e-cfb1-44e7-bb36-e1f9f1bd1ce0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-l7d4h\" (UID: \"4474038e-cfb1-44e7-bb36-e1f9f1bd1ce0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-l7d4h"
Jul 06 01:31:28.931164 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:28.931128    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4474038e-cfb1-44e7-bb36-e1f9f1bd1ce0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-l7d4h\" (UID: \"4474038e-cfb1-44e7-bb36-e1f9f1bd1ce0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-l7d4h"
Jul 06 01:31:28.933682 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:28.933659    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4474038e-cfb1-44e7-bb36-e1f9f1bd1ce0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-l7d4h\" (UID: \"4474038e-cfb1-44e7-bb36-e1f9f1bd1ce0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-l7d4h"
Jul 06 01:31:29.045290 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:29.045200    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-l7d4h"
Jul 06 01:31:29.181533 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:29.181499    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-l7d4h"]
Jul 06 01:31:29.184832 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:31:29.184791    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4474038e_cfb1_44e7_bb36_e1f9f1bd1ce0.slice/crio-b806677a53452b6e135a2f13839dd8d3594080c2dc780ea94084e82c229e243d WatchSource:0}: Error finding container b806677a53452b6e135a2f13839dd8d3594080c2dc780ea94084e82c229e243d: Status 404 returned error can't find the container with id b806677a53452b6e135a2f13839dd8d3594080c2dc780ea94084e82c229e243d
Jul 06 01:31:29.483245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:29.483204    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-l7d4h" event={"ID":"4474038e-cfb1-44e7-bb36-e1f9f1bd1ce0","Type":"ContainerStarted","Data":"b806677a53452b6e135a2f13839dd8d3594080c2dc780ea94084e82c229e243d"}
Jul 06 01:31:31.492186 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:31.492145    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-l7d4h" event={"ID":"4474038e-cfb1-44e7-bb36-e1f9f1bd1ce0","Type":"ContainerStarted","Data":"3318ba0ad98415d442d6dc78047f8f5b0f8c52b2f3c111fd1ba5be8523176efa"}
Jul 06 01:31:31.492741 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:31.492353    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-l7d4h"
Jul 06 01:31:31.496924 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:31.496894    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-l7d4h"
Jul 06 01:31:31.508511 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:31.508464    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-l7d4h" podStartSLOduration=2.110526721 podStartE2EDuration="3.508448952s" totalImagesPullingTime="1.397922231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:31:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:31:31.506963924 +0000 UTC m=+299.748731791" watchObservedRunningTime="2026-07-06 01:31:31.508448952 +0000 UTC m=+299.750216819"
Jul 06 01:31:31.782506 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:31.782424    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-fw866"]
Jul 06 01:31:31.812866 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:31.812827    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-fw866"]
Jul 06 01:31:31.813065 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:31.812964    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fw866"
Jul 06 01:31:31.815594 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:31.815563    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 06 01:31:31.816721 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:31.816699    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 06 01:31:31.816830 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:31.816720    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 01:31:31.816830 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:31.816704    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-g9wc9\""
Jul 06 01:31:31.957327 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:31.957289    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ph2f\" (UniqueName: \"kubernetes.io/projected/1174c84d-15b7-4016-9d0f-9b76fc428049-kube-api-access-4ph2f\") pod \"prometheus-operator-567f7b8b7c-fw866\" (UID: \"1174c84d-15b7-4016-9d0f-9b76fc428049\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fw866"
Jul 06 01:31:31.957492 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:31.957349    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1174c84d-15b7-4016-9d0f-9b76fc428049-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-fw866\" (UID: \"1174c84d-15b7-4016-9d0f-9b76fc428049\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fw866"
Jul 06 01:31:31.957492 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:31.957434    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1174c84d-15b7-4016-9d0f-9b76fc428049-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-fw866\" (UID: \"1174c84d-15b7-4016-9d0f-9b76fc428049\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fw866"
Jul 06 01:31:31.957492 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:31.957483    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1174c84d-15b7-4016-9d0f-9b76fc428049-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-fw866\" (UID: \"1174c84d-15b7-4016-9d0f-9b76fc428049\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fw866"
Jul 06 01:31:32.058358 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:32.058264    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ph2f\" (UniqueName: \"kubernetes.io/projected/1174c84d-15b7-4016-9d0f-9b76fc428049-kube-api-access-4ph2f\") pod \"prometheus-operator-567f7b8b7c-fw866\" (UID: \"1174c84d-15b7-4016-9d0f-9b76fc428049\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fw866"
Jul 06 01:31:32.058358 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:32.058336    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1174c84d-15b7-4016-9d0f-9b76fc428049-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-fw866\" (UID: \"1174c84d-15b7-4016-9d0f-9b76fc428049\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fw866"
Jul 06 01:31:32.058559 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:32.058374    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1174c84d-15b7-4016-9d0f-9b76fc428049-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-fw866\" (UID: \"1174c84d-15b7-4016-9d0f-9b76fc428049\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fw866"
Jul 06 01:31:32.058559 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:32.058419    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1174c84d-15b7-4016-9d0f-9b76fc428049-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-fw866\" (UID: \"1174c84d-15b7-4016-9d0f-9b76fc428049\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fw866"
Jul 06 01:31:32.058559 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:31:32.058511    2584 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 06 01:31:32.058715 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:31:32.058595    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1174c84d-15b7-4016-9d0f-9b76fc428049-prometheus-operator-tls podName:1174c84d-15b7-4016-9d0f-9b76fc428049 nodeName:}" failed. No retries permitted until 2026-07-06 01:31:32.558573634 +0000 UTC m=+300.800341480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/1174c84d-15b7-4016-9d0f-9b76fc428049-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-fw866" (UID: "1174c84d-15b7-4016-9d0f-9b76fc428049") : secret "prometheus-operator-tls" not found
Jul 06 01:31:32.059183 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:32.059152    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1174c84d-15b7-4016-9d0f-9b76fc428049-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-fw866\" (UID: \"1174c84d-15b7-4016-9d0f-9b76fc428049\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fw866"
Jul 06 01:31:32.061041 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:32.061012    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1174c84d-15b7-4016-9d0f-9b76fc428049-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-fw866\" (UID: \"1174c84d-15b7-4016-9d0f-9b76fc428049\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fw866"
Jul 06 01:31:32.067074 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:32.067048    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ph2f\" (UniqueName: \"kubernetes.io/projected/1174c84d-15b7-4016-9d0f-9b76fc428049-kube-api-access-4ph2f\") pod \"prometheus-operator-567f7b8b7c-fw866\" (UID: \"1174c84d-15b7-4016-9d0f-9b76fc428049\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fw866"
Jul 06 01:31:32.226123 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:32.226096    2584 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 01:31:32.456861 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:32.456833    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8fc8h"
Jul 06 01:31:32.563436 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:32.563276    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1174c84d-15b7-4016-9d0f-9b76fc428049-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-fw866\" (UID: \"1174c84d-15b7-4016-9d0f-9b76fc428049\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fw866"
Jul 06 01:31:32.570350 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:32.565716    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1174c84d-15b7-4016-9d0f-9b76fc428049-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-fw866\" (UID: \"1174c84d-15b7-4016-9d0f-9b76fc428049\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fw866"
Jul 06 01:31:32.725671 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:32.725559    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-g9wc9\""
Jul 06 01:31:32.732702 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:32.732678    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fw866"
Jul 06 01:31:32.865847 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:32.865810    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-fw866"]
Jul 06 01:31:32.868876 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:31:32.868848    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1174c84d_15b7_4016_9d0f_9b76fc428049.slice/crio-1762533ba4d38bb73ddee0934fe12de530c62120dbda1e4004b012f4392916cb WatchSource:0}: Error finding container 1762533ba4d38bb73ddee0934fe12de530c62120dbda1e4004b012f4392916cb: Status 404 returned error can't find the container with id 1762533ba4d38bb73ddee0934fe12de530c62120dbda1e4004b012f4392916cb
Jul 06 01:31:33.500436 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:33.500403    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fw866" event={"ID":"1174c84d-15b7-4016-9d0f-9b76fc428049","Type":"ContainerStarted","Data":"1762533ba4d38bb73ddee0934fe12de530c62120dbda1e4004b012f4392916cb"}
Jul 06 01:31:34.505614 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:34.505534    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fw866" event={"ID":"1174c84d-15b7-4016-9d0f-9b76fc428049","Type":"ContainerStarted","Data":"8d98595ac27ed9b59e99a72f94d16bd6f6335a372920130d52d36980dbe82be2"}
Jul 06 01:31:34.505979 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:34.505615    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fw866" event={"ID":"1174c84d-15b7-4016-9d0f-9b76fc428049","Type":"ContainerStarted","Data":"e36f9c8987b33c448bcd1dfc2be53dce604e2e9271c6b3393545b6e2bcc52368"}
Jul 06 01:31:34.524235 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:34.524183    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fw866" podStartSLOduration=2.141046996 podStartE2EDuration="3.524168687s" totalImagesPullingTime="1.383121691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:31:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:31:34.523007463 +0000 UTC m=+302.764775330" watchObservedRunningTime="2026-07-06 01:31:34.524168687 +0000 UTC m=+302.765936588"
Jul 06 01:31:36.117507 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.117472    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hh9th"]
Jul 06 01:31:36.121332 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.121310    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.123821 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.123796    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 01:31:36.124003 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.123963    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 01:31:36.124112 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.124096    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 01:31:36.124329 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.124316    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tppmq\""
Jul 06 01:31:36.295531 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.295491    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-root\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.295766 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.295545    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-sys\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.295766 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.295572    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.295766 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.295605    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-node-exporter-wtmp\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.295766 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.295650    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-metrics-client-ca\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.295766 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.295678    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbn6b\" (UniqueName: \"kubernetes.io/projected/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-kube-api-access-sbn6b\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.295766 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.295708    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-node-exporter-accelerators-collector-config\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.296071 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.295771    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-node-exporter-tls\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.296071 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.295796    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-node-exporter-textfile\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.397198 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.397093    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-sys\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.397198 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.397143    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.397198 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.397174    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-node-exporter-wtmp\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.397485 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.397207    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-metrics-client-ca\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.397485 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.397238    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbn6b\" (UniqueName: \"kubernetes.io/projected/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-kube-api-access-sbn6b\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.397485 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.397252    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-sys\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.397485 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.397269    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-node-exporter-accelerators-collector-config\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.397485 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.397356    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-node-exporter-tls\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.397485 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.397386    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-node-exporter-textfile\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.397485 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.397442    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-root\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.397840 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.397532    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-root\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.397840 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.397715    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-node-exporter-wtmp\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.397982 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.397960    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-node-exporter-accelerators-collector-config\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.398414 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.398390    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-metrics-client-ca\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.398517 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.398439    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-node-exporter-textfile\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.400244 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.400218    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.400761 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.400737    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-node-exporter-tls\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.410646 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.408498    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbn6b\" (UniqueName: \"kubernetes.io/projected/460b272d-f0f4-4589-b9e2-45ad3bc13f5d-kube-api-access-sbn6b\") pod \"node-exporter-hh9th\" (UID: \"460b272d-f0f4-4589-b9e2-45ad3bc13f5d\") " pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.433324 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.433286    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hh9th"
Jul 06 01:31:36.448600 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:31:36.448565    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod460b272d_f0f4_4589_b9e2_45ad3bc13f5d.slice/crio-a8b5dd54c4cd59dcd4e34fb338a4e394359a4ae1d1c96ae15f6b8e2c9f7dc911 WatchSource:0}: Error finding container a8b5dd54c4cd59dcd4e34fb338a4e394359a4ae1d1c96ae15f6b8e2c9f7dc911: Status 404 returned error can't find the container with id a8b5dd54c4cd59dcd4e34fb338a4e394359a4ae1d1c96ae15f6b8e2c9f7dc911
Jul 06 01:31:36.451226 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.451205    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 01:31:36.515251 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.515169    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hh9th" event={"ID":"460b272d-f0f4-4589-b9e2-45ad3bc13f5d","Type":"ContainerStarted","Data":"a8b5dd54c4cd59dcd4e34fb338a4e394359a4ae1d1c96ae15f6b8e2c9f7dc911"}
Jul 06 01:31:36.718799 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.718718    2584 patch_prober.go:28] interesting pod/image-registry-69788b8597-tt6ch container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 01:31:36.718799 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:36.718779    2584 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-69788b8597-tt6ch" podUID="91217fbf-2d05-4fea-a848-ce72d151cd49" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 01:31:37.175445 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.175408    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 01:31:37.180407 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.180380    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.187045 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.187004    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 01:31:37.196248 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.195981    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 01:31:37.196248 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.196015    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 01:31:37.196248 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.196113    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 01:31:37.196535 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.196372    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 01:31:37.196535 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.196403    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 01:31:37.197581 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.197226    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 01:31:37.197581 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.197438    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 01:31:37.199342 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.199321    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-h7cmf\""
Jul 06 01:31:37.206035 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.206001    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 01:31:37.206399 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.206378    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 01:31:37.305767 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.305724    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-web-config\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.306061 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.305788    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1d067bc0-b4ef-43c0-844a-93a32d30f011-config-out\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.306061 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.305822    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.306061 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.305853    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d067bc0-b4ef-43c0-844a-93a32d30f011-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.306061 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.305884    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1d067bc0-b4ef-43c0-844a-93a32d30f011-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.306061 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.305913    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.306061 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.306033    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qgwn\" (UniqueName: \"kubernetes.io/projected/1d067bc0-b4ef-43c0-844a-93a32d30f011-kube-api-access-2qgwn\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.306417 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.306100    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-config-volume\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.306417 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.306151    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.306417 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.306191    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.306417 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.306219    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d067bc0-b4ef-43c0-844a-93a32d30f011-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.306417 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.306252    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1d067bc0-b4ef-43c0-844a-93a32d30f011-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.306417 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.306313    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.407108 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.407064    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1d067bc0-b4ef-43c0-844a-93a32d30f011-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.407302 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.407120    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.407302 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.407165    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-web-config\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.407302 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.407201    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1d067bc0-b4ef-43c0-844a-93a32d30f011-config-out\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.407302 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.407223    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.407302 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.407247    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d067bc0-b4ef-43c0-844a-93a32d30f011-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.407302 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.407273    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1d067bc0-b4ef-43c0-844a-93a32d30f011-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.407302 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.407299    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.407747 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.407341    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qgwn\" (UniqueName: \"kubernetes.io/projected/1d067bc0-b4ef-43c0-844a-93a32d30f011-kube-api-access-2qgwn\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.407747 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.407367    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-config-volume\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.407747 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.407394    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.407747 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.407427    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.407747 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.407451    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d067bc0-b4ef-43c0-844a-93a32d30f011-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.407747 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.407534    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1d067bc0-b4ef-43c0-844a-93a32d30f011-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.408359 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.408331    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d067bc0-b4ef-43c0-844a-93a32d30f011-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.408559 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.408534    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d067bc0-b4ef-43c0-844a-93a32d30f011-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.410840 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.410814    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.411090 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.411065    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.411377 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.411355    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-web-config\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.413522 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.412910    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-config-volume\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.413522 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.412972    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.413522 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.413149    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1d067bc0-b4ef-43c0-844a-93a32d30f011-config-out\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.413522 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.413330    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1d067bc0-b4ef-43c0-844a-93a32d30f011-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.413522 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.413393    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.414417 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.414393    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.415775 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.415750    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qgwn\" (UniqueName: \"kubernetes.io/projected/1d067bc0-b4ef-43c0-844a-93a32d30f011-kube-api-access-2qgwn\") pod \"alertmanager-main-0\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.490941 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.490851    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:31:37.651798 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:37.651754    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 01:31:37.759476 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:31:37.759403    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d067bc0_b4ef_43c0_844a_93a32d30f011.slice/crio-8a4b859a5f7a1321facd3cfdf58cb980ead55e71cdd4241e3a19dc8c50772cc3 WatchSource:0}: Error finding container 8a4b859a5f7a1321facd3cfdf58cb980ead55e71cdd4241e3a19dc8c50772cc3: Status 404 returned error can't find the container with id 8a4b859a5f7a1321facd3cfdf58cb980ead55e71cdd4241e3a19dc8c50772cc3
Jul 06 01:31:38.524795 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:38.524756    2584 generic.go:356] "Generic (PLEG): container finished" podID="460b272d-f0f4-4589-b9e2-45ad3bc13f5d" containerID="688102a7e5f2e6c558d5245e5e5939ee941cd51b858c646ce95981b66c0c6b37" exitCode=0
Jul 06 01:31:38.525259 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:38.524838    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hh9th" event={"ID":"460b272d-f0f4-4589-b9e2-45ad3bc13f5d","Type":"ContainerDied","Data":"688102a7e5f2e6c558d5245e5e5939ee941cd51b858c646ce95981b66c0c6b37"}
Jul 06 01:31:38.526280 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:38.526247    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1d067bc0-b4ef-43c0-844a-93a32d30f011","Type":"ContainerStarted","Data":"8a4b859a5f7a1321facd3cfdf58cb980ead55e71cdd4241e3a19dc8c50772cc3"}
Jul 06 01:31:39.438957 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:39.438869    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:31:39.531559 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:39.531527    2584 generic.go:356] "Generic (PLEG): container finished" podID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerID="ca6d4c22e43b3478885c8d0beb40906ed8dd1b48f39a01bde0251819bf0656a6" exitCode=0
Jul 06 01:31:39.532083 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:39.531608    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1d067bc0-b4ef-43c0-844a-93a32d30f011","Type":"ContainerDied","Data":"ca6d4c22e43b3478885c8d0beb40906ed8dd1b48f39a01bde0251819bf0656a6"}
Jul 06 01:31:39.534606 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:39.534580    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hh9th" event={"ID":"460b272d-f0f4-4589-b9e2-45ad3bc13f5d","Type":"ContainerStarted","Data":"f1c245cbd3173ba8fd4856c6df4f9767082cc083d9855ddcfc44564acd7ca09e"}
Jul 06 01:31:39.534718 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:39.534676    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hh9th" event={"ID":"460b272d-f0f4-4589-b9e2-45ad3bc13f5d","Type":"ContainerStarted","Data":"5eabfb0608fbae081b63a43233568da575d12d8cf35f28d6f4b353d228f4ce9e"}
Jul 06 01:31:39.591847 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:39.591791    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hh9th" podStartSLOduration=2.170715295 podStartE2EDuration="3.591772846s" totalImagesPullingTime="1.353115249s" totalInitContainerRuntime="67.942302ms" isStatefulPod=true podCreationTimestamp="2026-07-06 01:31:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:31:39.59077185 +0000 UTC m=+307.832539717" watchObservedRunningTime="2026-07-06 01:31:39.591772846 +0000 UTC m=+307.833540733"
Jul 06 01:31:40.420396 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.420355    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-667dc4fbfd-njv4v"]
Jul 06 01:31:40.423877 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.423813    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:31:40.426643 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.426603    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 06 01:31:40.426767 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.426619    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 06 01:31:40.427846 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.427819    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 01:31:40.427976 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.427899    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 06 01:31:40.427976 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.427957    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vkz2s\""
Jul 06 01:31:40.428098 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.427904    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-smvui44oj1pd\""
Jul 06 01:31:40.433484 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.433460    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e4b0b454-1a46-4e71-9b66-f375be6de58f-secret-metrics-server-tls\") pod \"metrics-server-667dc4fbfd-njv4v\" (UID: \"e4b0b454-1a46-4e71-9b66-f375be6de58f\") " pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:31:40.433608 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.433518    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e4b0b454-1a46-4e71-9b66-f375be6de58f-secret-metrics-server-client-certs\") pod \"metrics-server-667dc4fbfd-njv4v\" (UID: \"e4b0b454-1a46-4e71-9b66-f375be6de58f\") " pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:31:40.433608 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.433565    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4b0b454-1a46-4e71-9b66-f375be6de58f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-667dc4fbfd-njv4v\" (UID: \"e4b0b454-1a46-4e71-9b66-f375be6de58f\") " pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:31:40.433751 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.433607    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e4b0b454-1a46-4e71-9b66-f375be6de58f-audit-log\") pod \"metrics-server-667dc4fbfd-njv4v\" (UID: \"e4b0b454-1a46-4e71-9b66-f375be6de58f\") " pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:31:40.433901 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.433710    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf2tm\" (UniqueName: \"kubernetes.io/projected/e4b0b454-1a46-4e71-9b66-f375be6de58f-kube-api-access-jf2tm\") pod \"metrics-server-667dc4fbfd-njv4v\" (UID: \"e4b0b454-1a46-4e71-9b66-f375be6de58f\") " pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:31:40.433901 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.433836    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e4b0b454-1a46-4e71-9b66-f375be6de58f-metrics-server-audit-profiles\") pod \"metrics-server-667dc4fbfd-njv4v\" (UID: \"e4b0b454-1a46-4e71-9b66-f375be6de58f\") " pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:31:40.434015 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.433922    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e4b0b454-1a46-4e71-9b66-f375be6de58f-client-ca-bundle\") pod \"metrics-server-667dc4fbfd-njv4v\" (UID: \"e4b0b454-1a46-4e71-9b66-f375be6de58f\") " pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:31:40.434946 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.434917    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-667dc4fbfd-njv4v"]
Jul 06 01:31:40.534613 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.534578    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e4b0b454-1a46-4e71-9b66-f375be6de58f-secret-metrics-server-client-certs\") pod \"metrics-server-667dc4fbfd-njv4v\" (UID: \"e4b0b454-1a46-4e71-9b66-f375be6de58f\") " pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:31:40.534613 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.534620    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4b0b454-1a46-4e71-9b66-f375be6de58f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-667dc4fbfd-njv4v\" (UID: \"e4b0b454-1a46-4e71-9b66-f375be6de58f\") " pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:31:40.535148 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.534748    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e4b0b454-1a46-4e71-9b66-f375be6de58f-audit-log\") pod \"metrics-server-667dc4fbfd-njv4v\" (UID: \"e4b0b454-1a46-4e71-9b66-f375be6de58f\") " pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:31:40.535148 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.534787    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf2tm\" (UniqueName: \"kubernetes.io/projected/e4b0b454-1a46-4e71-9b66-f375be6de58f-kube-api-access-jf2tm\") pod \"metrics-server-667dc4fbfd-njv4v\" (UID: \"e4b0b454-1a46-4e71-9b66-f375be6de58f\") " pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:31:40.535148 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.534837    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e4b0b454-1a46-4e71-9b66-f375be6de58f-metrics-server-audit-profiles\") pod \"metrics-server-667dc4fbfd-njv4v\" (UID: \"e4b0b454-1a46-4e71-9b66-f375be6de58f\") " pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:31:40.535148 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.534885    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e4b0b454-1a46-4e71-9b66-f375be6de58f-client-ca-bundle\") pod \"metrics-server-667dc4fbfd-njv4v\" (UID: \"e4b0b454-1a46-4e71-9b66-f375be6de58f\") " pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:31:40.535148 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.534962    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e4b0b454-1a46-4e71-9b66-f375be6de58f-secret-metrics-server-tls\") pod \"metrics-server-667dc4fbfd-njv4v\" (UID: \"e4b0b454-1a46-4e71-9b66-f375be6de58f\") " pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:31:40.535712 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.535683    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e4b0b454-1a46-4e71-9b66-f375be6de58f-audit-log\") pod \"metrics-server-667dc4fbfd-njv4v\" (UID: \"e4b0b454-1a46-4e71-9b66-f375be6de58f\") " pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:31:40.537127 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.536881    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4b0b454-1a46-4e71-9b66-f375be6de58f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-667dc4fbfd-njv4v\" (UID: \"e4b0b454-1a46-4e71-9b66-f375be6de58f\") " pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:31:40.537251 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.536955    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e4b0b454-1a46-4e71-9b66-f375be6de58f-metrics-server-audit-profiles\") pod \"metrics-server-667dc4fbfd-njv4v\" (UID: \"e4b0b454-1a46-4e71-9b66-f375be6de58f\") " pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:31:40.542962 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.539262    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e4b0b454-1a46-4e71-9b66-f375be6de58f-secret-metrics-server-client-certs\") pod \"metrics-server-667dc4fbfd-njv4v\" (UID: \"e4b0b454-1a46-4e71-9b66-f375be6de58f\") " pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:31:40.542962 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.539283    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e4b0b454-1a46-4e71-9b66-f375be6de58f-secret-metrics-server-tls\") pod \"metrics-server-667dc4fbfd-njv4v\" (UID: \"e4b0b454-1a46-4e71-9b66-f375be6de58f\") " pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:31:40.543886 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.543850    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e4b0b454-1a46-4e71-9b66-f375be6de58f-client-ca-bundle\") pod \"metrics-server-667dc4fbfd-njv4v\" (UID: \"e4b0b454-1a46-4e71-9b66-f375be6de58f\") " pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:31:40.544107 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.544086    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf2tm\" (UniqueName: \"kubernetes.io/projected/e4b0b454-1a46-4e71-9b66-f375be6de58f-kube-api-access-jf2tm\") pod \"metrics-server-667dc4fbfd-njv4v\" (UID: \"e4b0b454-1a46-4e71-9b66-f375be6de58f\") " pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:31:40.735227 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.735144    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:31:40.895939 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.895908    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-zhlj8"]
Jul 06 01:31:40.900541 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.900512    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zhlj8"
Jul 06 01:31:40.902977 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.902908    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 06 01:31:40.902977 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.902932    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-dn9cc\""
Jul 06 01:31:40.907024 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.906932    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-zhlj8"]
Jul 06 01:31:40.911927 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.910922    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-667dc4fbfd-njv4v"]
Jul 06 01:31:40.937245 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.937208    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/64c1edb3-0fc3-4703-a2f1-a96d8485aefe-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-zhlj8\" (UID: \"64c1edb3-0fc3-4703-a2f1-a96d8485aefe\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zhlj8"
Jul 06 01:31:40.937434 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:40.937362    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6knps\" (UniqueName: \"kubernetes.io/projected/64c1edb3-0fc3-4703-a2f1-a96d8485aefe-kube-api-access-6knps\") pod \"monitoring-plugin-d5dcff7cf-zhlj8\" (UID: \"64c1edb3-0fc3-4703-a2f1-a96d8485aefe\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zhlj8"
Jul 06 01:31:41.038369 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:41.038281    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6knps\" (UniqueName: \"kubernetes.io/projected/64c1edb3-0fc3-4703-a2f1-a96d8485aefe-kube-api-access-6knps\") pod \"monitoring-plugin-d5dcff7cf-zhlj8\" (UID: \"64c1edb3-0fc3-4703-a2f1-a96d8485aefe\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zhlj8"
Jul 06 01:31:41.038552 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:41.038471    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/64c1edb3-0fc3-4703-a2f1-a96d8485aefe-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-zhlj8\" (UID: \"64c1edb3-0fc3-4703-a2f1-a96d8485aefe\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zhlj8"
Jul 06 01:31:41.038668 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:31:41.038635    2584 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 06 01:31:41.038729 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:31:41.038712    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64c1edb3-0fc3-4703-a2f1-a96d8485aefe-monitoring-plugin-cert podName:64c1edb3-0fc3-4703-a2f1-a96d8485aefe nodeName:}" failed. No retries permitted until 2026-07-06 01:31:41.538690524 +0000 UTC m=+309.780458373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/64c1edb3-0fc3-4703-a2f1-a96d8485aefe-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-zhlj8" (UID: "64c1edb3-0fc3-4703-a2f1-a96d8485aefe") : secret "monitoring-plugin-cert" not found
Jul 06 01:31:41.054858 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:41.054823    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6knps\" (UniqueName: \"kubernetes.io/projected/64c1edb3-0fc3-4703-a2f1-a96d8485aefe-kube-api-access-6knps\") pod \"monitoring-plugin-d5dcff7cf-zhlj8\" (UID: \"64c1edb3-0fc3-4703-a2f1-a96d8485aefe\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zhlj8"
Jul 06 01:31:41.196747 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:31:41.196715    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4b0b454_1a46_4e71_9b66_f375be6de58f.slice/crio-20845abe30cedb07c9deb0b23c53fa2419728c054cfeb9ad7652e34c8981cc52 WatchSource:0}: Error finding container 20845abe30cedb07c9deb0b23c53fa2419728c054cfeb9ad7652e34c8981cc52: Status 404 returned error can't find the container with id 20845abe30cedb07c9deb0b23c53fa2419728c054cfeb9ad7652e34c8981cc52
Jul 06 01:31:41.542924 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:41.542846    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/64c1edb3-0fc3-4703-a2f1-a96d8485aefe-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-zhlj8\" (UID: \"64c1edb3-0fc3-4703-a2f1-a96d8485aefe\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zhlj8"
Jul 06 01:31:41.545228 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:41.545198    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/64c1edb3-0fc3-4703-a2f1-a96d8485aefe-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-zhlj8\" (UID: \"64c1edb3-0fc3-4703-a2f1-a96d8485aefe\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zhlj8"
Jul 06 01:31:41.553396 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:41.553362    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1d067bc0-b4ef-43c0-844a-93a32d30f011","Type":"ContainerStarted","Data":"deefec8989131a74033dc74e6db16beceb7aa7657506889273c96e7b720758ca"}
Jul 06 01:31:41.553541 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:41.553443    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1d067bc0-b4ef-43c0-844a-93a32d30f011","Type":"ContainerStarted","Data":"fceabde13818749afc0b3808d2c4ede65677582c573e630458aaea282129324a"}
Jul 06 01:31:41.553541 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:41.553471    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1d067bc0-b4ef-43c0-844a-93a32d30f011","Type":"ContainerStarted","Data":"86c63a3bcbad4f91fb798cc6bfe36d36b07cc3a6c77ada9121caf2d386bc497a"}
Jul 06 01:31:41.553541 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:41.553495    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1d067bc0-b4ef-43c0-844a-93a32d30f011","Type":"ContainerStarted","Data":"c9bca079a67a245838ffc58a0470df297573392b8821f2e8a818c66b79dfc3d5"}
Jul 06 01:31:41.554658 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:41.554616    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v" event={"ID":"e4b0b454-1a46-4e71-9b66-f375be6de58f","Type":"ContainerStarted","Data":"20845abe30cedb07c9deb0b23c53fa2419728c054cfeb9ad7652e34c8981cc52"}
Jul 06 01:31:41.609672 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:41.609619    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:31:41.814877 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:41.814786    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zhlj8"
Jul 06 01:31:41.963722 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:41.963569    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-zhlj8"]
Jul 06 01:31:41.967093 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:31:41.967061    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64c1edb3_0fc3_4703_a2f1_a96d8485aefe.slice/crio-9e4bca9b51ed02a2698e8fa32e8e88402174f8479a3d99b6d44febf6e11e91ad WatchSource:0}: Error finding container 9e4bca9b51ed02a2698e8fa32e8e88402174f8479a3d99b6d44febf6e11e91ad: Status 404 returned error can't find the container with id 9e4bca9b51ed02a2698e8fa32e8e88402174f8479a3d99b6d44febf6e11e91ad
Jul 06 01:31:42.349873 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.349842    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 01:31:42.358092 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.358058    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.362723 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.362376    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 06 01:31:42.362723 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.362457    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 06 01:31:42.362723 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.362400    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 06 01:31:42.362723 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.362528    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 06 01:31:42.362723 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.362460    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 06 01:31:42.362723 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.362690    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-w6bfr\""
Jul 06 01:31:42.363115 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.362915    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 06 01:31:42.363115 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.362929    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 06 01:31:42.364131 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.364088    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9rptnheuuhr20\""
Jul 06 01:31:42.364723 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.364492    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 06 01:31:42.364723 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.364701    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 06 01:31:42.364875 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.364703    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 06 01:31:42.365480 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.365460    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 06 01:31:42.365579 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.365535    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 06 01:31:42.367201 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.367024    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 06 01:31:42.371795 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.369861    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 06 01:31:42.373875 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.373841    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 01:31:42.450530 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.450488    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.450779 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.450761    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.450884 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.450869    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-config\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.450971 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.450960    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-config-out\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.451090 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.451075    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.451189 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.451174    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.451277 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.451263    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.451389 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.451369    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.451571 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.451554    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.451790 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.451757    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-web-config\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.451901 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.451794    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.451901 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.451834    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.451901 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.451863    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcdck\" (UniqueName: \"kubernetes.io/projected/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-kube-api-access-lcdck\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.451901 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.451895    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.452108 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.451993    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.452108 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.452025    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.452108 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.452043    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.452108 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.452062    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.452304 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.452128    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.452304 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.452192    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.552761 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.552716    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.553239 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.552766    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.553239 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.552803    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-config\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.553239 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.552830    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-config-out\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.553239 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.552902    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.553239 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.552927    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.553239 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.552958    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.553239 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.553016    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.553239 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.553046    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.553239 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.553070    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-web-config\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.553239 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.553095    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.553239 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.553137    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.553239 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.553164    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcdck\" (UniqueName: \"kubernetes.io/projected/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-kube-api-access-lcdck\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.553239 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.553192    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.553239 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.553228    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.553971 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.553253    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.553971 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.553281    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.553971 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.553314    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.553971 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.553339    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.553971 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.553364    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.558681 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.558297    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.565384 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.559464    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.566422 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.566269    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.566764 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.566742    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.567013 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.566987    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-config\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.569320 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.567479    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.569320 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.567989    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.569320 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.568612    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.570129 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.570103    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.573345 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.572250    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.573345 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.572996    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.573954 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.573928    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.575732 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.575246    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.576404 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.576325    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcdck\" (UniqueName: \"kubernetes.io/projected/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-kube-api-access-lcdck\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.576404 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.576349    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-web-config\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.576547 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.576473    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.577132 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.577112    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.578581 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.578551    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-config-out\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.582870 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.580831    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.582870 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.582048    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:42.592616 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.592579    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1d067bc0-b4ef-43c0-844a-93a32d30f011","Type":"ContainerStarted","Data":"df07a2a0d3c08fb0d0af6034d790b3e3756b3ee8c2297da1ebaaa33e12253a49"}
Jul 06 01:31:42.594613 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.594574    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zhlj8" event={"ID":"64c1edb3-0fc3-4703-a2f1-a96d8485aefe","Type":"ContainerStarted","Data":"9e4bca9b51ed02a2698e8fa32e8e88402174f8479a3d99b6d44febf6e11e91ad"}
Jul 06 01:31:42.676003 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:42.675912    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:31:43.193142 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:43.193115    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 01:31:43.194140 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:31:43.194110    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d2e805c_f53d_4dcb_a1f1_2050f5da56f7.slice/crio-3ff68f44cfa9ded7d3ff0e4af571a5d1c5e22cb1ec23c3e400ee944794602607 WatchSource:0}: Error finding container 3ff68f44cfa9ded7d3ff0e4af571a5d1c5e22cb1ec23c3e400ee944794602607: Status 404 returned error can't find the container with id 3ff68f44cfa9ded7d3ff0e4af571a5d1c5e22cb1ec23c3e400ee944794602607
Jul 06 01:31:43.604147 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:43.604097    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1d067bc0-b4ef-43c0-844a-93a32d30f011","Type":"ContainerStarted","Data":"6501ca8f3ad5d4d88e716f729b874f5389801a226386f15143386d157efc89af"}
Jul 06 01:31:43.607090 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:43.606774    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v" event={"ID":"e4b0b454-1a46-4e71-9b66-f375be6de58f","Type":"ContainerStarted","Data":"c3092c11e22df4d383e84b53326aa3e931cf43c780f2f05ba202d21bba89716b"}
Jul 06 01:31:43.608851 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:43.608809    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7","Type":"ContainerDied","Data":"9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4"}
Jul 06 01:31:43.609008 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:43.608811    2584 generic.go:356] "Generic (PLEG): container finished" podID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerID="9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4" exitCode=0
Jul 06 01:31:43.609008 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:43.608961    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7","Type":"ContainerStarted","Data":"3ff68f44cfa9ded7d3ff0e4af571a5d1c5e22cb1ec23c3e400ee944794602607"}
Jul 06 01:31:43.637450 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:43.637378    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.12283616 podStartE2EDuration="6.637360227s" totalImagesPullingTime="4.495803008s" totalInitContainerRuntime="18.721059ms" isStatefulPod=false podCreationTimestamp="2026-07-06 01:31:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:31:43.635563896 +0000 UTC m=+311.877331789" watchObservedRunningTime="2026-07-06 01:31:43.637360227 +0000 UTC m=+311.879128093"
Jul 06 01:31:43.658782 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:43.658716    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v" podStartSLOduration=1.8387018469999998 podStartE2EDuration="3.658698698s" totalImagesPullingTime="1.819996851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:31:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:31:43.657076128 +0000 UTC m=+311.898843996" watchObservedRunningTime="2026-07-06 01:31:43.658698698 +0000 UTC m=+311.900466565"
Jul 06 01:31:44.616654 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:44.616573    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zhlj8" event={"ID":"64c1edb3-0fc3-4703-a2f1-a96d8485aefe","Type":"ContainerStarted","Data":"26fd075fc76341b9d14ffea81a12827d6e3b450c1b47147b04d942471ea1adcf"}
Jul 06 01:31:44.617147 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:44.616770    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zhlj8"
Jul 06 01:31:44.622951 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:44.622916    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zhlj8"
Jul 06 01:31:44.644224 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:44.644092    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zhlj8" podStartSLOduration=2.731752809 podStartE2EDuration="4.644071731s" totalImagesPullingTime="1.912318922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:31:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:31:44.64341596 +0000 UTC m=+312.885183827" watchObservedRunningTime="2026-07-06 01:31:44.644071731 +0000 UTC m=+312.885839602"
Jul 06 01:31:46.462346 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:46.462310    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69788b8597-tt6ch"]
Jul 06 01:31:47.635860 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:47.635729    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7","Type":"ContainerStarted","Data":"07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9"}
Jul 06 01:31:47.635860 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:47.635836    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7","Type":"ContainerStarted","Data":"d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910"}
Jul 06 01:31:50.654699 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:50.654653    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7","Type":"ContainerStarted","Data":"562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347"}
Jul 06 01:31:50.655121 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:50.654727    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7","Type":"ContainerStarted","Data":"a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b"}
Jul 06 01:31:50.655121 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:50.654758    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7","Type":"ContainerStarted","Data":"154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95"}
Jul 06 01:31:50.655121 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:50.654782    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7","Type":"ContainerStarted","Data":"1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272"}
Jul 06 01:31:50.682641 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:50.682580    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.842728263 podStartE2EDuration="8.68255929s" totalImagesPullingTime="5.816924081s" totalInitContainerRuntime="22.906946ms" isStatefulPod=false podCreationTimestamp="2026-07-06 01:31:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:31:50.680146751 +0000 UTC m=+318.921914618" watchObservedRunningTime="2026-07-06 01:31:50.68255929 +0000 UTC m=+318.924327156"
Jul 06 01:31:52.676576 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:31:52.676535    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:32:00.736250 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:00.736216    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:32:00.736607 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:00.736278    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:32:11.490649 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.490563    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-69788b8597-tt6ch" podUID="91217fbf-2d05-4fea-a848-ce72d151cd49" containerName="registry" containerID="cri-o://1ae57045a3d329a8763c17b8dbf4792e1237fa0200869038bcd9ec67279384f5" gracePeriod=30
Jul 06 01:32:11.744849 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.744774    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:32:11.745250 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.745229    2584 generic.go:356] "Generic (PLEG): container finished" podID="91217fbf-2d05-4fea-a848-ce72d151cd49" containerID="1ae57045a3d329a8763c17b8dbf4792e1237fa0200869038bcd9ec67279384f5" exitCode=0
Jul 06 01:32:11.745329 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.745304    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69788b8597-tt6ch" event={"ID":"91217fbf-2d05-4fea-a848-ce72d151cd49","Type":"ContainerDied","Data":"1ae57045a3d329a8763c17b8dbf4792e1237fa0200869038bcd9ec67279384f5"}
Jul 06 01:32:11.745370 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.745363    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69788b8597-tt6ch" event={"ID":"91217fbf-2d05-4fea-a848-ce72d151cd49","Type":"ContainerDied","Data":"d64b3900343b150782f54aa2113cf2404ed43372bdb9c01f372696729bc4876a"}
Jul 06 01:32:11.745406 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.745384    2584 scope.go:117] "RemoveContainer" containerID="1ae57045a3d329a8763c17b8dbf4792e1237fa0200869038bcd9ec67279384f5"
Jul 06 01:32:11.753926 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.753905    2584 scope.go:117] "RemoveContainer" containerID="1ae57045a3d329a8763c17b8dbf4792e1237fa0200869038bcd9ec67279384f5"
Jul 06 01:32:11.754290 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:32:11.754264    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ae57045a3d329a8763c17b8dbf4792e1237fa0200869038bcd9ec67279384f5\": container with ID starting with 1ae57045a3d329a8763c17b8dbf4792e1237fa0200869038bcd9ec67279384f5 not found: ID does not exist" containerID="1ae57045a3d329a8763c17b8dbf4792e1237fa0200869038bcd9ec67279384f5"
Jul 06 01:32:11.754351 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.754303    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ae57045a3d329a8763c17b8dbf4792e1237fa0200869038bcd9ec67279384f5"} err="failed to get container status \"1ae57045a3d329a8763c17b8dbf4792e1237fa0200869038bcd9ec67279384f5\": rpc error: code = NotFound desc = could not find container \"1ae57045a3d329a8763c17b8dbf4792e1237fa0200869038bcd9ec67279384f5\": container with ID starting with 1ae57045a3d329a8763c17b8dbf4792e1237fa0200869038bcd9ec67279384f5 not found: ID does not exist"
Jul 06 01:32:11.840067 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.840026    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xr5mz\" (UniqueName: \"kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-kube-api-access-xr5mz\") pod \"91217fbf-2d05-4fea-a848-ce72d151cd49\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") "
Jul 06 01:32:11.840067 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.840076    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91217fbf-2d05-4fea-a848-ce72d151cd49-trusted-ca\") pod \"91217fbf-2d05-4fea-a848-ce72d151cd49\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") "
Jul 06 01:32:11.840296 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.840108    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-certificates\") pod \"91217fbf-2d05-4fea-a848-ce72d151cd49\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") "
Jul 06 01:32:11.840296 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.840130    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls\") pod \"91217fbf-2d05-4fea-a848-ce72d151cd49\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") "
Jul 06 01:32:11.840296 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.840244    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91217fbf-2d05-4fea-a848-ce72d151cd49-ca-trust-extracted\") pod \"91217fbf-2d05-4fea-a848-ce72d151cd49\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") "
Jul 06 01:32:11.840433 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.840301    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91217fbf-2d05-4fea-a848-ce72d151cd49-image-registry-private-configuration\") pod \"91217fbf-2d05-4fea-a848-ce72d151cd49\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") "
Jul 06 01:32:11.840433 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.840350    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-bound-sa-token\") pod \"91217fbf-2d05-4fea-a848-ce72d151cd49\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") "
Jul 06 01:32:11.840433 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.840380    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91217fbf-2d05-4fea-a848-ce72d151cd49-installation-pull-secrets\") pod \"91217fbf-2d05-4fea-a848-ce72d151cd49\" (UID: \"91217fbf-2d05-4fea-a848-ce72d151cd49\") "
Jul 06 01:32:11.840904 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.840665    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "91217fbf-2d05-4fea-a848-ce72d151cd49" (UID: "91217fbf-2d05-4fea-a848-ce72d151cd49"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:32:11.840904 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.840560    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91217fbf-2d05-4fea-a848-ce72d151cd49-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "91217fbf-2d05-4fea-a848-ce72d151cd49" (UID: "91217fbf-2d05-4fea-a848-ce72d151cd49"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:32:11.843215 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.843146    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91217fbf-2d05-4fea-a848-ce72d151cd49-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "91217fbf-2d05-4fea-a848-ce72d151cd49" (UID: "91217fbf-2d05-4fea-a848-ce72d151cd49"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:32:11.843215 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.843193    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91217fbf-2d05-4fea-a848-ce72d151cd49-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "91217fbf-2d05-4fea-a848-ce72d151cd49" (UID: "91217fbf-2d05-4fea-a848-ce72d151cd49"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:32:11.843215 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.843197    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "91217fbf-2d05-4fea-a848-ce72d151cd49" (UID: "91217fbf-2d05-4fea-a848-ce72d151cd49"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:32:11.843454 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.843191    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-kube-api-access-xr5mz" (OuterVolumeSpecName: "kube-api-access-xr5mz") pod "91217fbf-2d05-4fea-a848-ce72d151cd49" (UID: "91217fbf-2d05-4fea-a848-ce72d151cd49"). InnerVolumeSpecName "kube-api-access-xr5mz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:32:11.843454 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.843322    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "91217fbf-2d05-4fea-a848-ce72d151cd49" (UID: "91217fbf-2d05-4fea-a848-ce72d151cd49"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:32:11.851911 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.851865    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91217fbf-2d05-4fea-a848-ce72d151cd49-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "91217fbf-2d05-4fea-a848-ce72d151cd49" (UID: "91217fbf-2d05-4fea-a848-ce72d151cd49"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:32:11.942033 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.941986    2584 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91217fbf-2d05-4fea-a848-ce72d151cd49-ca-trust-extracted\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:32:11.942033 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.942023    2584 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91217fbf-2d05-4fea-a848-ce72d151cd49-image-registry-private-configuration\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:32:11.942033 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.942035    2584 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-bound-sa-token\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:32:11.942033 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.942044    2584 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91217fbf-2d05-4fea-a848-ce72d151cd49-installation-pull-secrets\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:32:11.942305 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.942053    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xr5mz\" (UniqueName: \"kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-kube-api-access-xr5mz\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:32:11.942305 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.942062    2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91217fbf-2d05-4fea-a848-ce72d151cd49-trusted-ca\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:32:11.942305 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.942070    2584 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-certificates\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:32:11.942305 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:11.942077    2584 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91217fbf-2d05-4fea-a848-ce72d151cd49-registry-tls\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:32:12.750929 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:12.750899    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69788b8597-tt6ch"
Jul 06 01:32:12.769303 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:12.769268    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69788b8597-tt6ch"]
Jul 06 01:32:12.773961 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:12.773929    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-69788b8597-tt6ch"]
Jul 06 01:32:13.757116 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:13.757073    2584 generic.go:356] "Generic (PLEG): container finished" podID="5b959825-a5f6-42c8-b8fa-c1228e63563b" containerID="8609285782e8e2cdfeb23999d1ef8988a2faacad6dc56899fcd9f2b7bc68a975" exitCode=0
Jul 06 01:32:13.757610 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:13.757154    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-msdjx" event={"ID":"5b959825-a5f6-42c8-b8fa-c1228e63563b","Type":"ContainerDied","Data":"8609285782e8e2cdfeb23999d1ef8988a2faacad6dc56899fcd9f2b7bc68a975"}
Jul 06 01:32:13.757610 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:13.757598    2584 scope.go:117] "RemoveContainer" containerID="8609285782e8e2cdfeb23999d1ef8988a2faacad6dc56899fcd9f2b7bc68a975"
Jul 06 01:32:14.614712 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:14.614679    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91217fbf-2d05-4fea-a848-ce72d151cd49" path="/var/lib/kubelet/pods/91217fbf-2d05-4fea-a848-ce72d151cd49/volumes"
Jul 06 01:32:14.763028 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:14.762992    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-msdjx" event={"ID":"5b959825-a5f6-42c8-b8fa-c1228e63563b","Type":"ContainerStarted","Data":"dd2c90841f6e250543e2beec672df41991a61ff99e716f52eaccc5eb84cb799f"}
Jul 06 01:32:20.742089 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:20.742057    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:32:20.746584 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:20.746553    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-667dc4fbfd-njv4v"
Jul 06 01:32:33.847473 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:33.847438    2584 generic.go:356] "Generic (PLEG): container finished" podID="7a7e13be-4e2d-4ee6-838a-4507db79883a" containerID="484e28bf3469667d13ceb15743930d3f0bc75bf2052d450cee9a40484d159e3a" exitCode=0
Jul 06 01:32:33.847911 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:33.847509    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nm48x" event={"ID":"7a7e13be-4e2d-4ee6-838a-4507db79883a","Type":"ContainerDied","Data":"484e28bf3469667d13ceb15743930d3f0bc75bf2052d450cee9a40484d159e3a"}
Jul 06 01:32:33.847911 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:33.847853    2584 scope.go:117] "RemoveContainer" containerID="484e28bf3469667d13ceb15743930d3f0bc75bf2052d450cee9a40484d159e3a"
Jul 06 01:32:34.853902 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:34.853866    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nm48x" event={"ID":"7a7e13be-4e2d-4ee6-838a-4507db79883a","Type":"ContainerStarted","Data":"c398f49dff80a39addeb0878157cbe030267487b680840b8a1b43e65f8243c76"}
Jul 06 01:32:42.676982 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:42.676927    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:32:42.696202 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:42.696171    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:32:42.901674 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:42.901644    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:32:46.241124 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:46.241075    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs\") pod \"network-metrics-daemon-7fkg2\" (UID: \"d05d6ef9-2d73-4ab9-b875-7d121bd89c4d\") " pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:32:46.243640 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:46.243598    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d05d6ef9-2d73-4ab9-b875-7d121bd89c4d-metrics-certs\") pod \"network-metrics-daemon-7fkg2\" (UID: \"d05d6ef9-2d73-4ab9-b875-7d121bd89c4d\") " pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:32:46.413268 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:46.413232    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qszpf\""
Jul 06 01:32:46.421379 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:46.421336    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fkg2"
Jul 06 01:32:46.557672 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:46.557642    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7fkg2"]
Jul 06 01:32:46.560200 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:32:46.560166    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd05d6ef9_2d73_4ab9_b875_7d121bd89c4d.slice/crio-47ef5f52c605d40b7b2d298ca97105dca7ace5748656bdc7aa959acb6cf76baf WatchSource:0}: Error finding container 47ef5f52c605d40b7b2d298ca97105dca7ace5748656bdc7aa959acb6cf76baf: Status 404 returned error can't find the container with id 47ef5f52c605d40b7b2d298ca97105dca7ace5748656bdc7aa959acb6cf76baf
Jul 06 01:32:46.904156 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:46.904119    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7fkg2" event={"ID":"d05d6ef9-2d73-4ab9-b875-7d121bd89c4d","Type":"ContainerStarted","Data":"47ef5f52c605d40b7b2d298ca97105dca7ace5748656bdc7aa959acb6cf76baf"}
Jul 06 01:32:47.911432 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:47.911401    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7fkg2" event={"ID":"d05d6ef9-2d73-4ab9-b875-7d121bd89c4d","Type":"ContainerStarted","Data":"d5a77c8915aabb0352c0bb3233ae1d31e4a01469f5cc1d8d32bb5ab47effcb30"}
Jul 06 01:32:48.917272 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:48.917230    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7fkg2" event={"ID":"d05d6ef9-2d73-4ab9-b875-7d121bd89c4d","Type":"ContainerStarted","Data":"b6a52ce32e286149b187155e2a56edeccfe81f684857c09965160b4180133589"}
Jul 06 01:32:48.934963 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:48.934900    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7fkg2" podStartSLOduration=375.730522052 podStartE2EDuration="6m16.934878907s" totalImagesPullingTime="1.204356855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:32:48.934688488 +0000 UTC m=+377.176456359" watchObservedRunningTime="2026-07-06 01:32:48.934878907 +0000 UTC m=+377.176646777"
Jul 06 01:32:56.424913 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:56.424875    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 01:32:56.425316 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:56.425176    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="alertmanager" containerID="cri-o://c9bca079a67a245838ffc58a0470df297573392b8821f2e8a818c66b79dfc3d5" gracePeriod=120
Jul 06 01:32:56.425316 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:56.425230    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="kube-rbac-proxy-metric" containerID="cri-o://df07a2a0d3c08fb0d0af6034d790b3e3756b3ee8c2297da1ebaaa33e12253a49" gracePeriod=120
Jul 06 01:32:56.425316 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:56.425265    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="kube-rbac-proxy-web" containerID="cri-o://fceabde13818749afc0b3808d2c4ede65677582c573e630458aaea282129324a" gracePeriod=120
Jul 06 01:32:56.425316 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:56.425278    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="config-reloader" containerID="cri-o://86c63a3bcbad4f91fb798cc6bfe36d36b07cc3a6c77ada9121caf2d386bc497a" gracePeriod=120
Jul 06 01:32:56.425509 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:56.425330    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="prom-label-proxy" containerID="cri-o://6501ca8f3ad5d4d88e716f729b874f5389801a226386f15143386d157efc89af" gracePeriod=120
Jul 06 01:32:56.425509 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:56.425359    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="kube-rbac-proxy" containerID="cri-o://deefec8989131a74033dc74e6db16beceb7aa7657506889273c96e7b720758ca" gracePeriod=120
Jul 06 01:32:56.958730 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:56.958697    2584 generic.go:356] "Generic (PLEG): container finished" podID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerID="6501ca8f3ad5d4d88e716f729b874f5389801a226386f15143386d157efc89af" exitCode=0
Jul 06 01:32:56.958730 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:56.958721    2584 generic.go:356] "Generic (PLEG): container finished" podID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerID="deefec8989131a74033dc74e6db16beceb7aa7657506889273c96e7b720758ca" exitCode=0
Jul 06 01:32:56.958730 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:56.958728    2584 generic.go:356] "Generic (PLEG): container finished" podID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerID="86c63a3bcbad4f91fb798cc6bfe36d36b07cc3a6c77ada9121caf2d386bc497a" exitCode=0
Jul 06 01:32:56.958730 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:56.958734    2584 generic.go:356] "Generic (PLEG): container finished" podID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerID="c9bca079a67a245838ffc58a0470df297573392b8821f2e8a818c66b79dfc3d5" exitCode=0
Jul 06 01:32:56.958992 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:56.958769    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1d067bc0-b4ef-43c0-844a-93a32d30f011","Type":"ContainerDied","Data":"6501ca8f3ad5d4d88e716f729b874f5389801a226386f15143386d157efc89af"}
Jul 06 01:32:56.958992 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:56.958833    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1d067bc0-b4ef-43c0-844a-93a32d30f011","Type":"ContainerDied","Data":"deefec8989131a74033dc74e6db16beceb7aa7657506889273c96e7b720758ca"}
Jul 06 01:32:56.958992 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:56.958861    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1d067bc0-b4ef-43c0-844a-93a32d30f011","Type":"ContainerDied","Data":"86c63a3bcbad4f91fb798cc6bfe36d36b07cc3a6c77ada9121caf2d386bc497a"}
Jul 06 01:32:56.958992 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:56.958887    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1d067bc0-b4ef-43c0-844a-93a32d30f011","Type":"ContainerDied","Data":"c9bca079a67a245838ffc58a0470df297573392b8821f2e8a818c66b79dfc3d5"}
Jul 06 01:32:57.687961 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.687936    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:32:57.842441 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.842414    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-web-config\") pod \"1d067bc0-b4ef-43c0-844a-93a32d30f011\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") "
Jul 06 01:32:57.842593 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.842460    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1d067bc0-b4ef-43c0-844a-93a32d30f011-alertmanager-main-db\") pod \"1d067bc0-b4ef-43c0-844a-93a32d30f011\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") "
Jul 06 01:32:57.842593 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.842493    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1d067bc0-b4ef-43c0-844a-93a32d30f011-tls-assets\") pod \"1d067bc0-b4ef-43c0-844a-93a32d30f011\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") "
Jul 06 01:32:57.842593 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.842524    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1d067bc0-b4ef-43c0-844a-93a32d30f011-config-out\") pod \"1d067bc0-b4ef-43c0-844a-93a32d30f011\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") "
Jul 06 01:32:57.842593 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.842570    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-secret-alertmanager-kube-rbac-proxy-web\") pod \"1d067bc0-b4ef-43c0-844a-93a32d30f011\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") "
Jul 06 01:32:57.842807 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.842598    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-cluster-tls-config\") pod \"1d067bc0-b4ef-43c0-844a-93a32d30f011\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") "
Jul 06 01:32:57.842807 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.842663    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-config-volume\") pod \"1d067bc0-b4ef-43c0-844a-93a32d30f011\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") "
Jul 06 01:32:57.842807 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.842700    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-secret-alertmanager-main-tls\") pod \"1d067bc0-b4ef-43c0-844a-93a32d30f011\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") "
Jul 06 01:32:57.842807 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.842733    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d067bc0-b4ef-43c0-844a-93a32d30f011-alertmanager-trusted-ca-bundle\") pod \"1d067bc0-b4ef-43c0-844a-93a32d30f011\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") "
Jul 06 01:32:57.842807 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.842784    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-secret-alertmanager-kube-rbac-proxy-metric\") pod \"1d067bc0-b4ef-43c0-844a-93a32d30f011\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") "
Jul 06 01:32:57.843054 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.842819    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-secret-alertmanager-kube-rbac-proxy\") pod \"1d067bc0-b4ef-43c0-844a-93a32d30f011\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") "
Jul 06 01:32:57.843054 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.842826    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d067bc0-b4ef-43c0-844a-93a32d30f011-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "1d067bc0-b4ef-43c0-844a-93a32d30f011" (UID: "1d067bc0-b4ef-43c0-844a-93a32d30f011"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:32:57.843054 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.842848    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d067bc0-b4ef-43c0-844a-93a32d30f011-metrics-client-ca\") pod \"1d067bc0-b4ef-43c0-844a-93a32d30f011\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") "
Jul 06 01:32:57.843054 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.842891    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qgwn\" (UniqueName: \"kubernetes.io/projected/1d067bc0-b4ef-43c0-844a-93a32d30f011-kube-api-access-2qgwn\") pod \"1d067bc0-b4ef-43c0-844a-93a32d30f011\" (UID: \"1d067bc0-b4ef-43c0-844a-93a32d30f011\") "
Jul 06 01:32:57.843253 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.843155    2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1d067bc0-b4ef-43c0-844a-93a32d30f011-alertmanager-main-db\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:32:57.843253 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.843232    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d067bc0-b4ef-43c0-844a-93a32d30f011-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "1d067bc0-b4ef-43c0-844a-93a32d30f011" (UID: "1d067bc0-b4ef-43c0-844a-93a32d30f011"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:32:57.843864 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.843833    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d067bc0-b4ef-43c0-844a-93a32d30f011-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "1d067bc0-b4ef-43c0-844a-93a32d30f011" (UID: "1d067bc0-b4ef-43c0-844a-93a32d30f011"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:32:57.846263 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.846030    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d067bc0-b4ef-43c0-844a-93a32d30f011-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1d067bc0-b4ef-43c0-844a-93a32d30f011" (UID: "1d067bc0-b4ef-43c0-844a-93a32d30f011"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:32:57.846263 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.846142    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-config-volume" (OuterVolumeSpecName: "config-volume") pod "1d067bc0-b4ef-43c0-844a-93a32d30f011" (UID: "1d067bc0-b4ef-43c0-844a-93a32d30f011"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:32:57.846571 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.846531    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "1d067bc0-b4ef-43c0-844a-93a32d30f011" (UID: "1d067bc0-b4ef-43c0-844a-93a32d30f011"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:32:57.846571 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.846549    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d067bc0-b4ef-43c0-844a-93a32d30f011-kube-api-access-2qgwn" (OuterVolumeSpecName: "kube-api-access-2qgwn") pod "1d067bc0-b4ef-43c0-844a-93a32d30f011" (UID: "1d067bc0-b4ef-43c0-844a-93a32d30f011"). InnerVolumeSpecName "kube-api-access-2qgwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:32:57.846571 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.846545    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "1d067bc0-b4ef-43c0-844a-93a32d30f011" (UID: "1d067bc0-b4ef-43c0-844a-93a32d30f011"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:32:57.846924 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.846893    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "1d067bc0-b4ef-43c0-844a-93a32d30f011" (UID: "1d067bc0-b4ef-43c0-844a-93a32d30f011"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:32:57.847213 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.847186    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d067bc0-b4ef-43c0-844a-93a32d30f011-config-out" (OuterVolumeSpecName: "config-out") pod "1d067bc0-b4ef-43c0-844a-93a32d30f011" (UID: "1d067bc0-b4ef-43c0-844a-93a32d30f011"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:32:57.847313 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.847254    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "1d067bc0-b4ef-43c0-844a-93a32d30f011" (UID: "1d067bc0-b4ef-43c0-844a-93a32d30f011"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:32:57.851328 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.851310    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "1d067bc0-b4ef-43c0-844a-93a32d30f011" (UID: "1d067bc0-b4ef-43c0-844a-93a32d30f011"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:32:57.857595 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.857565    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-web-config" (OuterVolumeSpecName: "web-config") pod "1d067bc0-b4ef-43c0-844a-93a32d30f011" (UID: "1d067bc0-b4ef-43c0-844a-93a32d30f011"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:32:57.943730 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.943686    2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d067bc0-b4ef-43c0-844a-93a32d30f011-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:32:57.943730 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.943722    2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:32:57.943730 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.943733    2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:32:57.943730 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.943743    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d067bc0-b4ef-43c0-844a-93a32d30f011-metrics-client-ca\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:32:57.944003 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.943752    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qgwn\" (UniqueName: \"kubernetes.io/projected/1d067bc0-b4ef-43c0-844a-93a32d30f011-kube-api-access-2qgwn\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:32:57.944003 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.943784    2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-web-config\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:32:57.944003 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.943799    2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1d067bc0-b4ef-43c0-844a-93a32d30f011-tls-assets\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:32:57.944003 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.943809    2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1d067bc0-b4ef-43c0-844a-93a32d30f011-config-out\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:32:57.944003 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.943826    2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:32:57.944003 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.943835    2584 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-cluster-tls-config\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:32:57.944003 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.943844    2584 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-config-volume\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:32:57.944003 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.943853    2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1d067bc0-b4ef-43c0-844a-93a32d30f011-secret-alertmanager-main-tls\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:32:57.966889 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.966856    2584 generic.go:356] "Generic (PLEG): container finished" podID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerID="df07a2a0d3c08fb0d0af6034d790b3e3756b3ee8c2297da1ebaaa33e12253a49" exitCode=0
Jul 06 01:32:57.966889 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.966881    2584 generic.go:356] "Generic (PLEG): container finished" podID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerID="fceabde13818749afc0b3808d2c4ede65677582c573e630458aaea282129324a" exitCode=0
Jul 06 01:32:57.967144 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.966937    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:32:57.967144 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.966944    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1d067bc0-b4ef-43c0-844a-93a32d30f011","Type":"ContainerDied","Data":"df07a2a0d3c08fb0d0af6034d790b3e3756b3ee8c2297da1ebaaa33e12253a49"}
Jul 06 01:32:57.967144 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.967066    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1d067bc0-b4ef-43c0-844a-93a32d30f011","Type":"ContainerDied","Data":"fceabde13818749afc0b3808d2c4ede65677582c573e630458aaea282129324a"}
Jul 06 01:32:57.967144 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.967110    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1d067bc0-b4ef-43c0-844a-93a32d30f011","Type":"ContainerDied","Data":"8a4b859a5f7a1321facd3cfdf58cb980ead55e71cdd4241e3a19dc8c50772cc3"}
Jul 06 01:32:57.967144 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.967127    2584 scope.go:117] "RemoveContainer" containerID="6501ca8f3ad5d4d88e716f729b874f5389801a226386f15143386d157efc89af"
Jul 06 01:32:57.975422 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.975403    2584 scope.go:117] "RemoveContainer" containerID="df07a2a0d3c08fb0d0af6034d790b3e3756b3ee8c2297da1ebaaa33e12253a49"
Jul 06 01:32:57.983001 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.982981    2584 scope.go:117] "RemoveContainer" containerID="deefec8989131a74033dc74e6db16beceb7aa7657506889273c96e7b720758ca"
Jul 06 01:32:57.990793 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.990761    2584 scope.go:117] "RemoveContainer" containerID="fceabde13818749afc0b3808d2c4ede65677582c573e630458aaea282129324a"
Jul 06 01:32:57.992033 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.992013    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 01:32:57.998876 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.998854    2584 scope.go:117] "RemoveContainer" containerID="86c63a3bcbad4f91fb798cc6bfe36d36b07cc3a6c77ada9121caf2d386bc497a"
Jul 06 01:32:57.999207 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:57.999190    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 01:32:58.006293 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.006274    2584 scope.go:117] "RemoveContainer" containerID="c9bca079a67a245838ffc58a0470df297573392b8821f2e8a818c66b79dfc3d5"
Jul 06 01:32:58.014215 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.013903    2584 scope.go:117] "RemoveContainer" containerID="ca6d4c22e43b3478885c8d0beb40906ed8dd1b48f39a01bde0251819bf0656a6"
Jul 06 01:32:58.021546 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.021520    2584 scope.go:117] "RemoveContainer" containerID="6501ca8f3ad5d4d88e716f729b874f5389801a226386f15143386d157efc89af"
Jul 06 01:32:58.021909 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:32:58.021883    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6501ca8f3ad5d4d88e716f729b874f5389801a226386f15143386d157efc89af\": container with ID starting with 6501ca8f3ad5d4d88e716f729b874f5389801a226386f15143386d157efc89af not found: ID does not exist" containerID="6501ca8f3ad5d4d88e716f729b874f5389801a226386f15143386d157efc89af"
Jul 06 01:32:58.021995 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.021917    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6501ca8f3ad5d4d88e716f729b874f5389801a226386f15143386d157efc89af"} err="failed to get container status \"6501ca8f3ad5d4d88e716f729b874f5389801a226386f15143386d157efc89af\": rpc error: code = NotFound desc = could not find container \"6501ca8f3ad5d4d88e716f729b874f5389801a226386f15143386d157efc89af\": container with ID starting with 6501ca8f3ad5d4d88e716f729b874f5389801a226386f15143386d157efc89af not found: ID does not exist"
Jul 06 01:32:58.021995 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.021937    2584 scope.go:117] "RemoveContainer" containerID="df07a2a0d3c08fb0d0af6034d790b3e3756b3ee8c2297da1ebaaa33e12253a49"
Jul 06 01:32:58.022200 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:32:58.022183    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df07a2a0d3c08fb0d0af6034d790b3e3756b3ee8c2297da1ebaaa33e12253a49\": container with ID starting with df07a2a0d3c08fb0d0af6034d790b3e3756b3ee8c2297da1ebaaa33e12253a49 not found: ID does not exist" containerID="df07a2a0d3c08fb0d0af6034d790b3e3756b3ee8c2297da1ebaaa33e12253a49"
Jul 06 01:32:58.022252 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.022204    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df07a2a0d3c08fb0d0af6034d790b3e3756b3ee8c2297da1ebaaa33e12253a49"} err="failed to get container status \"df07a2a0d3c08fb0d0af6034d790b3e3756b3ee8c2297da1ebaaa33e12253a49\": rpc error: code = NotFound desc = could not find container \"df07a2a0d3c08fb0d0af6034d790b3e3756b3ee8c2297da1ebaaa33e12253a49\": container with ID starting with df07a2a0d3c08fb0d0af6034d790b3e3756b3ee8c2297da1ebaaa33e12253a49 not found: ID does not exist"
Jul 06 01:32:58.022252 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.022218    2584 scope.go:117] "RemoveContainer" containerID="deefec8989131a74033dc74e6db16beceb7aa7657506889273c96e7b720758ca"
Jul 06 01:32:58.022446 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:32:58.022428    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"deefec8989131a74033dc74e6db16beceb7aa7657506889273c96e7b720758ca\": container with ID starting with deefec8989131a74033dc74e6db16beceb7aa7657506889273c96e7b720758ca not found: ID does not exist" containerID="deefec8989131a74033dc74e6db16beceb7aa7657506889273c96e7b720758ca"
Jul 06 01:32:58.022484 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.022454    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"deefec8989131a74033dc74e6db16beceb7aa7657506889273c96e7b720758ca"} err="failed to get container status \"deefec8989131a74033dc74e6db16beceb7aa7657506889273c96e7b720758ca\": rpc error: code = NotFound desc = could not find container \"deefec8989131a74033dc74e6db16beceb7aa7657506889273c96e7b720758ca\": container with ID starting with deefec8989131a74033dc74e6db16beceb7aa7657506889273c96e7b720758ca not found: ID does not exist"
Jul 06 01:32:58.022484 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.022470    2584 scope.go:117] "RemoveContainer" containerID="fceabde13818749afc0b3808d2c4ede65677582c573e630458aaea282129324a"
Jul 06 01:32:58.022764 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:32:58.022742    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fceabde13818749afc0b3808d2c4ede65677582c573e630458aaea282129324a\": container with ID starting with fceabde13818749afc0b3808d2c4ede65677582c573e630458aaea282129324a not found: ID does not exist" containerID="fceabde13818749afc0b3808d2c4ede65677582c573e630458aaea282129324a"
Jul 06 01:32:58.022831 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.022767    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fceabde13818749afc0b3808d2c4ede65677582c573e630458aaea282129324a"} err="failed to get container status \"fceabde13818749afc0b3808d2c4ede65677582c573e630458aaea282129324a\": rpc error: code = NotFound desc = could not find container \"fceabde13818749afc0b3808d2c4ede65677582c573e630458aaea282129324a\": container with ID starting with fceabde13818749afc0b3808d2c4ede65677582c573e630458aaea282129324a not found: ID does not exist"
Jul 06 01:32:58.022831 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.022783    2584 scope.go:117] "RemoveContainer" containerID="86c63a3bcbad4f91fb798cc6bfe36d36b07cc3a6c77ada9121caf2d386bc497a"
Jul 06 01:32:58.023010 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:32:58.022989    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86c63a3bcbad4f91fb798cc6bfe36d36b07cc3a6c77ada9121caf2d386bc497a\": container with ID starting with 86c63a3bcbad4f91fb798cc6bfe36d36b07cc3a6c77ada9121caf2d386bc497a not found: ID does not exist" containerID="86c63a3bcbad4f91fb798cc6bfe36d36b07cc3a6c77ada9121caf2d386bc497a"
Jul 06 01:32:58.023054 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.023016    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86c63a3bcbad4f91fb798cc6bfe36d36b07cc3a6c77ada9121caf2d386bc497a"} err="failed to get container status \"86c63a3bcbad4f91fb798cc6bfe36d36b07cc3a6c77ada9121caf2d386bc497a\": rpc error: code = NotFound desc = could not find container \"86c63a3bcbad4f91fb798cc6bfe36d36b07cc3a6c77ada9121caf2d386bc497a\": container with ID starting with 86c63a3bcbad4f91fb798cc6bfe36d36b07cc3a6c77ada9121caf2d386bc497a not found: ID does not exist"
Jul 06 01:32:58.023054 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.023030    2584 scope.go:117] "RemoveContainer" containerID="c9bca079a67a245838ffc58a0470df297573392b8821f2e8a818c66b79dfc3d5"
Jul 06 01:32:58.023227 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:32:58.023213    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9bca079a67a245838ffc58a0470df297573392b8821f2e8a818c66b79dfc3d5\": container with ID starting with c9bca079a67a245838ffc58a0470df297573392b8821f2e8a818c66b79dfc3d5 not found: ID does not exist" containerID="c9bca079a67a245838ffc58a0470df297573392b8821f2e8a818c66b79dfc3d5"
Jul 06 01:32:58.023273 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.023230    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9bca079a67a245838ffc58a0470df297573392b8821f2e8a818c66b79dfc3d5"} err="failed to get container status \"c9bca079a67a245838ffc58a0470df297573392b8821f2e8a818c66b79dfc3d5\": rpc error: code = NotFound desc = could not find container \"c9bca079a67a245838ffc58a0470df297573392b8821f2e8a818c66b79dfc3d5\": container with ID starting with c9bca079a67a245838ffc58a0470df297573392b8821f2e8a818c66b79dfc3d5 not found: ID does not exist"
Jul 06 01:32:58.023273 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.023241    2584 scope.go:117] "RemoveContainer" containerID="ca6d4c22e43b3478885c8d0beb40906ed8dd1b48f39a01bde0251819bf0656a6"
Jul 06 01:32:58.023409 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:32:58.023396    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca6d4c22e43b3478885c8d0beb40906ed8dd1b48f39a01bde0251819bf0656a6\": container with ID starting with ca6d4c22e43b3478885c8d0beb40906ed8dd1b48f39a01bde0251819bf0656a6 not found: ID does not exist" containerID="ca6d4c22e43b3478885c8d0beb40906ed8dd1b48f39a01bde0251819bf0656a6"
Jul 06 01:32:58.023443 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.023412    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca6d4c22e43b3478885c8d0beb40906ed8dd1b48f39a01bde0251819bf0656a6"} err="failed to get container status \"ca6d4c22e43b3478885c8d0beb40906ed8dd1b48f39a01bde0251819bf0656a6\": rpc error: code = NotFound desc = could not find container \"ca6d4c22e43b3478885c8d0beb40906ed8dd1b48f39a01bde0251819bf0656a6\": container with ID starting with ca6d4c22e43b3478885c8d0beb40906ed8dd1b48f39a01bde0251819bf0656a6 not found: ID does not exist"
Jul 06 01:32:58.023443 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.023428    2584 scope.go:117] "RemoveContainer" containerID="6501ca8f3ad5d4d88e716f729b874f5389801a226386f15143386d157efc89af"
Jul 06 01:32:58.023681 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.023659    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6501ca8f3ad5d4d88e716f729b874f5389801a226386f15143386d157efc89af"} err="failed to get container status \"6501ca8f3ad5d4d88e716f729b874f5389801a226386f15143386d157efc89af\": rpc error: code = NotFound desc = could not find container \"6501ca8f3ad5d4d88e716f729b874f5389801a226386f15143386d157efc89af\": container with ID starting with 6501ca8f3ad5d4d88e716f729b874f5389801a226386f15143386d157efc89af not found: ID does not exist"
Jul 06 01:32:58.023737 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.023683    2584 scope.go:117] "RemoveContainer" containerID="df07a2a0d3c08fb0d0af6034d790b3e3756b3ee8c2297da1ebaaa33e12253a49"
Jul 06 01:32:58.023937 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.023921    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df07a2a0d3c08fb0d0af6034d790b3e3756b3ee8c2297da1ebaaa33e12253a49"} err="failed to get container status \"df07a2a0d3c08fb0d0af6034d790b3e3756b3ee8c2297da1ebaaa33e12253a49\": rpc error: code = NotFound desc = could not find container \"df07a2a0d3c08fb0d0af6034d790b3e3756b3ee8c2297da1ebaaa33e12253a49\": container with ID starting with df07a2a0d3c08fb0d0af6034d790b3e3756b3ee8c2297da1ebaaa33e12253a49 not found: ID does not exist"
Jul 06 01:32:58.023986 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.023937    2584 scope.go:117] "RemoveContainer" containerID="deefec8989131a74033dc74e6db16beceb7aa7657506889273c96e7b720758ca"
Jul 06 01:32:58.024162 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.024143    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"deefec8989131a74033dc74e6db16beceb7aa7657506889273c96e7b720758ca"} err="failed to get container status \"deefec8989131a74033dc74e6db16beceb7aa7657506889273c96e7b720758ca\": rpc error: code = NotFound desc = could not find container \"deefec8989131a74033dc74e6db16beceb7aa7657506889273c96e7b720758ca\": container with ID starting with deefec8989131a74033dc74e6db16beceb7aa7657506889273c96e7b720758ca not found: ID does not exist"
Jul 06 01:32:58.024215 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.024165    2584 scope.go:117] "RemoveContainer" containerID="fceabde13818749afc0b3808d2c4ede65677582c573e630458aaea282129324a"
Jul 06 01:32:58.024418 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.024395    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fceabde13818749afc0b3808d2c4ede65677582c573e630458aaea282129324a"} err="failed to get container status \"fceabde13818749afc0b3808d2c4ede65677582c573e630458aaea282129324a\": rpc error: code = NotFound desc = could not find container \"fceabde13818749afc0b3808d2c4ede65677582c573e630458aaea282129324a\": container with ID starting with fceabde13818749afc0b3808d2c4ede65677582c573e630458aaea282129324a not found: ID does not exist"
Jul 06 01:32:58.024418 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.024416    2584 scope.go:117] "RemoveContainer" containerID="86c63a3bcbad4f91fb798cc6bfe36d36b07cc3a6c77ada9121caf2d386bc497a"
Jul 06 01:32:58.024636 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.024599    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86c63a3bcbad4f91fb798cc6bfe36d36b07cc3a6c77ada9121caf2d386bc497a"} err="failed to get container status \"86c63a3bcbad4f91fb798cc6bfe36d36b07cc3a6c77ada9121caf2d386bc497a\": rpc error: code = NotFound desc = could not find container \"86c63a3bcbad4f91fb798cc6bfe36d36b07cc3a6c77ada9121caf2d386bc497a\": container with ID starting with 86c63a3bcbad4f91fb798cc6bfe36d36b07cc3a6c77ada9121caf2d386bc497a not found: ID does not exist"
Jul 06 01:32:58.024687 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.024637    2584 scope.go:117] "RemoveContainer" containerID="c9bca079a67a245838ffc58a0470df297573392b8821f2e8a818c66b79dfc3d5"
Jul 06 01:32:58.024916 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.024898    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9bca079a67a245838ffc58a0470df297573392b8821f2e8a818c66b79dfc3d5"} err="failed to get container status \"c9bca079a67a245838ffc58a0470df297573392b8821f2e8a818c66b79dfc3d5\": rpc error: code = NotFound desc = could not find container \"c9bca079a67a245838ffc58a0470df297573392b8821f2e8a818c66b79dfc3d5\": container with ID starting with c9bca079a67a245838ffc58a0470df297573392b8821f2e8a818c66b79dfc3d5 not found: ID does not exist"
Jul 06 01:32:58.024916 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.024918    2584 scope.go:117] "RemoveContainer" containerID="ca6d4c22e43b3478885c8d0beb40906ed8dd1b48f39a01bde0251819bf0656a6"
Jul 06 01:32:58.025137 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.025119    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca6d4c22e43b3478885c8d0beb40906ed8dd1b48f39a01bde0251819bf0656a6"} err="failed to get container status \"ca6d4c22e43b3478885c8d0beb40906ed8dd1b48f39a01bde0251819bf0656a6\": rpc error: code = NotFound desc = could not find container \"ca6d4c22e43b3478885c8d0beb40906ed8dd1b48f39a01bde0251819bf0656a6\": container with ID starting with ca6d4c22e43b3478885c8d0beb40906ed8dd1b48f39a01bde0251819bf0656a6 not found: ID does not exist"
Jul 06 01:32:58.615492 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:32:58.615454    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" path="/var/lib/kubelet/pods/1d067bc0-b4ef-43c0-844a-93a32d30f011/volumes"
Jul 06 01:33:00.666489 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:00.666452    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 01:33:00.666952 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:00.666801    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="prometheus" containerID="cri-o://d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910" gracePeriod=600
Jul 06 01:33:00.666952 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:00.666842    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="thanos-sidecar" containerID="cri-o://1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272" gracePeriod=600
Jul 06 01:33:00.666952 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:00.666857    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="kube-rbac-proxy-web" containerID="cri-o://154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95" gracePeriod=600
Jul 06 01:33:00.666952 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:00.666886    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="kube-rbac-proxy-thanos" containerID="cri-o://562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347" gracePeriod=600
Jul 06 01:33:00.666952 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:00.666810    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="kube-rbac-proxy" containerID="cri-o://a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b" gracePeriod=600
Jul 06 01:33:00.666952 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:00.666844    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="config-reloader" containerID="cri-o://07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9" gracePeriod=600
Jul 06 01:33:00.936721 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:00.936692    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:00.984941 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:00.984903    2584 generic.go:356] "Generic (PLEG): container finished" podID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerID="562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347" exitCode=0
Jul 06 01:33:00.984941 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:00.984934    2584 generic.go:356] "Generic (PLEG): container finished" podID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerID="a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b" exitCode=0
Jul 06 01:33:00.984941 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:00.984943    2584 generic.go:356] "Generic (PLEG): container finished" podID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerID="154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95" exitCode=0
Jul 06 01:33:00.984941 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:00.984952    2584 generic.go:356] "Generic (PLEG): container finished" podID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerID="1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272" exitCode=0
Jul 06 01:33:00.985302 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:00.984960    2584 generic.go:356] "Generic (PLEG): container finished" podID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerID="07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9" exitCode=0
Jul 06 01:33:00.985302 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:00.984968    2584 generic.go:356] "Generic (PLEG): container finished" podID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerID="d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910" exitCode=0
Jul 06 01:33:00.985302 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:00.984994    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7","Type":"ContainerDied","Data":"562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347"}
Jul 06 01:33:00.985302 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:00.985104    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7","Type":"ContainerDied","Data":"a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b"}
Jul 06 01:33:00.985302 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:00.985144    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7","Type":"ContainerDied","Data":"154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95"}
Jul 06 01:33:00.985302 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:00.985183    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7","Type":"ContainerDied","Data":"1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272"}
Jul 06 01:33:00.985302 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:00.985221    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7","Type":"ContainerDied","Data":"07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9"}
Jul 06 01:33:00.985302 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:00.985258    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7","Type":"ContainerDied","Data":"d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910"}
Jul 06 01:33:00.985302 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:00.985297    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7","Type":"ContainerDied","Data":"3ff68f44cfa9ded7d3ff0e4af571a5d1c5e22cb1ec23c3e400ee944794602607"}
Jul 06 01:33:00.985761 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:00.985344    2584 scope.go:117] "RemoveContainer" containerID="562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347"
Jul 06 01:33:00.985761 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:00.985549    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:00.994919 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:00.994889    2584 scope.go:117] "RemoveContainer" containerID="a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b"
Jul 06 01:33:01.004840 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.004748    2584 scope.go:117] "RemoveContainer" containerID="154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95"
Jul 06 01:33:01.014191 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.014167    2584 scope.go:117] "RemoveContainer" containerID="1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272"
Jul 06 01:33:01.022666 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.022647    2584 scope.go:117] "RemoveContainer" containerID="07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9"
Jul 06 01:33:01.030334 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.030306    2584 scope.go:117] "RemoveContainer" containerID="d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910"
Jul 06 01:33:01.038311 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.038290    2584 scope.go:117] "RemoveContainer" containerID="9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4"
Jul 06 01:33:01.045684 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.045663    2584 scope.go:117] "RemoveContainer" containerID="562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347"
Jul 06 01:33:01.045970 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:33:01.045950    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347\": container with ID starting with 562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347 not found: ID does not exist" containerID="562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347"
Jul 06 01:33:01.046023 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.045979    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347"} err="failed to get container status \"562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347\": rpc error: code = NotFound desc = could not find container \"562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347\": container with ID starting with 562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347 not found: ID does not exist"
Jul 06 01:33:01.046023 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.045999    2584 scope.go:117] "RemoveContainer" containerID="a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b"
Jul 06 01:33:01.046226 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:33:01.046209    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b\": container with ID starting with a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b not found: ID does not exist" containerID="a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b"
Jul 06 01:33:01.046270 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.046228    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b"} err="failed to get container status \"a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b\": rpc error: code = NotFound desc = could not find container \"a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b\": container with ID starting with a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b not found: ID does not exist"
Jul 06 01:33:01.046270 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.046240    2584 scope.go:117] "RemoveContainer" containerID="154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95"
Jul 06 01:33:01.046463 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:33:01.046449    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95\": container with ID starting with 154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95 not found: ID does not exist" containerID="154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95"
Jul 06 01:33:01.046504 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.046466    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95"} err="failed to get container status \"154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95\": rpc error: code = NotFound desc = could not find container \"154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95\": container with ID starting with 154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95 not found: ID does not exist"
Jul 06 01:33:01.046504 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.046476    2584 scope.go:117] "RemoveContainer" containerID="1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272"
Jul 06 01:33:01.046718 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:33:01.046701    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272\": container with ID starting with 1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272 not found: ID does not exist" containerID="1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272"
Jul 06 01:33:01.046774 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.046720    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272"} err="failed to get container status \"1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272\": rpc error: code = NotFound desc = could not find container \"1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272\": container with ID starting with 1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272 not found: ID does not exist"
Jul 06 01:33:01.046774 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.046732    2584 scope.go:117] "RemoveContainer" containerID="07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9"
Jul 06 01:33:01.046942 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:33:01.046927    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9\": container with ID starting with 07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9 not found: ID does not exist" containerID="07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9"
Jul 06 01:33:01.046992 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.046944    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9"} err="failed to get container status \"07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9\": rpc error: code = NotFound desc = could not find container \"07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9\": container with ID starting with 07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9 not found: ID does not exist"
Jul 06 01:33:01.046992 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.046956    2584 scope.go:117] "RemoveContainer" containerID="d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910"
Jul 06 01:33:01.047146 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:33:01.047133    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910\": container with ID starting with d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910 not found: ID does not exist" containerID="d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910"
Jul 06 01:33:01.047180 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.047148    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910"} err="failed to get container status \"d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910\": rpc error: code = NotFound desc = could not find container \"d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910\": container with ID starting with d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910 not found: ID does not exist"
Jul 06 01:33:01.047180 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.047159    2584 scope.go:117] "RemoveContainer" containerID="9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4"
Jul 06 01:33:01.047367 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:33:01.047354    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4\": container with ID starting with 9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4 not found: ID does not exist" containerID="9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4"
Jul 06 01:33:01.047401 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.047368    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4"} err="failed to get container status \"9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4\": rpc error: code = NotFound desc = could not find container \"9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4\": container with ID starting with 9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4 not found: ID does not exist"
Jul 06 01:33:01.047401 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.047378    2584 scope.go:117] "RemoveContainer" containerID="562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347"
Jul 06 01:33:01.047596 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.047578    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347"} err="failed to get container status \"562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347\": rpc error: code = NotFound desc = could not find container \"562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347\": container with ID starting with 562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347 not found: ID does not exist"
Jul 06 01:33:01.047596 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.047596    2584 scope.go:117] "RemoveContainer" containerID="a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b"
Jul 06 01:33:01.047862 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.047839    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b"} err="failed to get container status \"a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b\": rpc error: code = NotFound desc = could not find container \"a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b\": container with ID starting with a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b not found: ID does not exist"
Jul 06 01:33:01.047899 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.047866    2584 scope.go:117] "RemoveContainer" containerID="154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95"
Jul 06 01:33:01.048109 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.048089    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95"} err="failed to get container status \"154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95\": rpc error: code = NotFound desc = could not find container \"154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95\": container with ID starting with 154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95 not found: ID does not exist"
Jul 06 01:33:01.048148 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.048110    2584 scope.go:117] "RemoveContainer" containerID="1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272"
Jul 06 01:33:01.048339 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.048321    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272"} err="failed to get container status \"1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272\": rpc error: code = NotFound desc = could not find container \"1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272\": container with ID starting with 1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272 not found: ID does not exist"
Jul 06 01:33:01.048381 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.048341    2584 scope.go:117] "RemoveContainer" containerID="07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9"
Jul 06 01:33:01.048558 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.048540    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9"} err="failed to get container status \"07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9\": rpc error: code = NotFound desc = could not find container \"07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9\": container with ID starting with 07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9 not found: ID does not exist"
Jul 06 01:33:01.048607 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.048558    2584 scope.go:117] "RemoveContainer" containerID="d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910"
Jul 06 01:33:01.048780 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.048764    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910"} err="failed to get container status \"d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910\": rpc error: code = NotFound desc = could not find container \"d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910\": container with ID starting with d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910 not found: ID does not exist"
Jul 06 01:33:01.048822 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.048781    2584 scope.go:117] "RemoveContainer" containerID="9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4"
Jul 06 01:33:01.048954 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.048938    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4"} err="failed to get container status \"9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4\": rpc error: code = NotFound desc = could not find container \"9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4\": container with ID starting with 9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4 not found: ID does not exist"
Jul 06 01:33:01.048994 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.048954    2584 scope.go:117] "RemoveContainer" containerID="562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347"
Jul 06 01:33:01.049137 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.049121    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347"} err="failed to get container status \"562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347\": rpc error: code = NotFound desc = could not find container \"562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347\": container with ID starting with 562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347 not found: ID does not exist"
Jul 06 01:33:01.049172 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.049137    2584 scope.go:117] "RemoveContainer" containerID="a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b"
Jul 06 01:33:01.049305 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.049290    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b"} err="failed to get container status \"a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b\": rpc error: code = NotFound desc = could not find container \"a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b\": container with ID starting with a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b not found: ID does not exist"
Jul 06 01:33:01.049343 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.049305    2584 scope.go:117] "RemoveContainer" containerID="154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95"
Jul 06 01:33:01.049485 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.049470    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95"} err="failed to get container status \"154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95\": rpc error: code = NotFound desc = could not find container \"154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95\": container with ID starting with 154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95 not found: ID does not exist"
Jul 06 01:33:01.049522 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.049485    2584 scope.go:117] "RemoveContainer" containerID="1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272"
Jul 06 01:33:01.049707 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.049684    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272"} err="failed to get container status \"1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272\": rpc error: code = NotFound desc = could not find container \"1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272\": container with ID starting with 1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272 not found: ID does not exist"
Jul 06 01:33:01.049748 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.049708    2584 scope.go:117] "RemoveContainer" containerID="07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9"
Jul 06 01:33:01.049897 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.049880    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9"} err="failed to get container status \"07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9\": rpc error: code = NotFound desc = could not find container \"07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9\": container with ID starting with 07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9 not found: ID does not exist"
Jul 06 01:33:01.049935 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.049897    2584 scope.go:117] "RemoveContainer" containerID="d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910"
Jul 06 01:33:01.050107 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.050090    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910"} err="failed to get container status \"d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910\": rpc error: code = NotFound desc = could not find container \"d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910\": container with ID starting with d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910 not found: ID does not exist"
Jul 06 01:33:01.050157 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.050107    2584 scope.go:117] "RemoveContainer" containerID="9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4"
Jul 06 01:33:01.050289 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.050273    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4"} err="failed to get container status \"9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4\": rpc error: code = NotFound desc = could not find container \"9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4\": container with ID starting with 9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4 not found: ID does not exist"
Jul 06 01:33:01.050324 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.050288    2584 scope.go:117] "RemoveContainer" containerID="562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347"
Jul 06 01:33:01.050469 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.050453    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347"} err="failed to get container status \"562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347\": rpc error: code = NotFound desc = could not find container \"562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347\": container with ID starting with 562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347 not found: ID does not exist"
Jul 06 01:33:01.050516 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.050470    2584 scope.go:117] "RemoveContainer" containerID="a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b"
Jul 06 01:33:01.050702 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.050685    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b"} err="failed to get container status \"a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b\": rpc error: code = NotFound desc = could not find container \"a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b\": container with ID starting with a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b not found: ID does not exist"
Jul 06 01:33:01.050702 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.050701    2584 scope.go:117] "RemoveContainer" containerID="154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95"
Jul 06 01:33:01.050890 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.050872    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95"} err="failed to get container status \"154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95\": rpc error: code = NotFound desc = could not find container \"154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95\": container with ID starting with 154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95 not found: ID does not exist"
Jul 06 01:33:01.050890 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.050890    2584 scope.go:117] "RemoveContainer" containerID="1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272"
Jul 06 01:33:01.051084 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.051069    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272"} err="failed to get container status \"1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272\": rpc error: code = NotFound desc = could not find container \"1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272\": container with ID starting with 1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272 not found: ID does not exist"
Jul 06 01:33:01.051130 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.051085    2584 scope.go:117] "RemoveContainer" containerID="07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9"
Jul 06 01:33:01.051280 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.051264    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9"} err="failed to get container status \"07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9\": rpc error: code = NotFound desc = could not find container \"07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9\": container with ID starting with 07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9 not found: ID does not exist"
Jul 06 01:33:01.051280 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.051278    2584 scope.go:117] "RemoveContainer" containerID="d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910"
Jul 06 01:33:01.051485 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.051466    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910"} err="failed to get container status \"d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910\": rpc error: code = NotFound desc = could not find container \"d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910\": container with ID starting with d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910 not found: ID does not exist"
Jul 06 01:33:01.051531 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.051485    2584 scope.go:117] "RemoveContainer" containerID="9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4"
Jul 06 01:33:01.051677 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.051660    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4"} err="failed to get container status \"9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4\": rpc error: code = NotFound desc = could not find container \"9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4\": container with ID starting with 9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4 not found: ID does not exist"
Jul 06 01:33:01.051677 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.051676    2584 scope.go:117] "RemoveContainer" containerID="562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347"
Jul 06 01:33:01.051868 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.051853    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347"} err="failed to get container status \"562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347\": rpc error: code = NotFound desc = could not find container \"562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347\": container with ID starting with 562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347 not found: ID does not exist"
Jul 06 01:33:01.051905 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.051868    2584 scope.go:117] "RemoveContainer" containerID="a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b"
Jul 06 01:33:01.052053 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.052032    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b"} err="failed to get container status \"a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b\": rpc error: code = NotFound desc = could not find container \"a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b\": container with ID starting with a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b not found: ID does not exist"
Jul 06 01:33:01.052107 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.052054    2584 scope.go:117] "RemoveContainer" containerID="154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95"
Jul 06 01:33:01.052234 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.052215    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95"} err="failed to get container status \"154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95\": rpc error: code = NotFound desc = could not find container \"154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95\": container with ID starting with 154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95 not found: ID does not exist"
Jul 06 01:33:01.052280 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.052234    2584 scope.go:117] "RemoveContainer" containerID="1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272"
Jul 06 01:33:01.052469 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.052450    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272"} err="failed to get container status \"1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272\": rpc error: code = NotFound desc = could not find container \"1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272\": container with ID starting with 1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272 not found: ID does not exist"
Jul 06 01:33:01.052520 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.052470    2584 scope.go:117] "RemoveContainer" containerID="07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9"
Jul 06 01:33:01.052719 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.052702    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9"} err="failed to get container status \"07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9\": rpc error: code = NotFound desc = could not find container \"07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9\": container with ID starting with 07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9 not found: ID does not exist"
Jul 06 01:33:01.052764 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.052720    2584 scope.go:117] "RemoveContainer" containerID="d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910"
Jul 06 01:33:01.052902 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.052886    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910"} err="failed to get container status \"d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910\": rpc error: code = NotFound desc = could not find container \"d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910\": container with ID starting with d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910 not found: ID does not exist"
Jul 06 01:33:01.052938 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.052902    2584 scope.go:117] "RemoveContainer" containerID="9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4"
Jul 06 01:33:01.053108 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.053086    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4"} err="failed to get container status \"9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4\": rpc error: code = NotFound desc = could not find container \"9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4\": container with ID starting with 9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4 not found: ID does not exist"
Jul 06 01:33:01.053156 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.053108    2584 scope.go:117] "RemoveContainer" containerID="562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347"
Jul 06 01:33:01.053363 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.053346    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347"} err="failed to get container status \"562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347\": rpc error: code = NotFound desc = could not find container \"562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347\": container with ID starting with 562364be902059ad0652ae27e419f9b11f9b26595da0c1f0afdbdd7aca39a347 not found: ID does not exist"
Jul 06 01:33:01.053412 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.053363    2584 scope.go:117] "RemoveContainer" containerID="a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b"
Jul 06 01:33:01.053579 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.053559    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b"} err="failed to get container status \"a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b\": rpc error: code = NotFound desc = could not find container \"a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b\": container with ID starting with a7731f7aceecf76e7ebbd3af629f04011be08ae470226e364df78567f84b3f9b not found: ID does not exist"
Jul 06 01:33:01.053642 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.053581    2584 scope.go:117] "RemoveContainer" containerID="154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95"
Jul 06 01:33:01.053806 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.053789    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95"} err="failed to get container status \"154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95\": rpc error: code = NotFound desc = could not find container \"154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95\": container with ID starting with 154a340a38cc22d98b91e9dd5d531bae99d0d84586484e859243950a59d2cf95 not found: ID does not exist"
Jul 06 01:33:01.053843 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.053807    2584 scope.go:117] "RemoveContainer" containerID="1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272"
Jul 06 01:33:01.054005 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.053989    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272"} err="failed to get container status \"1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272\": rpc error: code = NotFound desc = could not find container \"1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272\": container with ID starting with 1ca3461e9bdb47ac389843fbea2b63b18d2e266af6ffa07ad0d2bf83bf371272 not found: ID does not exist"
Jul 06 01:33:01.054060 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.054005    2584 scope.go:117] "RemoveContainer" containerID="07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9"
Jul 06 01:33:01.054199 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.054183    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9"} err="failed to get container status \"07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9\": rpc error: code = NotFound desc = could not find container \"07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9\": container with ID starting with 07b6a08cfd6783d2fcd83c44f13d07fc1572d9bbe8bfcc446bdae26a8f7083d9 not found: ID does not exist"
Jul 06 01:33:01.054244 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.054200    2584 scope.go:117] "RemoveContainer" containerID="d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910"
Jul 06 01:33:01.054383 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.054367    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910"} err="failed to get container status \"d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910\": rpc error: code = NotFound desc = could not find container \"d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910\": container with ID starting with d121327b339dcf1731babf5cb4102b568cd45b69e9de66285e55a73d949bb910 not found: ID does not exist"
Jul 06 01:33:01.054419 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.054384    2584 scope.go:117] "RemoveContainer" containerID="9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4"
Jul 06 01:33:01.054583 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.054569    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4"} err="failed to get container status \"9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4\": rpc error: code = NotFound desc = could not find container \"9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4\": container with ID starting with 9a26a33d075baf6cf81ecb7017ab3a573467783c9b33432c53bd5c8c29119ee4 not found: ID does not exist"
Jul 06 01:33:01.067923 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.067891    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-thanos-prometheus-http-client-file\") pod \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") "
Jul 06 01:33:01.068027 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.067940    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") "
Jul 06 01:33:01.068027 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.067962    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-config\") pod \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") "
Jul 06 01:33:01.068027 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.067979    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-k8s-db\") pod \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") "
Jul 06 01:33:01.068027 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.068000    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") "
Jul 06 01:33:01.068027 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.068026    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-tls-assets\") pod \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") "
Jul 06 01:33:01.068333 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.068057    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-kube-rbac-proxy\") pod \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") "
Jul 06 01:33:01.068333 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.068106    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-k8s-rulefiles-2\") pod \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") "
Jul 06 01:33:01.068333 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.068132    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-config-out\") pod \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") "
Jul 06 01:33:01.068333 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.068159    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-configmap-metrics-client-ca\") pod \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") "
Jul 06 01:33:01.068333 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.068193    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-configmap-serving-certs-ca-bundle\") pod \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") "
Jul 06 01:33:01.068333 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.068218    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-metrics-client-certs\") pod \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") "
Jul 06 01:33:01.068333 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.068243    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-prometheus-k8s-tls\") pod \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") "
Jul 06 01:33:01.068333 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.068272    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-k8s-rulefiles-0\") pod \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") "
Jul 06 01:33:01.068333 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.068305    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-web-config\") pod \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") "
Jul 06 01:33:01.068333 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.068331    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-configmap-kubelet-serving-ca-bundle\") pod \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") "
Jul 06 01:33:01.068810 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.068357    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-k8s-rulefiles-1\") pod \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") "
Jul 06 01:33:01.068810 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.068391    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcdck\" (UniqueName: \"kubernetes.io/projected/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-kube-api-access-lcdck\") pod \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") "
Jul 06 01:33:01.068810 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.068431    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-trusted-ca-bundle\") pod \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") "
Jul 06 01:33:01.068810 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.068482    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-grpc-tls\") pod \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\" (UID: \"7d2e805c-f53d-4dcb-a1f1-2050f5da56f7\") "
Jul 06 01:33:01.069425 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.069391    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" (UID: "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:33:01.069525 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.069456    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" (UID: "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:33:01.069525 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.069515    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" (UID: "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:33:01.069883 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.069855    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" (UID: "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:33:01.070213 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.070168    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" (UID: "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:33:01.070680 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.070658    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" (UID: "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:33:01.070843 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.070821    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" (UID: "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:33:01.071071 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.071047    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" (UID: "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:33:01.071310 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.071282    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" (UID: "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:33:01.071422 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.071392    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" (UID: "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:33:01.071857 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.071831    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-config" (OuterVolumeSpecName: "config") pod "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" (UID: "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:33:01.072264 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.072211    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-config-out" (OuterVolumeSpecName: "config-out") pod "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" (UID: "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:33:01.072264 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.072229    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" (UID: "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:33:01.072416 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.072365    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" (UID: "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:33:01.072416 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.072391    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" (UID: "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:33:01.072641 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.072605    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" (UID: "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:33:01.073046 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.073016    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" (UID: "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:33:01.073135 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.073114    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" (UID: "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:33:01.073177 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.073114    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-kube-api-access-lcdck" (OuterVolumeSpecName: "kube-api-access-lcdck") pod "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" (UID: "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7"). InnerVolumeSpecName "kube-api-access-lcdck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:33:01.084129 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.084075    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-web-config" (OuterVolumeSpecName: "web-config") pod "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" (UID: "7d2e805c-f53d-4dcb-a1f1-2050f5da56f7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:33:01.169943 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.169901    2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-tls-assets\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:33:01.169943 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.169933    2584 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-kube-rbac-proxy\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:33:01.169943 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.169945    2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:33:01.169943 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.169953    2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-config-out\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:33:01.170258 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.169962    2584 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-configmap-metrics-client-ca\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:33:01.170258 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.169971    2584 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:33:01.170258 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.169982    2584 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-metrics-client-certs\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:33:01.170258 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.169990    2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:33:01.170258 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.169998    2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:33:01.170258 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.170007    2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-web-config\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:33:01.170258 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.170015    2584 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:33:01.170258 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.170023    2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:33:01.170258 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.170031    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcdck\" (UniqueName: \"kubernetes.io/projected/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-kube-api-access-lcdck\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:33:01.170258 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.170039    2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:33:01.170258 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.170048    2584 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-grpc-tls\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:33:01.170258 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.170055    2584 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:33:01.170258 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.170064    2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:33:01.170258 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.170072    2584 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-config\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:33:01.170258 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.170079    2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-prometheus-k8s-db\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:33:01.170258 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.170088    2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:33:01.311096 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.311057    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 01:33:01.315511 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.315482    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 01:33:01.339997 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.339955    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 01:33:01.340257 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340244    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="kube-rbac-proxy"
Jul 06 01:33:01.340299 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340259    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="kube-rbac-proxy"
Jul 06 01:33:01.340299 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340270    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="alertmanager"
Jul 06 01:33:01.340299 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340275    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="alertmanager"
Jul 06 01:33:01.340299 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340282    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="kube-rbac-proxy-web"
Jul 06 01:33:01.340299 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340288    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="kube-rbac-proxy-web"
Jul 06 01:33:01.340299 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340293    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="prometheus"
Jul 06 01:33:01.340299 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340299    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="prometheus"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340305    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="config-reloader"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340310    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="config-reloader"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340316    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="thanos-sidecar"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340320    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="thanos-sidecar"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340329    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="init-config-reloader"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340334    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="init-config-reloader"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340340    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="kube-rbac-proxy-web"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340346    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="kube-rbac-proxy-web"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340352    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="config-reloader"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340357    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="config-reloader"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340364    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="kube-rbac-proxy"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340370    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="kube-rbac-proxy"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340376    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="kube-rbac-proxy-metric"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340381    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="kube-rbac-proxy-metric"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340386    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="init-config-reloader"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340391    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="init-config-reloader"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340397    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="prom-label-proxy"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340402    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="prom-label-proxy"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340408    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="kube-rbac-proxy-thanos"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340414    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="kube-rbac-proxy-thanos"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340422    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91217fbf-2d05-4fea-a848-ce72d151cd49" containerName="registry"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340427    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="91217fbf-2d05-4fea-a848-ce72d151cd49" containerName="registry"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340473    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="prom-label-proxy"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340481    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="config-reloader"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340489    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="thanos-sidecar"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340495    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="kube-rbac-proxy-web"
Jul 06 01:33:01.340488 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340501    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="kube-rbac-proxy-web"
Jul 06 01:33:01.341251 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340506    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="prometheus"
Jul 06 01:33:01.341251 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340511    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="alertmanager"
Jul 06 01:33:01.341251 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340516    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="kube-rbac-proxy-metric"
Jul 06 01:33:01.341251 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340521    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="91217fbf-2d05-4fea-a848-ce72d151cd49" containerName="registry"
Jul 06 01:33:01.341251 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340526    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d067bc0-b4ef-43c0-844a-93a32d30f011" containerName="kube-rbac-proxy"
Jul 06 01:33:01.341251 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340531    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="kube-rbac-proxy"
Jul 06 01:33:01.341251 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340536    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="kube-rbac-proxy-thanos"
Jul 06 01:33:01.341251 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.340542    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" containerName="config-reloader"
Jul 06 01:33:01.345995 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.345967    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.348906 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.348861    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 06 01:33:01.349044 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.348921    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 06 01:33:01.349611 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.349205    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 06 01:33:01.349611 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.349380    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 06 01:33:01.349611 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.349441    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9rptnheuuhr20\""
Jul 06 01:33:01.349611 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.349512    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-w6bfr\""
Jul 06 01:33:01.350667 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.350101    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 06 01:33:01.350667 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.350226    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 06 01:33:01.350667 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.350339    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 06 01:33:01.350667 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.350662    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 06 01:33:01.350928 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.350779    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 06 01:33:01.350928 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.350798    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 06 01:33:01.350928 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.350782    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 06 01:33:01.351082 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.351009    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 06 01:33:01.353300 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.353275    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 06 01:33:01.355049 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.355026    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 06 01:33:01.360164 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.360139    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 01:33:01.472305 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.472270    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/40294cf0-b627-4a90-80b6-0e37d1496b4c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.472305 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.472313    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.472521 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.472336    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/40294cf0-b627-4a90-80b6-0e37d1496b4c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.472521 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.472362    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.472521 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.472405    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.472521 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.472460    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-config\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.472521 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.472478    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.472521 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.472493    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40294cf0-b627-4a90-80b6-0e37d1496b4c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.472743 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.472569    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfplb\" (UniqueName: \"kubernetes.io/projected/40294cf0-b627-4a90-80b6-0e37d1496b4c-kube-api-access-tfplb\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.472743 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.472593    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.472743 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.472609    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40294cf0-b627-4a90-80b6-0e37d1496b4c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.472743 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.472649    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/40294cf0-b627-4a90-80b6-0e37d1496b4c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.472743 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.472665    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/40294cf0-b627-4a90-80b6-0e37d1496b4c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.472743 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.472680    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-web-config\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.472743 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.472695    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.472945 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.472746    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40294cf0-b627-4a90-80b6-0e37d1496b4c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.472945 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.472767    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40294cf0-b627-4a90-80b6-0e37d1496b4c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.472945 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.472786    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40294cf0-b627-4a90-80b6-0e37d1496b4c-config-out\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.472945 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.472809    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40294cf0-b627-4a90-80b6-0e37d1496b4c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.472945 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.472842    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.573512 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.573412    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-config\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.573512 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.573451    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.573512 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.573468    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40294cf0-b627-4a90-80b6-0e37d1496b4c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.573823 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.573522    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfplb\" (UniqueName: \"kubernetes.io/projected/40294cf0-b627-4a90-80b6-0e37d1496b4c-kube-api-access-tfplb\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.573823 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.573559    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.573823 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.573584    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40294cf0-b627-4a90-80b6-0e37d1496b4c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.573823 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.573612    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/40294cf0-b627-4a90-80b6-0e37d1496b4c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.573823 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.573672    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/40294cf0-b627-4a90-80b6-0e37d1496b4c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.573823 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.573693    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-web-config\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.573823 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.573715    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.573823 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.573739    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40294cf0-b627-4a90-80b6-0e37d1496b4c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.574406 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.574379    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/40294cf0-b627-4a90-80b6-0e37d1496b4c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.575535 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.574380    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/40294cf0-b627-4a90-80b6-0e37d1496b4c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.575535 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.574435    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40294cf0-b627-4a90-80b6-0e37d1496b4c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.575535 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.574503    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40294cf0-b627-4a90-80b6-0e37d1496b4c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.575535 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.574555    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40294cf0-b627-4a90-80b6-0e37d1496b4c-config-out\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.575535 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.574584    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40294cf0-b627-4a90-80b6-0e37d1496b4c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.575535 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.574619    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.575535 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.574680    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/40294cf0-b627-4a90-80b6-0e37d1496b4c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.575535 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.574719    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.575535 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.574757    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/40294cf0-b627-4a90-80b6-0e37d1496b4c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.575535 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.574790    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.575535 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.574816    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.575535 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.575067    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40294cf0-b627-4a90-80b6-0e37d1496b4c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.576146 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.575618    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40294cf0-b627-4a90-80b6-0e37d1496b4c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.576146 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.575711    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40294cf0-b627-4a90-80b6-0e37d1496b4c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.576146 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.575978    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/40294cf0-b627-4a90-80b6-0e37d1496b4c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.577674 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.576783    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.577674 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.577184    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-config\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.577674 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.577301    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-web-config\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.577674 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.577636    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.578161 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.578142    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.578592 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.578542    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40294cf0-b627-4a90-80b6-0e37d1496b4c-config-out\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.578705 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.578620    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40294cf0-b627-4a90-80b6-0e37d1496b4c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.578842 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.578806    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.578989 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.578971    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.579118 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.579102    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.579758 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.579734    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/40294cf0-b627-4a90-80b6-0e37d1496b4c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.580118 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.580097    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40294cf0-b627-4a90-80b6-0e37d1496b4c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.582493 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.582474    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfplb\" (UniqueName: \"kubernetes.io/projected/40294cf0-b627-4a90-80b6-0e37d1496b4c-kube-api-access-tfplb\") pod \"prometheus-k8s-0\" (UID: \"40294cf0-b627-4a90-80b6-0e37d1496b4c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.658031 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.657986    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:33:01.808505 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.808470    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 01:33:01.812073 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:33:01.812040    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40294cf0_b627_4a90_80b6_0e37d1496b4c.slice/crio-e596ad2a746608d7139ddea57f28043076703316b89a404c106aed67c8079800 WatchSource:0}: Error finding container e596ad2a746608d7139ddea57f28043076703316b89a404c106aed67c8079800: Status 404 returned error can't find the container with id e596ad2a746608d7139ddea57f28043076703316b89a404c106aed67c8079800
Jul 06 01:33:01.991432 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.991397    2584 generic.go:356] "Generic (PLEG): container finished" podID="40294cf0-b627-4a90-80b6-0e37d1496b4c" containerID="54018d75bf18737636d5e8325a2b3ef5e40bfaf7996df4991a31b46f56c64b66" exitCode=0
Jul 06 01:33:01.991605 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.991491    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40294cf0-b627-4a90-80b6-0e37d1496b4c","Type":"ContainerDied","Data":"54018d75bf18737636d5e8325a2b3ef5e40bfaf7996df4991a31b46f56c64b66"}
Jul 06 01:33:01.991605 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:01.991571    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40294cf0-b627-4a90-80b6-0e37d1496b4c","Type":"ContainerStarted","Data":"e596ad2a746608d7139ddea57f28043076703316b89a404c106aed67c8079800"}
Jul 06 01:33:02.615317 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:02.615270    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d2e805c-f53d-4dcb-a1f1-2050f5da56f7" path="/var/lib/kubelet/pods/7d2e805c-f53d-4dcb-a1f1-2050f5da56f7/volumes"
Jul 06 01:33:03.000331 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:03.000245    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40294cf0-b627-4a90-80b6-0e37d1496b4c","Type":"ContainerStarted","Data":"7bd24d38e53c5893ef381c461f5a17a7a6d8254d78e03d32db617b006c2f06be"}
Jul 06 01:33:03.000331 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:03.000312    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40294cf0-b627-4a90-80b6-0e37d1496b4c","Type":"ContainerStarted","Data":"124d8436ffe99d7b28948cc8ed4ee7973726321cb428ab6df3fabedd53ef71d0"}
Jul 06 01:33:03.000854 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:03.000343    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40294cf0-b627-4a90-80b6-0e37d1496b4c","Type":"ContainerStarted","Data":"2a2f66342e482f5abcb5e39fb1a087c24e40fa534093cf1f7fd3be91fa1dc827"}
Jul 06 01:33:03.000854 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:03.000370    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40294cf0-b627-4a90-80b6-0e37d1496b4c","Type":"ContainerStarted","Data":"8d80bf2fd9fbed69aceea91b4e961f2ccaf9d9891c9e22059e65c0cfffbeec0c"}
Jul 06 01:33:03.000854 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:03.000394    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40294cf0-b627-4a90-80b6-0e37d1496b4c","Type":"ContainerStarted","Data":"5fb0ce372510e0b5294f64ee32edbcf4a1b83678a433baf590d0a2682877feef"}
Jul 06 01:33:03.000854 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:03.000416    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40294cf0-b627-4a90-80b6-0e37d1496b4c","Type":"ContainerStarted","Data":"7e8d1a35cbc6f9dafac5fd2ec92e040016aae169e036261417e2eb939053c95c"}
Jul 06 01:33:03.030170 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:03.030111    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.006892588 podStartE2EDuration="2.030094041s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.201453ms" isStatefulPod=false podCreationTimestamp="2026-07-06 01:33:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:33:03.029165843 +0000 UTC m=+391.270933715" watchObservedRunningTime="2026-07-06 01:33:03.030094041 +0000 UTC m=+391.271861907"
Jul 06 01:33:06.658803 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:33:06.658761    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:34:01.658955 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:01.658855    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:34:01.674895 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:01.674867    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:34:02.254317 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:02.254291    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:34:46.722522 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:46.722475    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6rjxp"]
Jul 06 01:34:46.725834 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:46.725811    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6rjxp"
Jul 06 01:34:46.728614 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:46.728585    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-7842w\""
Jul 06 01:34:46.728771 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:46.728637    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 01:34:46.729769 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:46.729750    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 01:34:46.734468 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:46.734427    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6rjxp"]
Jul 06 01:34:46.849426 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:46.849387    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlxs2\" (UniqueName: \"kubernetes.io/projected/96ff114d-9d41-4989-b08e-86f8958a0187-kube-api-access-nlxs2\") pod \"cert-manager-55b4d954d5-6rjxp\" (UID: \"96ff114d-9d41-4989-b08e-86f8958a0187\") " pod="cert-manager/cert-manager-55b4d954d5-6rjxp"
Jul 06 01:34:46.849672 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:46.849470    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96ff114d-9d41-4989-b08e-86f8958a0187-bound-sa-token\") pod \"cert-manager-55b4d954d5-6rjxp\" (UID: \"96ff114d-9d41-4989-b08e-86f8958a0187\") " pod="cert-manager/cert-manager-55b4d954d5-6rjxp"
Jul 06 01:34:46.950154 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:46.950121    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96ff114d-9d41-4989-b08e-86f8958a0187-bound-sa-token\") pod \"cert-manager-55b4d954d5-6rjxp\" (UID: \"96ff114d-9d41-4989-b08e-86f8958a0187\") " pod="cert-manager/cert-manager-55b4d954d5-6rjxp"
Jul 06 01:34:46.950326 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:46.950170    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlxs2\" (UniqueName: \"kubernetes.io/projected/96ff114d-9d41-4989-b08e-86f8958a0187-kube-api-access-nlxs2\") pod \"cert-manager-55b4d954d5-6rjxp\" (UID: \"96ff114d-9d41-4989-b08e-86f8958a0187\") " pod="cert-manager/cert-manager-55b4d954d5-6rjxp"
Jul 06 01:34:46.961846 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:46.961816    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96ff114d-9d41-4989-b08e-86f8958a0187-bound-sa-token\") pod \"cert-manager-55b4d954d5-6rjxp\" (UID: \"96ff114d-9d41-4989-b08e-86f8958a0187\") " pod="cert-manager/cert-manager-55b4d954d5-6rjxp"
Jul 06 01:34:46.962090 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:46.962069    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlxs2\" (UniqueName: \"kubernetes.io/projected/96ff114d-9d41-4989-b08e-86f8958a0187-kube-api-access-nlxs2\") pod \"cert-manager-55b4d954d5-6rjxp\" (UID: \"96ff114d-9d41-4989-b08e-86f8958a0187\") " pod="cert-manager/cert-manager-55b4d954d5-6rjxp"
Jul 06 01:34:47.049099 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:47.049001    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6rjxp"
Jul 06 01:34:47.191958 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:47.191768    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6rjxp"]
Jul 06 01:34:47.194692 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:34:47.194656    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96ff114d_9d41_4989_b08e_86f8958a0187.slice/crio-d0c864a920289f84499e90a968206a14b9d6c47bd2970dee072463c00b5565bd WatchSource:0}: Error finding container d0c864a920289f84499e90a968206a14b9d6c47bd2970dee072463c00b5565bd: Status 404 returned error can't find the container with id d0c864a920289f84499e90a968206a14b9d6c47bd2970dee072463c00b5565bd
Jul 06 01:34:47.411377 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:47.411331    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6rjxp" event={"ID":"96ff114d-9d41-4989-b08e-86f8958a0187","Type":"ContainerStarted","Data":"d0c864a920289f84499e90a968206a14b9d6c47bd2970dee072463c00b5565bd"}
Jul 06 01:34:49.984574 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:49.984539    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hgbpr"]
Jul 06 01:34:49.988347 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:49.988321    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hgbpr"
Jul 06 01:34:49.991216 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:49.991187    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 01:34:49.992351 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:49.992326    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 01:34:49.992480 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:49.992327    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zsgjg\""
Jul 06 01:34:49.995837 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:49.995807    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hgbpr"]
Jul 06 01:34:50.076143 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:50.076095    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c59mk\" (UniqueName: \"kubernetes.io/projected/5e7df46c-b62e-4dda-86d2-f78543840c65-kube-api-access-c59mk\") pod \"openshift-lws-operator-fd8ccff4c-hgbpr\" (UID: \"5e7df46c-b62e-4dda-86d2-f78543840c65\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hgbpr"
Jul 06 01:34:50.076143 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:50.076148    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e7df46c-b62e-4dda-86d2-f78543840c65-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hgbpr\" (UID: \"5e7df46c-b62e-4dda-86d2-f78543840c65\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hgbpr"
Jul 06 01:34:50.176581 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:50.176550    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c59mk\" (UniqueName: \"kubernetes.io/projected/5e7df46c-b62e-4dda-86d2-f78543840c65-kube-api-access-c59mk\") pod \"openshift-lws-operator-fd8ccff4c-hgbpr\" (UID: \"5e7df46c-b62e-4dda-86d2-f78543840c65\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hgbpr"
Jul 06 01:34:50.176761 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:50.176598    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e7df46c-b62e-4dda-86d2-f78543840c65-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hgbpr\" (UID: \"5e7df46c-b62e-4dda-86d2-f78543840c65\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hgbpr"
Jul 06 01:34:50.177012 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:50.176992    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e7df46c-b62e-4dda-86d2-f78543840c65-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hgbpr\" (UID: \"5e7df46c-b62e-4dda-86d2-f78543840c65\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hgbpr"
Jul 06 01:34:50.191331 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:50.191300    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c59mk\" (UniqueName: \"kubernetes.io/projected/5e7df46c-b62e-4dda-86d2-f78543840c65-kube-api-access-c59mk\") pod \"openshift-lws-operator-fd8ccff4c-hgbpr\" (UID: \"5e7df46c-b62e-4dda-86d2-f78543840c65\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hgbpr"
Jul 06 01:34:50.300818 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:50.300726    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hgbpr"
Jul 06 01:34:50.428874 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:50.428839    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6rjxp" event={"ID":"96ff114d-9d41-4989-b08e-86f8958a0187","Type":"ContainerStarted","Data":"96a1271ee7af59c1b384f94809f1246e1cf19ede1e50a595f58eeaf1b93283b2"}
Jul 06 01:34:50.446031 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:50.445977    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-6rjxp" podStartSLOduration=1.543768638 podStartE2EDuration="4.445956713s" totalImagesPullingTime="2.902188075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:34:50.444975594 +0000 UTC m=+498.686743460" watchObservedRunningTime="2026-07-06 01:34:50.445956713 +0000 UTC m=+498.687724579"
Jul 06 01:34:50.460153 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:50.460123    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hgbpr"]
Jul 06 01:34:50.469654 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:34:50.463854    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e7df46c_b62e_4dda_86d2_f78543840c65.slice/crio-1f3ff6bf54ae9778ad6735a5d560d82e13b4e5a8deb61ecb94663ba076b1b4d3 WatchSource:0}: Error finding container 1f3ff6bf54ae9778ad6735a5d560d82e13b4e5a8deb61ecb94663ba076b1b4d3: Status 404 returned error can't find the container with id 1f3ff6bf54ae9778ad6735a5d560d82e13b4e5a8deb61ecb94663ba076b1b4d3
Jul 06 01:34:51.436370 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:51.436320    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hgbpr" event={"ID":"5e7df46c-b62e-4dda-86d2-f78543840c65","Type":"ContainerStarted","Data":"1f3ff6bf54ae9778ad6735a5d560d82e13b4e5a8deb61ecb94663ba076b1b4d3"}
Jul 06 01:34:53.447156 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:53.447072    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hgbpr" event={"ID":"5e7df46c-b62e-4dda-86d2-f78543840c65","Type":"ContainerStarted","Data":"4c03086a65f74b672e16066c2f921424a4f58095f1e833737530b60c0871312b"}
Jul 06 01:34:53.462804 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:34:53.462737    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hgbpr" podStartSLOduration=1.802360088 podStartE2EDuration="4.462714101s" totalImagesPullingTime="2.660354013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:34:53.461865505 +0000 UTC m=+501.703633373" watchObservedRunningTime="2026-07-06 01:34:53.462714101 +0000 UTC m=+501.704481973"
Jul 06 01:35:13.152118 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:13.152075    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6"]
Jul 06 01:35:13.161468 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:13.161438    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6"
Jul 06 01:35:13.165946 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:13.165917    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 01:35:13.166101 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:13.165977    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 01:35:13.166581 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:13.166562    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jrd6l\""
Jul 06 01:35:13.166818 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:13.166802    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 01:35:13.167960 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:13.167935    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 01:35:13.170220 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:13.170197    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6"]
Jul 06 01:35:13.186769 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:13.186736    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/979b8c55-fa28-4af8-ab4b-6942d7fa727a-manifests\") pod \"opendatahub-operator-controller-manager-656987b587-swmw6\" (UID: \"979b8c55-fa28-4af8-ab4b-6942d7fa727a\") " pod="opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6"
Jul 06 01:35:13.186769 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:13.186782    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxxxd\" (UniqueName: \"kubernetes.io/projected/979b8c55-fa28-4af8-ab4b-6942d7fa727a-kube-api-access-bxxxd\") pod \"opendatahub-operator-controller-manager-656987b587-swmw6\" (UID: \"979b8c55-fa28-4af8-ab4b-6942d7fa727a\") " pod="opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6"
Jul 06 01:35:13.187047 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:13.186819    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/979b8c55-fa28-4af8-ab4b-6942d7fa727a-tmp\") pod \"opendatahub-operator-controller-manager-656987b587-swmw6\" (UID: \"979b8c55-fa28-4af8-ab4b-6942d7fa727a\") " pod="opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6"
Jul 06 01:35:13.187047 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:13.186888    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/979b8c55-fa28-4af8-ab4b-6942d7fa727a-webhook-cert\") pod \"opendatahub-operator-controller-manager-656987b587-swmw6\" (UID: \"979b8c55-fa28-4af8-ab4b-6942d7fa727a\") " pod="opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6"
Jul 06 01:35:13.187047 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:13.186951    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/979b8c55-fa28-4af8-ab4b-6942d7fa727a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-656987b587-swmw6\" (UID: \"979b8c55-fa28-4af8-ab4b-6942d7fa727a\") " pod="opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6"
Jul 06 01:35:13.287876 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:13.287834    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/979b8c55-fa28-4af8-ab4b-6942d7fa727a-manifests\") pod \"opendatahub-operator-controller-manager-656987b587-swmw6\" (UID: \"979b8c55-fa28-4af8-ab4b-6942d7fa727a\") " pod="opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6"
Jul 06 01:35:13.288080 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:13.287890    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxxxd\" (UniqueName: \"kubernetes.io/projected/979b8c55-fa28-4af8-ab4b-6942d7fa727a-kube-api-access-bxxxd\") pod \"opendatahub-operator-controller-manager-656987b587-swmw6\" (UID: \"979b8c55-fa28-4af8-ab4b-6942d7fa727a\") " pod="opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6"
Jul 06 01:35:13.288080 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:13.287927    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/979b8c55-fa28-4af8-ab4b-6942d7fa727a-tmp\") pod \"opendatahub-operator-controller-manager-656987b587-swmw6\" (UID: \"979b8c55-fa28-4af8-ab4b-6942d7fa727a\") " pod="opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6"
Jul 06 01:35:13.288080 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:13.287973    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/979b8c55-fa28-4af8-ab4b-6942d7fa727a-webhook-cert\") pod \"opendatahub-operator-controller-manager-656987b587-swmw6\" (UID: \"979b8c55-fa28-4af8-ab4b-6942d7fa727a\") " pod="opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6"
Jul 06 01:35:13.288080 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:13.287998    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/979b8c55-fa28-4af8-ab4b-6942d7fa727a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-656987b587-swmw6\" (UID: \"979b8c55-fa28-4af8-ab4b-6942d7fa727a\") " pod="opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6"
Jul 06 01:35:13.288343 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:13.288313    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/979b8c55-fa28-4af8-ab4b-6942d7fa727a-manifests\") pod \"opendatahub-operator-controller-manager-656987b587-swmw6\" (UID: \"979b8c55-fa28-4af8-ab4b-6942d7fa727a\") " pod="opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6"
Jul 06 01:35:13.290254 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:13.290223    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/979b8c55-fa28-4af8-ab4b-6942d7fa727a-tmp\") pod \"opendatahub-operator-controller-manager-656987b587-swmw6\" (UID: \"979b8c55-fa28-4af8-ab4b-6942d7fa727a\") " pod="opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6"
Jul 06 01:35:13.290529 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:13.290510    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/979b8c55-fa28-4af8-ab4b-6942d7fa727a-webhook-cert\") pod \"opendatahub-operator-controller-manager-656987b587-swmw6\" (UID: \"979b8c55-fa28-4af8-ab4b-6942d7fa727a\") " pod="opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6"
Jul 06 01:35:13.290709 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:13.290690    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/979b8c55-fa28-4af8-ab4b-6942d7fa727a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-656987b587-swmw6\" (UID: \"979b8c55-fa28-4af8-ab4b-6942d7fa727a\") " pod="opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6"
Jul 06 01:35:13.296784 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:13.296751    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxxxd\" (UniqueName: \"kubernetes.io/projected/979b8c55-fa28-4af8-ab4b-6942d7fa727a-kube-api-access-bxxxd\") pod \"opendatahub-operator-controller-manager-656987b587-swmw6\" (UID: \"979b8c55-fa28-4af8-ab4b-6942d7fa727a\") " pod="opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6"
Jul 06 01:35:13.473819 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:13.473729    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6"
Jul 06 01:35:13.660345 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:13.660304    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6"]
Jul 06 01:35:13.664522 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:35:13.664489    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod979b8c55_fa28_4af8_ab4b_6942d7fa727a.slice/crio-a613f881cd97663b375587b1499c286ef7a546c28f94fa4f52bef3ebf44d348b WatchSource:0}: Error finding container a613f881cd97663b375587b1499c286ef7a546c28f94fa4f52bef3ebf44d348b: Status 404 returned error can't find the container with id a613f881cd97663b375587b1499c286ef7a546c28f94fa4f52bef3ebf44d348b
Jul 06 01:35:14.538903 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:14.538861    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6" event={"ID":"979b8c55-fa28-4af8-ab4b-6942d7fa727a","Type":"ContainerStarted","Data":"a613f881cd97663b375587b1499c286ef7a546c28f94fa4f52bef3ebf44d348b"}
Jul 06 01:35:17.555491 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:17.555453    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6" event={"ID":"979b8c55-fa28-4af8-ab4b-6942d7fa727a","Type":"ContainerStarted","Data":"45a6444cf86b81c19193e64ed7c1227bd506d040917b3974683ef4435140af1c"}
Jul 06 01:35:18.562518 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:18.562483    2584 generic.go:356] "Generic (PLEG): container finished" podID="979b8c55-fa28-4af8-ab4b-6942d7fa727a" containerID="45a6444cf86b81c19193e64ed7c1227bd506d040917b3974683ef4435140af1c" exitCode=0
Jul 06 01:35:18.563010 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:18.562578    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6" event={"ID":"979b8c55-fa28-4af8-ab4b-6942d7fa727a","Type":"ContainerDied","Data":"45a6444cf86b81c19193e64ed7c1227bd506d040917b3974683ef4435140af1c"}
Jul 06 01:35:19.568879 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:19.568841    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6" event={"ID":"979b8c55-fa28-4af8-ab4b-6942d7fa727a","Type":"ContainerStarted","Data":"61b206701a1d5e9c319f63b13bc8a8c85fcb4cbad0749814a24419c5c3198eed"}
Jul 06 01:35:19.569276 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:19.568921    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6"
Jul 06 01:35:19.591127 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:19.591070    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6" podStartSLOduration=1.7601179930000002 podStartE2EDuration="6.591051279s" totalImagesPullingTime="3.733888426s" totalInitContainerRuntime="1.09704486s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:35:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:35:19.58887059 +0000 UTC m=+527.830638458" watchObservedRunningTime="2026-07-06 01:35:19.591051279 +0000 UTC m=+527.832819146"
Jul 06 01:35:30.575792 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:30.575713    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-656987b587-swmw6"
Jul 06 01:35:42.683083 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:42.683016    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-577bbf7cf9-rgkbw"]
Jul 06 01:35:42.687919 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:42.687890    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-577bbf7cf9-rgkbw"
Jul 06 01:35:42.692194 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:42.692168    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 01:35:42.692361 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:42.692168    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 01:35:42.692361 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:42.692261    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 01:35:42.692361 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:42.692295    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-c52pm\""
Jul 06 01:35:42.696312 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:42.696256    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-577bbf7cf9-rgkbw"]
Jul 06 01:35:42.855805 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:42.855765    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa5bc261-545c-40c0-8e7c-ae4578ddeb44-metrics-cert\") pod \"lws-controller-manager-577bbf7cf9-rgkbw\" (UID: \"fa5bc261-545c-40c0-8e7c-ae4578ddeb44\") " pod="openshift-lws-operator/lws-controller-manager-577bbf7cf9-rgkbw"
Jul 06 01:35:42.855805 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:42.855806    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8rmx\" (UniqueName: \"kubernetes.io/projected/fa5bc261-545c-40c0-8e7c-ae4578ddeb44-kube-api-access-g8rmx\") pod \"lws-controller-manager-577bbf7cf9-rgkbw\" (UID: \"fa5bc261-545c-40c0-8e7c-ae4578ddeb44\") " pod="openshift-lws-operator/lws-controller-manager-577bbf7cf9-rgkbw"
Jul 06 01:35:42.856026 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:42.855838    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fa5bc261-545c-40c0-8e7c-ae4578ddeb44-manager-config\") pod \"lws-controller-manager-577bbf7cf9-rgkbw\" (UID: \"fa5bc261-545c-40c0-8e7c-ae4578ddeb44\") " pod="openshift-lws-operator/lws-controller-manager-577bbf7cf9-rgkbw"
Jul 06 01:35:42.856026 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:42.855955    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa5bc261-545c-40c0-8e7c-ae4578ddeb44-cert\") pod \"lws-controller-manager-577bbf7cf9-rgkbw\" (UID: \"fa5bc261-545c-40c0-8e7c-ae4578ddeb44\") " pod="openshift-lws-operator/lws-controller-manager-577bbf7cf9-rgkbw"
Jul 06 01:35:42.957261 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:42.957158    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fa5bc261-545c-40c0-8e7c-ae4578ddeb44-manager-config\") pod \"lws-controller-manager-577bbf7cf9-rgkbw\" (UID: \"fa5bc261-545c-40c0-8e7c-ae4578ddeb44\") " pod="openshift-lws-operator/lws-controller-manager-577bbf7cf9-rgkbw"
Jul 06 01:35:42.957261 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:42.957239    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa5bc261-545c-40c0-8e7c-ae4578ddeb44-cert\") pod \"lws-controller-manager-577bbf7cf9-rgkbw\" (UID: \"fa5bc261-545c-40c0-8e7c-ae4578ddeb44\") " pod="openshift-lws-operator/lws-controller-manager-577bbf7cf9-rgkbw"
Jul 06 01:35:42.957514 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:42.957271    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa5bc261-545c-40c0-8e7c-ae4578ddeb44-metrics-cert\") pod \"lws-controller-manager-577bbf7cf9-rgkbw\" (UID: \"fa5bc261-545c-40c0-8e7c-ae4578ddeb44\") " pod="openshift-lws-operator/lws-controller-manager-577bbf7cf9-rgkbw"
Jul 06 01:35:42.957514 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:42.957289    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8rmx\" (UniqueName: \"kubernetes.io/projected/fa5bc261-545c-40c0-8e7c-ae4578ddeb44-kube-api-access-g8rmx\") pod \"lws-controller-manager-577bbf7cf9-rgkbw\" (UID: \"fa5bc261-545c-40c0-8e7c-ae4578ddeb44\") " pod="openshift-lws-operator/lws-controller-manager-577bbf7cf9-rgkbw"
Jul 06 01:35:42.957917 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:42.957892    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fa5bc261-545c-40c0-8e7c-ae4578ddeb44-manager-config\") pod \"lws-controller-manager-577bbf7cf9-rgkbw\" (UID: \"fa5bc261-545c-40c0-8e7c-ae4578ddeb44\") " pod="openshift-lws-operator/lws-controller-manager-577bbf7cf9-rgkbw"
Jul 06 01:35:42.959871 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:42.959840    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa5bc261-545c-40c0-8e7c-ae4578ddeb44-cert\") pod \"lws-controller-manager-577bbf7cf9-rgkbw\" (UID: \"fa5bc261-545c-40c0-8e7c-ae4578ddeb44\") " pod="openshift-lws-operator/lws-controller-manager-577bbf7cf9-rgkbw"
Jul 06 01:35:42.959975 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:42.959882    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa5bc261-545c-40c0-8e7c-ae4578ddeb44-metrics-cert\") pod \"lws-controller-manager-577bbf7cf9-rgkbw\" (UID: \"fa5bc261-545c-40c0-8e7c-ae4578ddeb44\") " pod="openshift-lws-operator/lws-controller-manager-577bbf7cf9-rgkbw"
Jul 06 01:35:42.974041 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:42.974008    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8rmx\" (UniqueName: \"kubernetes.io/projected/fa5bc261-545c-40c0-8e7c-ae4578ddeb44-kube-api-access-g8rmx\") pod \"lws-controller-manager-577bbf7cf9-rgkbw\" (UID: \"fa5bc261-545c-40c0-8e7c-ae4578ddeb44\") " pod="openshift-lws-operator/lws-controller-manager-577bbf7cf9-rgkbw"
Jul 06 01:35:43.000829 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:43.000788    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-577bbf7cf9-rgkbw"
Jul 06 01:35:43.146831 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:43.146574    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-577bbf7cf9-rgkbw"]
Jul 06 01:35:43.150839 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:35:43.150119    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa5bc261_545c_40c0_8e7c_ae4578ddeb44.slice/crio-c3bdbabe6b41553b86a866d939125a0949e1838bac8d53e8af1cbeeba80affd6 WatchSource:0}: Error finding container c3bdbabe6b41553b86a866d939125a0949e1838bac8d53e8af1cbeeba80affd6: Status 404 returned error can't find the container with id c3bdbabe6b41553b86a866d939125a0949e1838bac8d53e8af1cbeeba80affd6
Jul 06 01:35:43.677869 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:43.677832    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-577bbf7cf9-rgkbw" event={"ID":"fa5bc261-545c-40c0-8e7c-ae4578ddeb44","Type":"ContainerStarted","Data":"c3bdbabe6b41553b86a866d939125a0949e1838bac8d53e8af1cbeeba80affd6"}
Jul 06 01:35:44.138147 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:44.138107    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-knc5n"]
Jul 06 01:35:44.141979 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:44.141951    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-knc5n"
Jul 06 01:35:44.145027 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:44.144995    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 06 01:35:44.145027 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:44.145015    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-msgbs\""
Jul 06 01:35:44.154153 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:44.154119    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-knc5n"]
Jul 06 01:35:44.269726 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:44.269690    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mssd9\" (UniqueName: \"kubernetes.io/projected/e170b11b-fc61-4699-b458-df23029d6cd9-kube-api-access-mssd9\") pod \"kserve-controller-manager-d6f4b65b8-knc5n\" (UID: \"e170b11b-fc61-4699-b458-df23029d6cd9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-knc5n"
Jul 06 01:35:44.269909 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:44.269744    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e170b11b-fc61-4699-b458-df23029d6cd9-cert\") pod \"kserve-controller-manager-d6f4b65b8-knc5n\" (UID: \"e170b11b-fc61-4699-b458-df23029d6cd9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-knc5n"
Jul 06 01:35:44.370620 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:44.370582    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mssd9\" (UniqueName: \"kubernetes.io/projected/e170b11b-fc61-4699-b458-df23029d6cd9-kube-api-access-mssd9\") pod \"kserve-controller-manager-d6f4b65b8-knc5n\" (UID: \"e170b11b-fc61-4699-b458-df23029d6cd9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-knc5n"
Jul 06 01:35:44.370841 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:44.370649    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e170b11b-fc61-4699-b458-df23029d6cd9-cert\") pod \"kserve-controller-manager-d6f4b65b8-knc5n\" (UID: \"e170b11b-fc61-4699-b458-df23029d6cd9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-knc5n"
Jul 06 01:35:44.370841 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:35:44.370799    2584 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 06 01:35:44.370959 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:35:44.370865    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e170b11b-fc61-4699-b458-df23029d6cd9-cert podName:e170b11b-fc61-4699-b458-df23029d6cd9 nodeName:}" failed. No retries permitted until 2026-07-06 01:35:44.870843672 +0000 UTC m=+553.112611517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e170b11b-fc61-4699-b458-df23029d6cd9-cert") pod "kserve-controller-manager-d6f4b65b8-knc5n" (UID: "e170b11b-fc61-4699-b458-df23029d6cd9") : secret "kserve-webhook-server-cert" not found
Jul 06 01:35:44.420651 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:44.420543    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mssd9\" (UniqueName: \"kubernetes.io/projected/e170b11b-fc61-4699-b458-df23029d6cd9-kube-api-access-mssd9\") pod \"kserve-controller-manager-d6f4b65b8-knc5n\" (UID: \"e170b11b-fc61-4699-b458-df23029d6cd9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-knc5n"
Jul 06 01:35:44.876341 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:44.876303    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e170b11b-fc61-4699-b458-df23029d6cd9-cert\") pod \"kserve-controller-manager-d6f4b65b8-knc5n\" (UID: \"e170b11b-fc61-4699-b458-df23029d6cd9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-knc5n"
Jul 06 01:35:44.879159 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:44.879130    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e170b11b-fc61-4699-b458-df23029d6cd9-cert\") pod \"kserve-controller-manager-d6f4b65b8-knc5n\" (UID: \"e170b11b-fc61-4699-b458-df23029d6cd9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-knc5n"
Jul 06 01:35:45.058435 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:45.058388    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-knc5n"
Jul 06 01:35:45.226346 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:45.226277    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-knc5n"]
Jul 06 01:35:45.229259 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:35:45.229216    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode170b11b_fc61_4699_b458_df23029d6cd9.slice/crio-fc65a2f34204b59674fac456250f8970a0aa74d305fde295bb7c8f9e65df7b9e WatchSource:0}: Error finding container fc65a2f34204b59674fac456250f8970a0aa74d305fde295bb7c8f9e65df7b9e: Status 404 returned error can't find the container with id fc65a2f34204b59674fac456250f8970a0aa74d305fde295bb7c8f9e65df7b9e
Jul 06 01:35:45.689593 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:45.689554    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-577bbf7cf9-rgkbw" event={"ID":"fa5bc261-545c-40c0-8e7c-ae4578ddeb44","Type":"ContainerStarted","Data":"4bfb3823a8a8489efa29e31d98648122b565660b8ddb4ec978c1e11fefd25ebe"}
Jul 06 01:35:45.689828 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:45.689713    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-577bbf7cf9-rgkbw"
Jul 06 01:35:45.690911 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:45.690853    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-knc5n" event={"ID":"e170b11b-fc61-4699-b458-df23029d6cd9","Type":"ContainerStarted","Data":"fc65a2f34204b59674fac456250f8970a0aa74d305fde295bb7c8f9e65df7b9e"}
Jul 06 01:35:45.707578 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:45.707522    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-577bbf7cf9-rgkbw" podStartSLOduration=1.774353417 podStartE2EDuration="3.707499245s" totalImagesPullingTime="1.933145828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:35:45.706793198 +0000 UTC m=+553.948561066" watchObservedRunningTime="2026-07-06 01:35:45.707499245 +0000 UTC m=+553.949267112"
Jul 06 01:35:48.706833 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:48.706791    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-knc5n" event={"ID":"e170b11b-fc61-4699-b458-df23029d6cd9","Type":"ContainerStarted","Data":"43bf5a9558e087fa8998e7f90e4adf771c642e07b0d4404d74b35bc014a3913f"}
Jul 06 01:35:48.707284 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:48.706925    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-knc5n"
Jul 06 01:35:48.732517 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:48.732459    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-knc5n" podStartSLOduration=2.103023237 podStartE2EDuration="4.732443631s" totalImagesPullingTime="2.629420394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:35:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:35:48.732142076 +0000 UTC m=+556.973909943" watchObservedRunningTime="2026-07-06 01:35:48.732443631 +0000 UTC m=+556.974211499"
Jul 06 01:35:56.697857 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:35:56.697824    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-577bbf7cf9-rgkbw"
Jul 06 01:36:19.718182 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:36:19.718150    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-knc5n"
Jul 06 01:36:34.040550 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:36:34.040507    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qhqmm"]
Jul 06 01:36:34.043889 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:36:34.043867    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qhqmm"
Jul 06 01:36:34.046657 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:36:34.046601    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 01:36:34.046657 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:36:34.046620    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-md2s8\""
Jul 06 01:36:34.046869 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:36:34.046669    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 01:36:34.057570 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:36:34.057535    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qhqmm"]
Jul 06 01:36:34.200354 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:36:34.200316    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6z66\" (UniqueName: \"kubernetes.io/projected/60d535b5-353a-41c8-ab1f-e1cb511cb9c1-kube-api-access-j6z66\") pod \"kuadrant-operator-catalog-qhqmm\" (UID: \"60d535b5-353a-41c8-ab1f-e1cb511cb9c1\") " pod="kuadrant-system/kuadrant-operator-catalog-qhqmm"
Jul 06 01:36:34.301487 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:36:34.301398    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6z66\" (UniqueName: \"kubernetes.io/projected/60d535b5-353a-41c8-ab1f-e1cb511cb9c1-kube-api-access-j6z66\") pod \"kuadrant-operator-catalog-qhqmm\" (UID: \"60d535b5-353a-41c8-ab1f-e1cb511cb9c1\") " pod="kuadrant-system/kuadrant-operator-catalog-qhqmm"
Jul 06 01:36:34.309530 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:36:34.309493    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6z66\" (UniqueName: \"kubernetes.io/projected/60d535b5-353a-41c8-ab1f-e1cb511cb9c1-kube-api-access-j6z66\") pod \"kuadrant-operator-catalog-qhqmm\" (UID: \"60d535b5-353a-41c8-ab1f-e1cb511cb9c1\") " pod="kuadrant-system/kuadrant-operator-catalog-qhqmm"
Jul 06 01:36:34.356693 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:36:34.356654    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qhqmm"
Jul 06 01:36:34.491061 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:36:34.491036    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qhqmm"]
Jul 06 01:36:34.493241 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:36:34.493210    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d535b5_353a_41c8_ab1f_e1cb511cb9c1.slice/crio-f1d2d247bc12907d479e8e008e92ba82f4d802ded032e66e8c06e3f151d27396 WatchSource:0}: Error finding container f1d2d247bc12907d479e8e008e92ba82f4d802ded032e66e8c06e3f151d27396: Status 404 returned error can't find the container with id f1d2d247bc12907d479e8e008e92ba82f4d802ded032e66e8c06e3f151d27396
Jul 06 01:36:34.924550 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:36:34.924513    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qhqmm" event={"ID":"60d535b5-353a-41c8-ab1f-e1cb511cb9c1","Type":"ContainerStarted","Data":"f1d2d247bc12907d479e8e008e92ba82f4d802ded032e66e8c06e3f151d27396"}
Jul 06 01:36:36.937882 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:36:36.937782    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qhqmm" event={"ID":"60d535b5-353a-41c8-ab1f-e1cb511cb9c1","Type":"ContainerStarted","Data":"6ceade9210b9e0e5c7608c8c4cbf68a5c94964f2156e6dcd8c65afe2cbd03aa9"}
Jul 06 01:36:36.955230 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:36:36.955169    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qhqmm" podStartSLOduration=0.814076176 podStartE2EDuration="2.955151332s" totalImagesPullingTime="2.141075156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:36:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:36:36.953721926 +0000 UTC m=+605.195489794" watchObservedRunningTime="2026-07-06 01:36:36.955151332 +0000 UTC m=+605.196919198"
Jul 06 01:36:44.356784 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:36:44.356750    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-qhqmm"
Jul 06 01:36:44.357211 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:36:44.356832    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-qhqmm"
Jul 06 01:36:44.379459 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:36:44.379425    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-qhqmm"
Jul 06 01:36:45.005234 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:36:45.005207    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-qhqmm"
Jul 06 01:37:06.087202 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:06.087165    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch"]
Jul 06 01:37:06.090618 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:06.090600    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch"
Jul 06 01:37:06.093273 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:06.093251    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xkfc6\""
Jul 06 01:37:06.102894 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:06.102863    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch"]
Jul 06 01:37:06.166161 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:06.166113    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dnvd\" (UniqueName: \"kubernetes.io/projected/7ca4a165-4727-48c6-af9b-27eaa5c93767-kube-api-access-4dnvd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sjgch\" (UID: \"7ca4a165-4727-48c6-af9b-27eaa5c93767\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch"
Jul 06 01:37:06.166352 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:06.166177    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ca4a165-4727-48c6-af9b-27eaa5c93767-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sjgch\" (UID: \"7ca4a165-4727-48c6-af9b-27eaa5c93767\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch"
Jul 06 01:37:06.267598 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:06.267547    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dnvd\" (UniqueName: \"kubernetes.io/projected/7ca4a165-4727-48c6-af9b-27eaa5c93767-kube-api-access-4dnvd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sjgch\" (UID: \"7ca4a165-4727-48c6-af9b-27eaa5c93767\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch"
Jul 06 01:37:06.267774 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:06.267606    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ca4a165-4727-48c6-af9b-27eaa5c93767-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sjgch\" (UID: \"7ca4a165-4727-48c6-af9b-27eaa5c93767\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch"
Jul 06 01:37:06.268019 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:06.268002    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ca4a165-4727-48c6-af9b-27eaa5c93767-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sjgch\" (UID: \"7ca4a165-4727-48c6-af9b-27eaa5c93767\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch"
Jul 06 01:37:06.283551 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:06.283515    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dnvd\" (UniqueName: \"kubernetes.io/projected/7ca4a165-4727-48c6-af9b-27eaa5c93767-kube-api-access-4dnvd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sjgch\" (UID: \"7ca4a165-4727-48c6-af9b-27eaa5c93767\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch"
Jul 06 01:37:06.400883 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:06.400839    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch"
Jul 06 01:37:06.546592 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:06.546556    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch"]
Jul 06 01:37:06.549555 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:37:06.549519    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ca4a165_4727_48c6_af9b_27eaa5c93767.slice/crio-c2bf1d7e80dcf5b6f53370669859d80d9f2f4cb2fedc1a0c8557c09a5f447c39 WatchSource:0}: Error finding container c2bf1d7e80dcf5b6f53370669859d80d9f2f4cb2fedc1a0c8557c09a5f447c39: Status 404 returned error can't find the container with id c2bf1d7e80dcf5b6f53370669859d80d9f2f4cb2fedc1a0c8557c09a5f447c39
Jul 06 01:37:06.552296 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:06.552275    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 01:37:07.084753 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:07.084715    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch" event={"ID":"7ca4a165-4727-48c6-af9b-27eaa5c93767","Type":"ContainerStarted","Data":"c2bf1d7e80dcf5b6f53370669859d80d9f2f4cb2fedc1a0c8557c09a5f447c39"}
Jul 06 01:37:13.117745 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:13.117701    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch" event={"ID":"7ca4a165-4727-48c6-af9b-27eaa5c93767","Type":"ContainerStarted","Data":"92b2c3f403046a2cf443eea13e8f1828c66ddec6e64e48c83467e0037dc1ade3"}
Jul 06 01:37:13.118187 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:13.117863    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch"
Jul 06 01:37:13.145864 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:13.145803    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch" podStartSLOduration=1.2902723090000001 podStartE2EDuration="7.145784393s" totalImagesPullingTime="5.855512084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:37:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:37:13.144155662 +0000 UTC m=+641.385923533" watchObservedRunningTime="2026-07-06 01:37:13.145784393 +0000 UTC m=+641.387552329"
Jul 06 01:37:14.169577 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:14.169539    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgwxk"]
Jul 06 01:37:14.172971 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:14.172950    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgwxk"
Jul 06 01:37:14.175530 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:14.175510    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5sc8w\""
Jul 06 01:37:14.183140 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:14.183111    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgwxk"]
Jul 06 01:37:14.240817 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:14.240771    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4dtf\" (UniqueName: \"kubernetes.io/projected/6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3-kube-api-access-k4dtf\") pod \"limitador-operator-controller-manager-859d7b78bd-rgwxk\" (UID: \"6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgwxk"
Jul 06 01:37:14.341602 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:14.341554    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4dtf\" (UniqueName: \"kubernetes.io/projected/6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3-kube-api-access-k4dtf\") pod \"limitador-operator-controller-manager-859d7b78bd-rgwxk\" (UID: \"6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgwxk"
Jul 06 01:37:14.352392 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:14.352357    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4dtf\" (UniqueName: \"kubernetes.io/projected/6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3-kube-api-access-k4dtf\") pod \"limitador-operator-controller-manager-859d7b78bd-rgwxk\" (UID: \"6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgwxk"
Jul 06 01:37:14.484583 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:14.484468    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgwxk"
Jul 06 01:37:14.634346 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:14.634313    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgwxk"]
Jul 06 01:37:14.638187 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:37:14.638156    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6558ecf2_fe72_4d8e_9f62_a2ab9bc11bb3.slice/crio-420557e49718f11b75cc621f04f7e38fd9c5419d76b4b97a9f9525578419a0a9 WatchSource:0}: Error finding container 420557e49718f11b75cc621f04f7e38fd9c5419d76b4b97a9f9525578419a0a9: Status 404 returned error can't find the container with id 420557e49718f11b75cc621f04f7e38fd9c5419d76b4b97a9f9525578419a0a9
Jul 06 01:37:15.129075 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:15.129037    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgwxk" event={"ID":"6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3","Type":"ContainerStarted","Data":"420557e49718f11b75cc621f04f7e38fd9c5419d76b4b97a9f9525578419a0a9"}
Jul 06 01:37:17.141385 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:17.141343    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgwxk" event={"ID":"6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3","Type":"ContainerStarted","Data":"49e6194ecb952cf50a3df1d3ce5652942ae932b1f268101e9267ac4aa2832588"}
Jul 06 01:37:17.141816 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:17.141422    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgwxk"
Jul 06 01:37:17.159121 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:17.159062    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgwxk" podStartSLOduration=1.574849787 podStartE2EDuration="3.15904436s" totalImagesPullingTime="1.584194573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:37:17.158056837 +0000 UTC m=+645.399824703" watchObservedRunningTime="2026-07-06 01:37:17.15904436 +0000 UTC m=+645.400812227"
Jul 06 01:37:24.125060 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:24.125029    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch"
Jul 06 01:37:25.995772 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:25.995729    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-749ch"]
Jul 06 01:37:25.999639 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:25.999603    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-749ch"
Jul 06 01:37:26.017470 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.017434    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-749ch"]
Jul 06 01:37:26.101257 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.101223    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch"]
Jul 06 01:37:26.101474 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.101435    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch" podUID="7ca4a165-4727-48c6-af9b-27eaa5c93767" containerName="manager" containerID="cri-o://92b2c3f403046a2cf443eea13e8f1828c66ddec6e64e48c83467e0037dc1ade3" gracePeriod=2
Jul 06 01:37:26.116713 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.116681    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch"]
Jul 06 01:37:26.123190 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:37:26.123155    2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"7ca4a165-4727-48c6-af9b-27eaa5c93767\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-sjgch\": pods \"kuadrant-operator-controller-manager-8684c9ff49-sjgch\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch"
Jul 06 01:37:26.130750 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.130717    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-749ch"]
Jul 06 01:37:26.131073 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:37:26.131039    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-f4mp2], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-749ch" podUID="ab06b76a-329b-4b90-ad59-165c7b22a8b8"
Jul 06 01:37:26.132539 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.132512    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-749ch"]
Jul 06 01:37:26.146803 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.146772    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgwxk"]
Jul 06 01:37:26.146983 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.146957    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgwxk" podUID="6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3" containerName="manager" containerID="cri-o://49e6194ecb952cf50a3df1d3ce5652942ae932b1f268101e9267ac4aa2832588" gracePeriod=2
Jul 06 01:37:26.149032 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.149009    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgwxk"
Jul 06 01:37:26.149307 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:37:26.149278    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sjgch\" is forbidden: User \"system:node:ip-10-0-128-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-8.ec2.internal' and this object" podUID="7ca4a165-4727-48c6-af9b-27eaa5c93767" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch"
Jul 06 01:37:26.152753 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.152726    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4mp2\" (UniqueName: \"kubernetes.io/projected/ab06b76a-329b-4b90-ad59-165c7b22a8b8-kube-api-access-f4mp2\") pod \"kuadrant-operator-controller-manager-86878c769f-749ch\" (UID: \"ab06b76a-329b-4b90-ad59-165c7b22a8b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-749ch"
Jul 06 01:37:26.152921 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.152817    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab06b76a-329b-4b90-ad59-165c7b22a8b8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-749ch\" (UID: \"ab06b76a-329b-4b90-ad59-165c7b22a8b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-749ch"
Jul 06 01:37:26.165709 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.165589    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgwxk"]
Jul 06 01:37:26.168550 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.168517    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t47z"]
Jul 06 01:37:26.169105 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.169018    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3" containerName="manager"
Jul 06 01:37:26.169105 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.169041    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3" containerName="manager"
Jul 06 01:37:26.169105 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.169062    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ca4a165-4727-48c6-af9b-27eaa5c93767" containerName="manager"
Jul 06 01:37:26.169105 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.169071    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ca4a165-4727-48c6-af9b-27eaa5c93767" containerName="manager"
Jul 06 01:37:26.169554 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.169168    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3" containerName="manager"
Jul 06 01:37:26.169554 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.169180    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ca4a165-4727-48c6-af9b-27eaa5c93767" containerName="manager"
Jul 06 01:37:26.172418 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.172397    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn692"]
Jul 06 01:37:26.172593 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.172528    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t47z"
Jul 06 01:37:26.173197 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:37:26.173162    2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-rgwxk\": pods \"limitador-operator-controller-manager-859d7b78bd-rgwxk\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgwxk"
Jul 06 01:37:26.175576 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.175558    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn692"
Jul 06 01:37:26.178222 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:37:26.178196    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rgwxk\" is forbidden: User \"system:node:ip-10-0-128-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-8.ec2.internal' and this object" podUID="6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgwxk"
Jul 06 01:37:26.180831 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:37:26.180804    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sjgch\" is forbidden: User \"system:node:ip-10-0-128-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-8.ec2.internal' and this object" podUID="7ca4a165-4727-48c6-af9b-27eaa5c93767" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch"
Jul 06 01:37:26.184854 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.184830    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-749ch"
Jul 06 01:37:26.190363 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.190272    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t47z"]
Jul 06 01:37:26.192203 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.192178    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn692"]
Jul 06 01:37:26.206282 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:37:26.206247    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-749ch\" is forbidden: User \"system:node:ip-10-0-128-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-8.ec2.internal' and this object" podUID="ab06b76a-329b-4b90-ad59-165c7b22a8b8" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-749ch"
Jul 06 01:37:26.208487 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:37:26.208452    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rgwxk\" is forbidden: User \"system:node:ip-10-0-128-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-8.ec2.internal' and this object" podUID="6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgwxk"
Jul 06 01:37:26.210692 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:37:26.210665    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sjgch\" is forbidden: User \"system:node:ip-10-0-128-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-8.ec2.internal' and this object" podUID="7ca4a165-4727-48c6-af9b-27eaa5c93767" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch"
Jul 06 01:37:26.253320 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.253292    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4mp2\" (UniqueName: \"kubernetes.io/projected/ab06b76a-329b-4b90-ad59-165c7b22a8b8-kube-api-access-f4mp2\") pod \"kuadrant-operator-controller-manager-86878c769f-749ch\" (UID: \"ab06b76a-329b-4b90-ad59-165c7b22a8b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-749ch"
Jul 06 01:37:26.253494 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.253353    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab06b76a-329b-4b90-ad59-165c7b22a8b8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-749ch\" (UID: \"ab06b76a-329b-4b90-ad59-165c7b22a8b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-749ch"
Jul 06 01:37:26.253673 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.253620    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab06b76a-329b-4b90-ad59-165c7b22a8b8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-749ch\" (UID: \"ab06b76a-329b-4b90-ad59-165c7b22a8b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-749ch"
Jul 06 01:37:26.255189 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.255164    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-749ch"
Jul 06 01:37:26.257972 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:37:26.257934    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-749ch\" is forbidden: User \"system:node:ip-10-0-128-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-8.ec2.internal' and this object" podUID="ab06b76a-329b-4b90-ad59-165c7b22a8b8" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-749ch"
Jul 06 01:37:26.260009 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:37:26.259986    2584 projected.go:196] Error preparing data for projected volume kube-api-access-f4mp2 for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-749ch: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-749ch" not found
Jul 06 01:37:26.260125 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:37:26.260066    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab06b76a-329b-4b90-ad59-165c7b22a8b8-kube-api-access-f4mp2 podName:ab06b76a-329b-4b90-ad59-165c7b22a8b8 nodeName:}" failed. No retries permitted until 2026-07-06 01:37:26.760048884 +0000 UTC m=+655.001816728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f4mp2" (UniqueName: "kubernetes.io/projected/ab06b76a-329b-4b90-ad59-165c7b22a8b8-kube-api-access-f4mp2") pod "kuadrant-operator-controller-manager-86878c769f-749ch" (UID: "ab06b76a-329b-4b90-ad59-165c7b22a8b8") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-749ch" not found
Jul 06 01:37:26.260506 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:37:26.260480    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rgwxk\" is forbidden: User \"system:node:ip-10-0-128-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-8.ec2.internal' and this object" podUID="6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgwxk"
Jul 06 01:37:26.263016 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:37:26.262986    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sjgch\" is forbidden: User \"system:node:ip-10-0-128-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-8.ec2.internal' and this object" podUID="7ca4a165-4727-48c6-af9b-27eaa5c93767" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch"
Jul 06 01:37:26.354222 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.354191    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab06b76a-329b-4b90-ad59-165c7b22a8b8-extensions-socket-volume\") pod \"ab06b76a-329b-4b90-ad59-165c7b22a8b8\" (UID: \"ab06b76a-329b-4b90-ad59-165c7b22a8b8\") "
Jul 06 01:37:26.354417 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.354388    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qbxm\" (UniqueName: \"kubernetes.io/projected/4afa8d3a-6b8f-4efe-ad95-c4ec785eccb9-kube-api-access-8qbxm\") pod \"limitador-operator-controller-manager-859d7b78bd-gn692\" (UID: \"4afa8d3a-6b8f-4efe-ad95-c4ec785eccb9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn692"
Jul 06 01:37:26.354486 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.354426    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db63ce85-b232-4f80-9d3b-7a72302805f2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7t47z\" (UID: \"db63ce85-b232-4f80-9d3b-7a72302805f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t47z"
Jul 06 01:37:26.354486 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.354456    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk655\" (UniqueName: \"kubernetes.io/projected/db63ce85-b232-4f80-9d3b-7a72302805f2-kube-api-access-lk655\") pod \"kuadrant-operator-controller-manager-86878c769f-7t47z\" (UID: \"db63ce85-b232-4f80-9d3b-7a72302805f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t47z"
Jul 06 01:37:26.354486 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.354456    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab06b76a-329b-4b90-ad59-165c7b22a8b8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ab06b76a-329b-4b90-ad59-165c7b22a8b8" (UID: "ab06b76a-329b-4b90-ad59-165c7b22a8b8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:37:26.354664 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.354525    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4mp2\" (UniqueName: \"kubernetes.io/projected/ab06b76a-329b-4b90-ad59-165c7b22a8b8-kube-api-access-f4mp2\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:37:26.398302 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.398272    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch"
Jul 06 01:37:26.400872 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:37:26.400841    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-749ch\" is forbidden: User \"system:node:ip-10-0-128-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-8.ec2.internal' and this object" podUID="ab06b76a-329b-4b90-ad59-165c7b22a8b8" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-749ch"
Jul 06 01:37:26.401303 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.401282    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgwxk"
Jul 06 01:37:26.403047 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:37:26.403022    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rgwxk\" is forbidden: User \"system:node:ip-10-0-128-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-8.ec2.internal' and this object" podUID="6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgwxk"
Jul 06 01:37:26.406098 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:37:26.406071    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sjgch\" is forbidden: User \"system:node:ip-10-0-128-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-8.ec2.internal' and this object" podUID="7ca4a165-4727-48c6-af9b-27eaa5c93767" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch"
Jul 06 01:37:26.408560 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:37:26.408536    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-749ch\" is forbidden: User \"system:node:ip-10-0-128-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-8.ec2.internal' and this object" podUID="ab06b76a-329b-4b90-ad59-165c7b22a8b8" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-749ch"
Jul 06 01:37:26.410775 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:37:26.410753    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rgwxk\" is forbidden: User \"system:node:ip-10-0-128-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-8.ec2.internal' and this object" podUID="6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgwxk"
Jul 06 01:37:26.413371 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:37:26.413345    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sjgch\" is forbidden: User \"system:node:ip-10-0-128-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-8.ec2.internal' and this object" podUID="7ca4a165-4727-48c6-af9b-27eaa5c93767" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch"
Jul 06 01:37:26.455538 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.455506    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qbxm\" (UniqueName: \"kubernetes.io/projected/4afa8d3a-6b8f-4efe-ad95-c4ec785eccb9-kube-api-access-8qbxm\") pod \"limitador-operator-controller-manager-859d7b78bd-gn692\" (UID: \"4afa8d3a-6b8f-4efe-ad95-c4ec785eccb9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn692"
Jul 06 01:37:26.455752 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.455560    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db63ce85-b232-4f80-9d3b-7a72302805f2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7t47z\" (UID: \"db63ce85-b232-4f80-9d3b-7a72302805f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t47z"
Jul 06 01:37:26.455752 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.455593    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk655\" (UniqueName: \"kubernetes.io/projected/db63ce85-b232-4f80-9d3b-7a72302805f2-kube-api-access-lk655\") pod \"kuadrant-operator-controller-manager-86878c769f-7t47z\" (UID: \"db63ce85-b232-4f80-9d3b-7a72302805f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t47z"
Jul 06 01:37:26.455752 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.455720    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab06b76a-329b-4b90-ad59-165c7b22a8b8-extensions-socket-volume\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:37:26.456071 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.456047    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db63ce85-b232-4f80-9d3b-7a72302805f2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7t47z\" (UID: \"db63ce85-b232-4f80-9d3b-7a72302805f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t47z"
Jul 06 01:37:26.473751 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.473719    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qbxm\" (UniqueName: \"kubernetes.io/projected/4afa8d3a-6b8f-4efe-ad95-c4ec785eccb9-kube-api-access-8qbxm\") pod \"limitador-operator-controller-manager-859d7b78bd-gn692\" (UID: \"4afa8d3a-6b8f-4efe-ad95-c4ec785eccb9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn692"
Jul 06 01:37:26.476412 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.476383    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk655\" (UniqueName: \"kubernetes.io/projected/db63ce85-b232-4f80-9d3b-7a72302805f2-kube-api-access-lk655\") pod \"kuadrant-operator-controller-manager-86878c769f-7t47z\" (UID: \"db63ce85-b232-4f80-9d3b-7a72302805f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t47z"
Jul 06 01:37:26.545386 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.545293    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t47z"
Jul 06 01:37:26.554862 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.554828    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn692"
Jul 06 01:37:26.555950 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.555923    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ca4a165-4727-48c6-af9b-27eaa5c93767-extensions-socket-volume\") pod \"7ca4a165-4727-48c6-af9b-27eaa5c93767\" (UID: \"7ca4a165-4727-48c6-af9b-27eaa5c93767\") "
Jul 06 01:37:26.556099 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.556051    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dnvd\" (UniqueName: \"kubernetes.io/projected/7ca4a165-4727-48c6-af9b-27eaa5c93767-kube-api-access-4dnvd\") pod \"7ca4a165-4727-48c6-af9b-27eaa5c93767\" (UID: \"7ca4a165-4727-48c6-af9b-27eaa5c93767\") "
Jul 06 01:37:26.556099 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.556087    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4dtf\" (UniqueName: \"kubernetes.io/projected/6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3-kube-api-access-k4dtf\") pod \"6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3\" (UID: \"6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3\") "
Jul 06 01:37:26.556516 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.556480    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ca4a165-4727-48c6-af9b-27eaa5c93767-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7ca4a165-4727-48c6-af9b-27eaa5c93767" (UID: "7ca4a165-4727-48c6-af9b-27eaa5c93767"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:37:26.558396 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.558375    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ca4a165-4727-48c6-af9b-27eaa5c93767-kube-api-access-4dnvd" (OuterVolumeSpecName: "kube-api-access-4dnvd") pod "7ca4a165-4727-48c6-af9b-27eaa5c93767" (UID: "7ca4a165-4727-48c6-af9b-27eaa5c93767"). InnerVolumeSpecName "kube-api-access-4dnvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:37:26.558538 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.558454    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3-kube-api-access-k4dtf" (OuterVolumeSpecName: "kube-api-access-k4dtf") pod "6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3" (UID: "6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3"). InnerVolumeSpecName "kube-api-access-k4dtf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:37:26.619864 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.619668    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3" path="/var/lib/kubelet/pods/6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3/volumes"
Jul 06 01:37:26.620204 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.620164    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ca4a165-4727-48c6-af9b-27eaa5c93767" path="/var/lib/kubelet/pods/7ca4a165-4727-48c6-af9b-27eaa5c93767/volumes"
Jul 06 01:37:26.620699 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.620653    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab06b76a-329b-4b90-ad59-165c7b22a8b8" path="/var/lib/kubelet/pods/ab06b76a-329b-4b90-ad59-165c7b22a8b8/volumes"
Jul 06 01:37:26.658351 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.658317    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ca4a165-4727-48c6-af9b-27eaa5c93767-extensions-socket-volume\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:37:26.658351 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.658352    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dnvd\" (UniqueName: \"kubernetes.io/projected/7ca4a165-4727-48c6-af9b-27eaa5c93767-kube-api-access-4dnvd\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:37:26.658607 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.658364    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4dtf\" (UniqueName: \"kubernetes.io/projected/6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3-kube-api-access-k4dtf\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:37:26.709909 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.709875    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t47z"]
Jul 06 01:37:26.713849 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:37:26.713818    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb63ce85_b232_4f80_9d3b_7a72302805f2.slice/crio-9074ecae90268e7d30d752693352bc4ad095540aa4821847014ebaf8290e7342 WatchSource:0}: Error finding container 9074ecae90268e7d30d752693352bc4ad095540aa4821847014ebaf8290e7342: Status 404 returned error can't find the container with id 9074ecae90268e7d30d752693352bc4ad095540aa4821847014ebaf8290e7342
Jul 06 01:37:26.732069 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:26.732040    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn692"]
Jul 06 01:37:26.735527 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:37:26.735501    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4afa8d3a_6b8f_4efe_ad95_c4ec785eccb9.slice/crio-dc84c82d9200fa7b335027e1314035b9f7c3fa0fc44aa70276a93cf71d6418ea WatchSource:0}: Error finding container dc84c82d9200fa7b335027e1314035b9f7c3fa0fc44aa70276a93cf71d6418ea: Status 404 returned error can't find the container with id dc84c82d9200fa7b335027e1314035b9f7c3fa0fc44aa70276a93cf71d6418ea
Jul 06 01:37:27.191873 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:27.191835    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn692" event={"ID":"4afa8d3a-6b8f-4efe-ad95-c4ec785eccb9","Type":"ContainerStarted","Data":"4520dce18a440adbba37e17d07f3a7ac048229445d0c4722b1c78daa323c3f68"}
Jul 06 01:37:27.192341 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:27.191893    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn692" event={"ID":"4afa8d3a-6b8f-4efe-ad95-c4ec785eccb9","Type":"ContainerStarted","Data":"dc84c82d9200fa7b335027e1314035b9f7c3fa0fc44aa70276a93cf71d6418ea"}
Jul 06 01:37:27.192341 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:27.191971    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn692"
Jul 06 01:37:27.193152 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:27.193129    2584 generic.go:356] "Generic (PLEG): container finished" podID="7ca4a165-4727-48c6-af9b-27eaa5c93767" containerID="92b2c3f403046a2cf443eea13e8f1828c66ddec6e64e48c83467e0037dc1ade3" exitCode=0
Jul 06 01:37:27.193267 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:27.193166    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sjgch"
Jul 06 01:37:27.193267 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:27.193214    2584 scope.go:117] "RemoveContainer" containerID="92b2c3f403046a2cf443eea13e8f1828c66ddec6e64e48c83467e0037dc1ade3"
Jul 06 01:37:27.194603 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:27.194583    2584 generic.go:356] "Generic (PLEG): container finished" podID="6558ecf2-fe72-4d8e-9f62-a2ab9bc11bb3" containerID="49e6194ecb952cf50a3df1d3ce5652942ae932b1f268101e9267ac4aa2832588" exitCode=0
Jul 06 01:37:27.194701 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:27.194616    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgwxk"
Jul 06 01:37:27.196615 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:27.196597    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-749ch"
Jul 06 01:37:27.197314 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:27.197269    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t47z" event={"ID":"db63ce85-b232-4f80-9d3b-7a72302805f2","Type":"ContainerStarted","Data":"cca291503d5e86a938d96213ddd60cae25b412b67d60a40cabc1cf7328d1f375"}
Jul 06 01:37:27.197471 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:27.197371    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t47z"
Jul 06 01:37:27.197471 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:27.197392    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t47z" event={"ID":"db63ce85-b232-4f80-9d3b-7a72302805f2","Type":"ContainerStarted","Data":"9074ecae90268e7d30d752693352bc4ad095540aa4821847014ebaf8290e7342"}
Jul 06 01:37:27.204873 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:27.204843    2584 scope.go:117] "RemoveContainer" containerID="92b2c3f403046a2cf443eea13e8f1828c66ddec6e64e48c83467e0037dc1ade3"
Jul 06 01:37:27.205212 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:37:27.205190    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92b2c3f403046a2cf443eea13e8f1828c66ddec6e64e48c83467e0037dc1ade3\": container with ID starting with 92b2c3f403046a2cf443eea13e8f1828c66ddec6e64e48c83467e0037dc1ade3 not found: ID does not exist" containerID="92b2c3f403046a2cf443eea13e8f1828c66ddec6e64e48c83467e0037dc1ade3"
Jul 06 01:37:27.205276 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:27.205222    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92b2c3f403046a2cf443eea13e8f1828c66ddec6e64e48c83467e0037dc1ade3"} err="failed to get container status \"92b2c3f403046a2cf443eea13e8f1828c66ddec6e64e48c83467e0037dc1ade3\": rpc error: code = NotFound desc = could not find container \"92b2c3f403046a2cf443eea13e8f1828c66ddec6e64e48c83467e0037dc1ade3\": container with ID starting with 92b2c3f403046a2cf443eea13e8f1828c66ddec6e64e48c83467e0037dc1ade3 not found: ID does not exist"
Jul 06 01:37:27.205276 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:27.205240    2584 scope.go:117] "RemoveContainer" containerID="49e6194ecb952cf50a3df1d3ce5652942ae932b1f268101e9267ac4aa2832588"
Jul 06 01:37:27.208540 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:27.208491    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn692" podStartSLOduration=1.208474951 podStartE2EDuration="1.208474951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:37:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:37:27.207207312 +0000 UTC m=+655.448975194" watchObservedRunningTime="2026-07-06 01:37:27.208474951 +0000 UTC m=+655.450242812"
Jul 06 01:37:27.214100 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:27.214079    2584 scope.go:117] "RemoveContainer" containerID="49e6194ecb952cf50a3df1d3ce5652942ae932b1f268101e9267ac4aa2832588"
Jul 06 01:37:27.214412 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:37:27.214393    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49e6194ecb952cf50a3df1d3ce5652942ae932b1f268101e9267ac4aa2832588\": container with ID starting with 49e6194ecb952cf50a3df1d3ce5652942ae932b1f268101e9267ac4aa2832588 not found: ID does not exist" containerID="49e6194ecb952cf50a3df1d3ce5652942ae932b1f268101e9267ac4aa2832588"
Jul 06 01:37:27.214472 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:27.214425    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49e6194ecb952cf50a3df1d3ce5652942ae932b1f268101e9267ac4aa2832588"} err="failed to get container status \"49e6194ecb952cf50a3df1d3ce5652942ae932b1f268101e9267ac4aa2832588\": rpc error: code = NotFound desc = could not find container \"49e6194ecb952cf50a3df1d3ce5652942ae932b1f268101e9267ac4aa2832588\": container with ID starting with 49e6194ecb952cf50a3df1d3ce5652942ae932b1f268101e9267ac4aa2832588 not found: ID does not exist"
Jul 06 01:37:27.225326 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:27.225268    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t47z" podStartSLOduration=1.225252135 podStartE2EDuration="1.225252135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:37:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:37:27.224663017 +0000 UTC m=+655.466430884" watchObservedRunningTime="2026-07-06 01:37:27.225252135 +0000 UTC m=+655.467020003"
Jul 06 01:37:27.226983 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:37:27.226953    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-749ch\" is forbidden: User \"system:node:ip-10-0-128-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-8.ec2.internal' and this object" podUID="ab06b76a-329b-4b90-ad59-165c7b22a8b8" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-749ch"
Jul 06 01:37:38.205666 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:38.205614    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gn692"
Jul 06 01:37:38.206123 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:38.205798    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t47z"
Jul 06 01:37:57.649044 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:57.649004    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:37:57.652720 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:57.652694    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-d49p8"
Jul 06 01:37:57.655603 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:57.655576    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 01:37:57.655833 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:57.655586    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cgz9t\""
Jul 06 01:37:57.661652 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:57.661609    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:37:57.696837 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:57.696802    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:37:57.743474 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:57.743429    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twc9c\" (UniqueName: \"kubernetes.io/projected/12f8ffe8-9ae5-42c1-a7d0-a8bf2535d1be-kube-api-access-twc9c\") pod \"limitador-limitador-54d6d988d5-d49p8\" (UID: \"12f8ffe8-9ae5-42c1-a7d0-a8bf2535d1be\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d49p8"
Jul 06 01:37:57.743719 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:57.743482    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/12f8ffe8-9ae5-42c1-a7d0-a8bf2535d1be-config-file\") pod \"limitador-limitador-54d6d988d5-d49p8\" (UID: \"12f8ffe8-9ae5-42c1-a7d0-a8bf2535d1be\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d49p8"
Jul 06 01:37:57.844500 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:57.844456    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twc9c\" (UniqueName: \"kubernetes.io/projected/12f8ffe8-9ae5-42c1-a7d0-a8bf2535d1be-kube-api-access-twc9c\") pod \"limitador-limitador-54d6d988d5-d49p8\" (UID: \"12f8ffe8-9ae5-42c1-a7d0-a8bf2535d1be\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d49p8"
Jul 06 01:37:57.844731 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:57.844528    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/12f8ffe8-9ae5-42c1-a7d0-a8bf2535d1be-config-file\") pod \"limitador-limitador-54d6d988d5-d49p8\" (UID: \"12f8ffe8-9ae5-42c1-a7d0-a8bf2535d1be\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d49p8"
Jul 06 01:37:57.845311 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:57.845285    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/12f8ffe8-9ae5-42c1-a7d0-a8bf2535d1be-config-file\") pod \"limitador-limitador-54d6d988d5-d49p8\" (UID: \"12f8ffe8-9ae5-42c1-a7d0-a8bf2535d1be\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d49p8"
Jul 06 01:37:57.865231 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:57.865189    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twc9c\" (UniqueName: \"kubernetes.io/projected/12f8ffe8-9ae5-42c1-a7d0-a8bf2535d1be-kube-api-access-twc9c\") pod \"limitador-limitador-54d6d988d5-d49p8\" (UID: \"12f8ffe8-9ae5-42c1-a7d0-a8bf2535d1be\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d49p8"
Jul 06 01:37:57.963886 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:57.963778    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-d49p8"
Jul 06 01:37:58.110591 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:58.110557    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:37:58.113958 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:37:58.113926    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12f8ffe8_9ae5_42c1_a7d0_a8bf2535d1be.slice/crio-0fb065c037e26e5e2cd1eff55afb6f89a6dd74ebe225965353526e09e8f08477 WatchSource:0}: Error finding container 0fb065c037e26e5e2cd1eff55afb6f89a6dd74ebe225965353526e09e8f08477: Status 404 returned error can't find the container with id 0fb065c037e26e5e2cd1eff55afb6f89a6dd74ebe225965353526e09e8f08477
Jul 06 01:37:58.353949 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:37:58.353913    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-d49p8" event={"ID":"12f8ffe8-9ae5-42c1-a7d0-a8bf2535d1be","Type":"ContainerStarted","Data":"0fb065c037e26e5e2cd1eff55afb6f89a6dd74ebe225965353526e09e8f08477"}
Jul 06 01:38:01.371066 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:38:01.371033    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-d49p8" event={"ID":"12f8ffe8-9ae5-42c1-a7d0-a8bf2535d1be","Type":"ContainerStarted","Data":"2cd6054c38c6d40c8a7df1fbccf64d5fa38acfb0b1b8fbeb751ec90566d27586"}
Jul 06 01:38:01.371516 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:38:01.371133    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-d49p8"
Jul 06 01:38:01.396511 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:38:01.396451    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-d49p8" podStartSLOduration=1.850063426 podStartE2EDuration="4.396432298s" totalImagesPullingTime="2.546368872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:37:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:38:01.39566694 +0000 UTC m=+689.637434788" watchObservedRunningTime="2026-07-06 01:38:01.396432298 +0000 UTC m=+689.638200165"
Jul 06 01:38:12.377764 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:38:12.377735    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-d49p8"
Jul 06 01:39:18.705688 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:18.705654    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-t6tq5"]
Jul 06 01:39:18.709002 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:18.708982    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-t6tq5"
Jul 06 01:39:18.711642 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:18.711600    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 01:39:18.711886 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:18.711872    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 01:39:18.711967 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:18.711948    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 06 01:39:18.712061 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:18.712037    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-wjvkx\""
Jul 06 01:39:18.717098 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:18.717077    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-t6tq5"]
Jul 06 01:39:18.747350 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:18.747316    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwk9g\" (UniqueName: \"kubernetes.io/projected/d84c0f2c-d90d-484f-806e-1d6d3e542587-kube-api-access-pwk9g\") pod \"payload-processing-58f86c7798-t6tq5\" (UID: \"d84c0f2c-d90d-484f-806e-1d6d3e542587\") " pod="openshift-ingress/payload-processing-58f86c7798-t6tq5"
Jul 06 01:39:18.747510 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:18.747365    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d84c0f2c-d90d-484f-806e-1d6d3e542587-plugins-config-volume\") pod \"payload-processing-58f86c7798-t6tq5\" (UID: \"d84c0f2c-d90d-484f-806e-1d6d3e542587\") " pod="openshift-ingress/payload-processing-58f86c7798-t6tq5"
Jul 06 01:39:18.751991 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:18.751959    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:39:18.848556 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:18.848505    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwk9g\" (UniqueName: \"kubernetes.io/projected/d84c0f2c-d90d-484f-806e-1d6d3e542587-kube-api-access-pwk9g\") pod \"payload-processing-58f86c7798-t6tq5\" (UID: \"d84c0f2c-d90d-484f-806e-1d6d3e542587\") " pod="openshift-ingress/payload-processing-58f86c7798-t6tq5"
Jul 06 01:39:18.848787 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:18.848588    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d84c0f2c-d90d-484f-806e-1d6d3e542587-plugins-config-volume\") pod \"payload-processing-58f86c7798-t6tq5\" (UID: \"d84c0f2c-d90d-484f-806e-1d6d3e542587\") " pod="openshift-ingress/payload-processing-58f86c7798-t6tq5"
Jul 06 01:39:18.849399 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:18.849372    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d84c0f2c-d90d-484f-806e-1d6d3e542587-plugins-config-volume\") pod \"payload-processing-58f86c7798-t6tq5\" (UID: \"d84c0f2c-d90d-484f-806e-1d6d3e542587\") " pod="openshift-ingress/payload-processing-58f86c7798-t6tq5"
Jul 06 01:39:18.856772 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:18.856742    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwk9g\" (UniqueName: \"kubernetes.io/projected/d84c0f2c-d90d-484f-806e-1d6d3e542587-kube-api-access-pwk9g\") pod \"payload-processing-58f86c7798-t6tq5\" (UID: \"d84c0f2c-d90d-484f-806e-1d6d3e542587\") " pod="openshift-ingress/payload-processing-58f86c7798-t6tq5"
Jul 06 01:39:19.020554 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:19.020472    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-t6tq5"
Jul 06 01:39:19.156421 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:19.156395    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-t6tq5"]
Jul 06 01:39:19.158741 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:39:19.158710    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd84c0f2c_d90d_484f_806e_1d6d3e542587.slice/crio-ea01c7b8061e0ea24ce4012706ba9e5cb24bdb986e10d536e9f4b790a0719b5e WatchSource:0}: Error finding container ea01c7b8061e0ea24ce4012706ba9e5cb24bdb986e10d536e9f4b790a0719b5e: Status 404 returned error can't find the container with id ea01c7b8061e0ea24ce4012706ba9e5cb24bdb986e10d536e9f4b790a0719b5e
Jul 06 01:39:19.745645 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:19.745587    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-t6tq5" event={"ID":"d84c0f2c-d90d-484f-806e-1d6d3e542587","Type":"ContainerStarted","Data":"ea01c7b8061e0ea24ce4012706ba9e5cb24bdb986e10d536e9f4b790a0719b5e"}
Jul 06 01:39:20.752706 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:20.752601    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-t6tq5" event={"ID":"d84c0f2c-d90d-484f-806e-1d6d3e542587","Type":"ContainerStarted","Data":"dadb34b6ba3cc7cb968a280c8fe8b07ef95b4f6b8f2a1c58538d0b71d3490e90"}
Jul 06 01:39:20.753057 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:20.752785    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-t6tq5"
Jul 06 01:39:20.768028 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:20.767975    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-t6tq5" podStartSLOduration=1.498020503 podStartE2EDuration="2.76795667s" totalImagesPullingTime="1.269936167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:39:20.766882418 +0000 UTC m=+769.008650286" watchObservedRunningTime="2026-07-06 01:39:20.76795667 +0000 UTC m=+769.009724538"
Jul 06 01:39:31.765127 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:31.765094    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-t6tq5"
Jul 06 01:39:41.149020 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:41.148982    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:39:48.012892 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.012853    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"]
Jul 06 01:39:48.016530 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.016507    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"
Jul 06 01:39:48.019099 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.019068    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cxdt6\""
Jul 06 01:39:48.019302 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.019288    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 01:39:48.020475 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.020454    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 06 01:39:48.020554 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.020479    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 01:39:48.025603 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.025581    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"]
Jul 06 01:39:48.108120 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.108091    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc8d8745-93d6-47ff-94c5-b89d7947b3f6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vwmvp\" (UID: \"bc8d8745-93d6-47ff-94c5-b89d7947b3f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"
Jul 06 01:39:48.108120 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.108123    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx4kw\" (UniqueName: \"kubernetes.io/projected/bc8d8745-93d6-47ff-94c5-b89d7947b3f6-kube-api-access-zx4kw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vwmvp\" (UID: \"bc8d8745-93d6-47ff-94c5-b89d7947b3f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"
Jul 06 01:39:48.108321 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.108150    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc8d8745-93d6-47ff-94c5-b89d7947b3f6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vwmvp\" (UID: \"bc8d8745-93d6-47ff-94c5-b89d7947b3f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"
Jul 06 01:39:48.108321 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.108223    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc8d8745-93d6-47ff-94c5-b89d7947b3f6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vwmvp\" (UID: \"bc8d8745-93d6-47ff-94c5-b89d7947b3f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"
Jul 06 01:39:48.108321 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.108273    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc8d8745-93d6-47ff-94c5-b89d7947b3f6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vwmvp\" (UID: \"bc8d8745-93d6-47ff-94c5-b89d7947b3f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"
Jul 06 01:39:48.108321 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.108304    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc8d8745-93d6-47ff-94c5-b89d7947b3f6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vwmvp\" (UID: \"bc8d8745-93d6-47ff-94c5-b89d7947b3f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"
Jul 06 01:39:48.209368 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.209338    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc8d8745-93d6-47ff-94c5-b89d7947b3f6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vwmvp\" (UID: \"bc8d8745-93d6-47ff-94c5-b89d7947b3f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"
Jul 06 01:39:48.209564 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.209376    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx4kw\" (UniqueName: \"kubernetes.io/projected/bc8d8745-93d6-47ff-94c5-b89d7947b3f6-kube-api-access-zx4kw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vwmvp\" (UID: \"bc8d8745-93d6-47ff-94c5-b89d7947b3f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"
Jul 06 01:39:48.209564 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.209406    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc8d8745-93d6-47ff-94c5-b89d7947b3f6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vwmvp\" (UID: \"bc8d8745-93d6-47ff-94c5-b89d7947b3f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"
Jul 06 01:39:48.209564 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.209438    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc8d8745-93d6-47ff-94c5-b89d7947b3f6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vwmvp\" (UID: \"bc8d8745-93d6-47ff-94c5-b89d7947b3f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"
Jul 06 01:39:48.209564 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.209480    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc8d8745-93d6-47ff-94c5-b89d7947b3f6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vwmvp\" (UID: \"bc8d8745-93d6-47ff-94c5-b89d7947b3f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"
Jul 06 01:39:48.210071 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.209667    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc8d8745-93d6-47ff-94c5-b89d7947b3f6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vwmvp\" (UID: \"bc8d8745-93d6-47ff-94c5-b89d7947b3f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"
Jul 06 01:39:48.210071 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.209791    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc8d8745-93d6-47ff-94c5-b89d7947b3f6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vwmvp\" (UID: \"bc8d8745-93d6-47ff-94c5-b89d7947b3f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"
Jul 06 01:39:48.210071 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.209863    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc8d8745-93d6-47ff-94c5-b89d7947b3f6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vwmvp\" (UID: \"bc8d8745-93d6-47ff-94c5-b89d7947b3f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"
Jul 06 01:39:48.210071 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.209886    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc8d8745-93d6-47ff-94c5-b89d7947b3f6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vwmvp\" (UID: \"bc8d8745-93d6-47ff-94c5-b89d7947b3f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"
Jul 06 01:39:48.211691 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.211658    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc8d8745-93d6-47ff-94c5-b89d7947b3f6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vwmvp\" (UID: \"bc8d8745-93d6-47ff-94c5-b89d7947b3f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"
Jul 06 01:39:48.212158 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.212136    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc8d8745-93d6-47ff-94c5-b89d7947b3f6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vwmvp\" (UID: \"bc8d8745-93d6-47ff-94c5-b89d7947b3f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"
Jul 06 01:39:48.218400 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.218378    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx4kw\" (UniqueName: \"kubernetes.io/projected/bc8d8745-93d6-47ff-94c5-b89d7947b3f6-kube-api-access-zx4kw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vwmvp\" (UID: \"bc8d8745-93d6-47ff-94c5-b89d7947b3f6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"
Jul 06 01:39:48.328343 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.328259    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"
Jul 06 01:39:48.459144 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.459115    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"]
Jul 06 01:39:48.460840 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:39:48.460813    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc8d8745_93d6_47ff_94c5_b89d7947b3f6.slice/crio-80fb4bd91773331c4ec05da0d97b786ea50be9d8b19beff62843973b5555b368 WatchSource:0}: Error finding container 80fb4bd91773331c4ec05da0d97b786ea50be9d8b19beff62843973b5555b368: Status 404 returned error can't find the container with id 80fb4bd91773331c4ec05da0d97b786ea50be9d8b19beff62843973b5555b368
Jul 06 01:39:48.897341 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.897254    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp" event={"ID":"bc8d8745-93d6-47ff-94c5-b89d7947b3f6","Type":"ContainerStarted","Data":"80fb4bd91773331c4ec05da0d97b786ea50be9d8b19beff62843973b5555b368"}
Jul 06 01:39:48.936933 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:48.936896    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:39:49.903205 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:49.903167    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp" event={"ID":"bc8d8745-93d6-47ff-94c5-b89d7947b3f6","Type":"ContainerStarted","Data":"83965c949f7cd213342cab324601175282e101e734caefec23518490b7250a56"}
Jul 06 01:39:49.919613 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:49.919558    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp" podStartSLOduration=1.878823117 podStartE2EDuration="2.919541231s" totalImagesPullingTime="1.040718114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:39:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:39:49.918695098 +0000 UTC m=+798.160462967" watchObservedRunningTime="2026-07-06 01:39:49.919541231 +0000 UTC m=+798.161309099"
Jul 06 01:39:58.328966 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:58.328850    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"
Jul 06 01:39:58.328966 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:58.328938    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"
Jul 06 01:39:58.342120 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:58.342091    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"
Jul 06 01:39:58.931051 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:58.931012    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:39:58.956340 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:39:58.956307    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vwmvp"
Jul 06 01:40:06.035604 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:40:06.035563    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:40:13.040297 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:40:13.040249    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:40:26.840250 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:40:26.840211    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:42:00.734001 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:42:00.733970    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:42:09.831085 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:42:09.831043    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:42:21.236838 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:42:21.236799    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:42:29.437065 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:42:29.437023    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:42:40.333437 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:42:40.333394    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:43:09.037592 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:43:09.037550    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:43:19.931891 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:43:19.931853    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:43:53.335558 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:43:53.335515    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:44:01.229118 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:44:01.229078    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:44:10.042619 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:44:10.042582    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:44:17.540284 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:44:17.540249    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:44:27.934256 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:44:27.934172    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:44:39.728922 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:44:39.728888    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:44:50.836529 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:44:50.836483    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:45:00.143877 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:45:00.143839    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29721705-mq97d"]
Jul 06 01:45:00.147428 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:45:00.147405    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721705-mq97d"
Jul 06 01:45:00.150320 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:45:00.150293    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cfbht\""
Jul 06 01:45:00.165890 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:45:00.165857    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29721705-mq97d"]
Jul 06 01:45:00.235131 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:45:00.235070    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6bkc\" (UniqueName: \"kubernetes.io/projected/e1ab9594-fd24-48d0-951d-5f9e89eb01f3-kube-api-access-g6bkc\") pod \"maas-api-key-cleanup-29721705-mq97d\" (UID: \"e1ab9594-fd24-48d0-951d-5f9e89eb01f3\") " pod="opendatahub/maas-api-key-cleanup-29721705-mq97d"
Jul 06 01:45:00.335703 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:45:00.335621    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6bkc\" (UniqueName: \"kubernetes.io/projected/e1ab9594-fd24-48d0-951d-5f9e89eb01f3-kube-api-access-g6bkc\") pod \"maas-api-key-cleanup-29721705-mq97d\" (UID: \"e1ab9594-fd24-48d0-951d-5f9e89eb01f3\") " pod="opendatahub/maas-api-key-cleanup-29721705-mq97d"
Jul 06 01:45:00.344749 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:45:00.344723    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6bkc\" (UniqueName: \"kubernetes.io/projected/e1ab9594-fd24-48d0-951d-5f9e89eb01f3-kube-api-access-g6bkc\") pod \"maas-api-key-cleanup-29721705-mq97d\" (UID: \"e1ab9594-fd24-48d0-951d-5f9e89eb01f3\") " pod="opendatahub/maas-api-key-cleanup-29721705-mq97d"
Jul 06 01:45:00.458044 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:45:00.457935    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721705-mq97d"
Jul 06 01:45:00.598932 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:45:00.598907    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29721705-mq97d"]
Jul 06 01:45:00.601539 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:45:00.601514    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1ab9594_fd24_48d0_951d_5f9e89eb01f3.slice/crio-17a6baf228f7d67c154140b1ef0325ee34ab039a72325481f456c86c1a5f3adb WatchSource:0}: Error finding container 17a6baf228f7d67c154140b1ef0325ee34ab039a72325481f456c86c1a5f3adb: Status 404 returned error can't find the container with id 17a6baf228f7d67c154140b1ef0325ee34ab039a72325481f456c86c1a5f3adb
Jul 06 01:45:00.603891 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:45:00.603871    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 01:45:01.029027 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:45:01.028985    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:45:01.412689 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:45:01.412654    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721705-mq97d" event={"ID":"e1ab9594-fd24-48d0-951d-5f9e89eb01f3","Type":"ContainerStarted","Data":"17a6baf228f7d67c154140b1ef0325ee34ab039a72325481f456c86c1a5f3adb"}
Jul 06 01:45:03.426644 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:45:03.426592    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721705-mq97d" event={"ID":"e1ab9594-fd24-48d0-951d-5f9e89eb01f3","Type":"ContainerStarted","Data":"91b1e5ce8617ff6e096b0b6707b84144f9086bd7ca5ce571947d62651b6efdc2"}
Jul 06 01:45:03.442321 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:45:03.442269    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29721705-mq97d" podStartSLOduration=1.001267983 podStartE2EDuration="3.442252183s" totalImagesPullingTime="2.4409842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:45:03.440602013 +0000 UTC m=+1111.682369882" watchObservedRunningTime="2026-07-06 01:45:03.442252183 +0000 UTC m=+1111.684020050"
Jul 06 01:45:04.432682 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:45:04.432618    2584 generic.go:356] "Generic (PLEG): container finished" podID="e1ab9594-fd24-48d0-951d-5f9e89eb01f3" containerID="91b1e5ce8617ff6e096b0b6707b84144f9086bd7ca5ce571947d62651b6efdc2" exitCode=0
Jul 06 01:45:04.433042 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:45:04.432725    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721705-mq97d" event={"ID":"e1ab9594-fd24-48d0-951d-5f9e89eb01f3","Type":"ContainerDied","Data":"91b1e5ce8617ff6e096b0b6707b84144f9086bd7ca5ce571947d62651b6efdc2"}
Jul 06 01:45:05.589019 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:45:05.588974    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721705-mq97d"
Jul 06 01:45:05.687691 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:45:05.687651    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6bkc\" (UniqueName: \"kubernetes.io/projected/e1ab9594-fd24-48d0-951d-5f9e89eb01f3-kube-api-access-g6bkc\") pod \"e1ab9594-fd24-48d0-951d-5f9e89eb01f3\" (UID: \"e1ab9594-fd24-48d0-951d-5f9e89eb01f3\") "
Jul 06 01:45:05.689943 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:45:05.689872    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1ab9594-fd24-48d0-951d-5f9e89eb01f3-kube-api-access-g6bkc" (OuterVolumeSpecName: "kube-api-access-g6bkc") pod "e1ab9594-fd24-48d0-951d-5f9e89eb01f3" (UID: "e1ab9594-fd24-48d0-951d-5f9e89eb01f3"). InnerVolumeSpecName "kube-api-access-g6bkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:45:05.789267 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:45:05.789220    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6bkc\" (UniqueName: \"kubernetes.io/projected/e1ab9594-fd24-48d0-951d-5f9e89eb01f3-kube-api-access-g6bkc\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:45:06.444506 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:45:06.444472    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721705-mq97d"
Jul 06 01:45:06.444716 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:45:06.444507    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721705-mq97d" event={"ID":"e1ab9594-fd24-48d0-951d-5f9e89eb01f3","Type":"ContainerDied","Data":"17a6baf228f7d67c154140b1ef0325ee34ab039a72325481f456c86c1a5f3adb"}
Jul 06 01:45:06.444716 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:45:06.444556    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17a6baf228f7d67c154140b1ef0325ee34ab039a72325481f456c86c1a5f3adb"
Jul 06 01:45:26.634136 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:45:26.634096    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:45:38.031354 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:45:38.031316    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:46:00.733730 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:46:00.733648    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:46:14.031748 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:46:14.031705    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:46:29.031936 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:46:29.031894    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:46:39.134320 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:46:39.134277    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:46:48.539164 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:46:48.539124    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:46:57.933437 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:46:57.933398    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:47:06.842468 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:47:06.842427    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:47:34.540063 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:47:34.539837    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t47z"]
Jul 06 01:47:34.540652 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:47:34.540181    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t47z" podUID="db63ce85-b232-4f80-9d3b-7a72302805f2" containerName="manager" containerID="cri-o://cca291503d5e86a938d96213ddd60cae25b412b67d60a40cabc1cf7328d1f375" gracePeriod=10
Jul 06 01:47:37.806250 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:47:37.806222    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t47z"
Jul 06 01:47:37.869617 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:47:37.869582    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lk655\" (UniqueName: \"kubernetes.io/projected/db63ce85-b232-4f80-9d3b-7a72302805f2-kube-api-access-lk655\") pod \"db63ce85-b232-4f80-9d3b-7a72302805f2\" (UID: \"db63ce85-b232-4f80-9d3b-7a72302805f2\") "
Jul 06 01:47:37.869805 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:47:37.869741    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db63ce85-b232-4f80-9d3b-7a72302805f2-extensions-socket-volume\") pod \"db63ce85-b232-4f80-9d3b-7a72302805f2\" (UID: \"db63ce85-b232-4f80-9d3b-7a72302805f2\") "
Jul 06 01:47:37.870206 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:47:37.870170    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db63ce85-b232-4f80-9d3b-7a72302805f2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "db63ce85-b232-4f80-9d3b-7a72302805f2" (UID: "db63ce85-b232-4f80-9d3b-7a72302805f2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:47:37.871768 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:47:37.871735    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db63ce85-b232-4f80-9d3b-7a72302805f2-kube-api-access-lk655" (OuterVolumeSpecName: "kube-api-access-lk655") pod "db63ce85-b232-4f80-9d3b-7a72302805f2" (UID: "db63ce85-b232-4f80-9d3b-7a72302805f2"). InnerVolumeSpecName "kube-api-access-lk655". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:47:37.970933 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:47:37.970890    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db63ce85-b232-4f80-9d3b-7a72302805f2-extensions-socket-volume\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:47:37.970933 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:47:37.970924    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lk655\" (UniqueName: \"kubernetes.io/projected/db63ce85-b232-4f80-9d3b-7a72302805f2-kube-api-access-lk655\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:47:38.207273 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:47:38.207182    2584 generic.go:356] "Generic (PLEG): container finished" podID="db63ce85-b232-4f80-9d3b-7a72302805f2" containerID="cca291503d5e86a938d96213ddd60cae25b412b67d60a40cabc1cf7328d1f375" exitCode=0
Jul 06 01:47:38.207273 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:47:38.207225    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t47z"
Jul 06 01:47:38.207273 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:47:38.207261    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t47z" event={"ID":"db63ce85-b232-4f80-9d3b-7a72302805f2","Type":"ContainerDied","Data":"cca291503d5e86a938d96213ddd60cae25b412b67d60a40cabc1cf7328d1f375"}
Jul 06 01:47:38.207528 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:47:38.207313    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t47z" event={"ID":"db63ce85-b232-4f80-9d3b-7a72302805f2","Type":"ContainerDied","Data":"9074ecae90268e7d30d752693352bc4ad095540aa4821847014ebaf8290e7342"}
Jul 06 01:47:38.207528 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:47:38.207350    2584 scope.go:117] "RemoveContainer" containerID="cca291503d5e86a938d96213ddd60cae25b412b67d60a40cabc1cf7328d1f375"
Jul 06 01:47:38.217548 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:47:38.217530    2584 scope.go:117] "RemoveContainer" containerID="cca291503d5e86a938d96213ddd60cae25b412b67d60a40cabc1cf7328d1f375"
Jul 06 01:47:38.217879 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:47:38.217858    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cca291503d5e86a938d96213ddd60cae25b412b67d60a40cabc1cf7328d1f375\": container with ID starting with cca291503d5e86a938d96213ddd60cae25b412b67d60a40cabc1cf7328d1f375 not found: ID does not exist" containerID="cca291503d5e86a938d96213ddd60cae25b412b67d60a40cabc1cf7328d1f375"
Jul 06 01:47:38.217957 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:47:38.217888    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cca291503d5e86a938d96213ddd60cae25b412b67d60a40cabc1cf7328d1f375"} err="failed to get container status \"cca291503d5e86a938d96213ddd60cae25b412b67d60a40cabc1cf7328d1f375\": rpc error: code = NotFound desc = could not find container \"cca291503d5e86a938d96213ddd60cae25b412b67d60a40cabc1cf7328d1f375\": container with ID starting with cca291503d5e86a938d96213ddd60cae25b412b67d60a40cabc1cf7328d1f375 not found: ID does not exist"
Jul 06 01:47:38.230304 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:47:38.230275    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t47z"]
Jul 06 01:47:38.235093 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:47:38.235064    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7t47z"]
Jul 06 01:47:38.615322 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:47:38.615284    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db63ce85-b232-4f80-9d3b-7a72302805f2" path="/var/lib/kubelet/pods/db63ce85-b232-4f80-9d3b-7a72302805f2/volumes"
Jul 06 01:48:35.726319 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:48:35.726275    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bf2mp"]
Jul 06 01:48:35.726861 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:48:35.726830    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db63ce85-b232-4f80-9d3b-7a72302805f2" containerName="manager"
Jul 06 01:48:35.726861 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:48:35.726850    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="db63ce85-b232-4f80-9d3b-7a72302805f2" containerName="manager"
Jul 06 01:48:35.727013 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:48:35.726865    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1ab9594-fd24-48d0-951d-5f9e89eb01f3" containerName="cleanup"
Jul 06 01:48:35.727013 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:48:35.726873    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1ab9594-fd24-48d0-951d-5f9e89eb01f3" containerName="cleanup"
Jul 06 01:48:35.727112 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:48:35.727025    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1ab9594-fd24-48d0-951d-5f9e89eb01f3" containerName="cleanup"
Jul 06 01:48:35.727112 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:48:35.727043    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="db63ce85-b232-4f80-9d3b-7a72302805f2" containerName="manager"
Jul 06 01:48:35.731215 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:48:35.731191    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bf2mp"
Jul 06 01:48:35.734140 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:48:35.734117    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xkfc6\""
Jul 06 01:48:35.742717 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:48:35.742677    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bf2mp"]
Jul 06 01:48:35.783938 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:48:35.783891    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8z4z\" (UniqueName: \"kubernetes.io/projected/747af27d-a14d-4e59-b91c-f6959109f99f-kube-api-access-l8z4z\") pod \"kuadrant-operator-controller-manager-86878c769f-bf2mp\" (UID: \"747af27d-a14d-4e59-b91c-f6959109f99f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bf2mp"
Jul 06 01:48:35.784131 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:48:35.783948    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/747af27d-a14d-4e59-b91c-f6959109f99f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bf2mp\" (UID: \"747af27d-a14d-4e59-b91c-f6959109f99f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bf2mp"
Jul 06 01:48:35.884910 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:48:35.884865    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8z4z\" (UniqueName: \"kubernetes.io/projected/747af27d-a14d-4e59-b91c-f6959109f99f-kube-api-access-l8z4z\") pod \"kuadrant-operator-controller-manager-86878c769f-bf2mp\" (UID: \"747af27d-a14d-4e59-b91c-f6959109f99f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bf2mp"
Jul 06 01:48:35.885098 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:48:35.884924    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/747af27d-a14d-4e59-b91c-f6959109f99f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bf2mp\" (UID: \"747af27d-a14d-4e59-b91c-f6959109f99f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bf2mp"
Jul 06 01:48:35.885381 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:48:35.885361    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/747af27d-a14d-4e59-b91c-f6959109f99f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bf2mp\" (UID: \"747af27d-a14d-4e59-b91c-f6959109f99f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bf2mp"
Jul 06 01:48:35.897440 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:48:35.897406    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8z4z\" (UniqueName: \"kubernetes.io/projected/747af27d-a14d-4e59-b91c-f6959109f99f-kube-api-access-l8z4z\") pod \"kuadrant-operator-controller-manager-86878c769f-bf2mp\" (UID: \"747af27d-a14d-4e59-b91c-f6959109f99f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bf2mp"
Jul 06 01:48:36.041408 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:48:36.041313    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bf2mp"
Jul 06 01:48:36.188182 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:48:36.188151    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bf2mp"]
Jul 06 01:48:36.191459 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:48:36.191428    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod747af27d_a14d_4e59_b91c_f6959109f99f.slice/crio-bd81dac743ebd0808e5628c96760eb1e54267663234943bdc4dc0d9fd1af0ae4 WatchSource:0}: Error finding container bd81dac743ebd0808e5628c96760eb1e54267663234943bdc4dc0d9fd1af0ae4: Status 404 returned error can't find the container with id bd81dac743ebd0808e5628c96760eb1e54267663234943bdc4dc0d9fd1af0ae4
Jul 06 01:48:36.497281 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:48:36.497246    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bf2mp" event={"ID":"747af27d-a14d-4e59-b91c-f6959109f99f","Type":"ContainerStarted","Data":"8da58414cdb9d8e77b9480ce7b641b84e612f4ac442945e4f1f51dbed4354e69"}
Jul 06 01:48:36.497447 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:48:36.497296    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bf2mp" event={"ID":"747af27d-a14d-4e59-b91c-f6959109f99f","Type":"ContainerStarted","Data":"bd81dac743ebd0808e5628c96760eb1e54267663234943bdc4dc0d9fd1af0ae4"}
Jul 06 01:48:36.497447 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:48:36.497343    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bf2mp"
Jul 06 01:48:36.514766 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:48:36.514716    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bf2mp" podStartSLOduration=1.5146975299999998 podStartE2EDuration="1.51469753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:48:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:48:36.514107388 +0000 UTC m=+1324.755875252" watchObservedRunningTime="2026-07-06 01:48:36.51469753 +0000 UTC m=+1324.756465396"
Jul 06 01:48:47.505428 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:48:47.505395    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bf2mp"
Jul 06 01:48:57.032846 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:48:57.032755    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:49:06.032395 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:49:06.032347    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:49:18.533139 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:49:18.533098    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:49:29.633339 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:49:29.633298    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:49:41.733321 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:49:41.733279    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:49:51.135961 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:49:51.135917    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:50:01.238493 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:50:01.238448    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:50:10.833351 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:50:10.833307    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:50:22.237982 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:50:22.237938    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:50:31.837530 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:50:31.837422    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:50:42.135185 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:50:42.135145    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:51:06.534898 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:51:06.534854    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:51:13.941121 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:51:13.941073    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:51:23.240041 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:51:23.240001    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:51:35.441680 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:51:35.441620    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:51:44.338507 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:51:44.338465    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:51:51.931030 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:51:51.930992    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:52:01.233816 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:52:01.233775    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:52:10.443893 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:52:10.443848    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:52:18.136028 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:52:18.135990    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:52:29.132202 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:52:29.132158    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:52:49.234530 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:52:49.234489    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:52:56.683843 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:52:56.683806    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:53:06.143343 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:53:06.143306    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:53:15.635681 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:53:15.635618    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:53:25.637921 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:53:25.637834    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:53:38.259565 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:53:38.259529    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:53:47.043680 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:53:47.043615    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:53:57.544079 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:53:57.544038    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:54:08.637826 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:08.637792    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:54:19.535115 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:19.535076    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:54:30.936322 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:30.936271    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:54:40.092268 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:40.092219    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:54:49.342155 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:49.342113    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:54:50.541510 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:50.541460    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8"]
Jul 06 01:54:50.546061 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:50.546032    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8"
Jul 06 01:54:50.549057 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:50.549033    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-adaa0b9e-serving-cert\""
Jul 06 01:54:50.549206 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:50.549088    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cfbht\""
Jul 06 01:54:50.555214 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:50.554688    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8"]
Jul 06 01:54:50.600898 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:50.600861    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38f287d0-6955-4531-8816-c83ecd7a94f5-maas-api-tls\") pod \"maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8\" (UID: \"38f287d0-6955-4531-8816-c83ecd7a94f5\") " pod="opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8"
Jul 06 01:54:50.601088 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:50.600917    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38f287d0-6955-4531-8816-c83ecd7a94f5-openshift-service-ca\") pod \"maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8\" (UID: \"38f287d0-6955-4531-8816-c83ecd7a94f5\") " pod="opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8"
Jul 06 01:54:50.601088 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:50.601022    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpdzh\" (UniqueName: \"kubernetes.io/projected/38f287d0-6955-4531-8816-c83ecd7a94f5-kube-api-access-lpdzh\") pod \"maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8\" (UID: \"38f287d0-6955-4531-8816-c83ecd7a94f5\") " pod="opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8"
Jul 06 01:54:50.701772 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:50.701720    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38f287d0-6955-4531-8816-c83ecd7a94f5-maas-api-tls\") pod \"maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8\" (UID: \"38f287d0-6955-4531-8816-c83ecd7a94f5\") " pod="opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8"
Jul 06 01:54:50.701985 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:50.701808    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38f287d0-6955-4531-8816-c83ecd7a94f5-openshift-service-ca\") pod \"maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8\" (UID: \"38f287d0-6955-4531-8816-c83ecd7a94f5\") " pod="opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8"
Jul 06 01:54:50.701985 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:50.701867    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpdzh\" (UniqueName: \"kubernetes.io/projected/38f287d0-6955-4531-8816-c83ecd7a94f5-kube-api-access-lpdzh\") pod \"maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8\" (UID: \"38f287d0-6955-4531-8816-c83ecd7a94f5\") " pod="opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8"
Jul 06 01:54:50.701985 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:54:50.701879    2584 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-adaa0b9e-serving-cert: secret "maas-api-e2e-ait-adaa0b9e-serving-cert" not found
Jul 06 01:54:50.701985 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:54:50.701955    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38f287d0-6955-4531-8816-c83ecd7a94f5-maas-api-tls podName:38f287d0-6955-4531-8816-c83ecd7a94f5 nodeName:}" failed. No retries permitted until 2026-07-06 01:54:51.201937646 +0000 UTC m=+1699.443705492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/38f287d0-6955-4531-8816-c83ecd7a94f5-maas-api-tls") pod "maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8" (UID: "38f287d0-6955-4531-8816-c83ecd7a94f5") : secret "maas-api-e2e-ait-adaa0b9e-serving-cert" not found
Jul 06 01:54:50.702538 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:50.702505    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38f287d0-6955-4531-8816-c83ecd7a94f5-openshift-service-ca\") pod \"maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8\" (UID: \"38f287d0-6955-4531-8816-c83ecd7a94f5\") " pod="opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8"
Jul 06 01:54:50.711353 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:50.711326    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpdzh\" (UniqueName: \"kubernetes.io/projected/38f287d0-6955-4531-8816-c83ecd7a94f5-kube-api-access-lpdzh\") pod \"maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8\" (UID: \"38f287d0-6955-4531-8816-c83ecd7a94f5\") " pod="opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8"
Jul 06 01:54:51.207102 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:51.207068    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38f287d0-6955-4531-8816-c83ecd7a94f5-maas-api-tls\") pod \"maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8\" (UID: \"38f287d0-6955-4531-8816-c83ecd7a94f5\") " pod="opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8"
Jul 06 01:54:51.209593 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:51.209571    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38f287d0-6955-4531-8816-c83ecd7a94f5-maas-api-tls\") pod \"maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8\" (UID: \"38f287d0-6955-4531-8816-c83ecd7a94f5\") " pod="opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8"
Jul 06 01:54:51.460193 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:51.460096    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8"
Jul 06 01:54:51.603303 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:51.603276    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8"]
Jul 06 01:54:51.606081 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:54:51.606053    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38f287d0_6955_4531_8816_c83ecd7a94f5.slice/crio-3215d71bb02889467df3a5ed9e75514c4ceebb560e55665ebfeda6cb7bf3f23a WatchSource:0}: Error finding container 3215d71bb02889467df3a5ed9e75514c4ceebb560e55665ebfeda6cb7bf3f23a: Status 404 returned error can't find the container with id 3215d71bb02889467df3a5ed9e75514c4ceebb560e55665ebfeda6cb7bf3f23a
Jul 06 01:54:51.607721 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:51.607699    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 01:54:52.402221 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:52.402179    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8" event={"ID":"38f287d0-6955-4531-8816-c83ecd7a94f5","Type":"ContainerStarted","Data":"3215d71bb02889467df3a5ed9e75514c4ceebb560e55665ebfeda6cb7bf3f23a"}
Jul 06 01:54:53.409058 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:53.409020    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8" event={"ID":"38f287d0-6955-4531-8816-c83ecd7a94f5","Type":"ContainerStarted","Data":"998ba11fc52a93ffc9cfb6c62e1013bb7540221f720216d3a7f5789c253d407a"}
Jul 06 01:54:53.409462 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:53.409103    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8"
Jul 06 01:54:53.427822 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:53.427755    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8" podStartSLOduration=1.833043693 podStartE2EDuration="3.427731759s" totalImagesPullingTime="1.594688066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:54:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:54:53.427353623 +0000 UTC m=+1701.669121492" watchObservedRunningTime="2026-07-06 01:54:53.427731759 +0000 UTC m=+1701.669499628"
Jul 06 01:54:55.976811 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:55.976592    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8"]
Jul 06 01:54:55.977515 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:55.977482    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8" podUID="38f287d0-6955-4531-8816-c83ecd7a94f5" containerName="maas-api" containerID="cri-o://998ba11fc52a93ffc9cfb6c62e1013bb7540221f720216d3a7f5789c253d407a" gracePeriod=30
Jul 06 01:54:56.232241 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:56.232163    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8"
Jul 06 01:54:56.355094 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:56.355053    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38f287d0-6955-4531-8816-c83ecd7a94f5-maas-api-tls\") pod \"38f287d0-6955-4531-8816-c83ecd7a94f5\" (UID: \"38f287d0-6955-4531-8816-c83ecd7a94f5\") "
Jul 06 01:54:56.355094 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:56.355100    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpdzh\" (UniqueName: \"kubernetes.io/projected/38f287d0-6955-4531-8816-c83ecd7a94f5-kube-api-access-lpdzh\") pod \"38f287d0-6955-4531-8816-c83ecd7a94f5\" (UID: \"38f287d0-6955-4531-8816-c83ecd7a94f5\") "
Jul 06 01:54:56.355363 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:56.355130    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38f287d0-6955-4531-8816-c83ecd7a94f5-openshift-service-ca\") pod \"38f287d0-6955-4531-8816-c83ecd7a94f5\" (UID: \"38f287d0-6955-4531-8816-c83ecd7a94f5\") "
Jul 06 01:54:56.355552 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:56.355521    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38f287d0-6955-4531-8816-c83ecd7a94f5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "38f287d0-6955-4531-8816-c83ecd7a94f5" (UID: "38f287d0-6955-4531-8816-c83ecd7a94f5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:54:56.357337 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:56.357307    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38f287d0-6955-4531-8816-c83ecd7a94f5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "38f287d0-6955-4531-8816-c83ecd7a94f5" (UID: "38f287d0-6955-4531-8816-c83ecd7a94f5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:54:56.357443 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:56.357424    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38f287d0-6955-4531-8816-c83ecd7a94f5-kube-api-access-lpdzh" (OuterVolumeSpecName: "kube-api-access-lpdzh") pod "38f287d0-6955-4531-8816-c83ecd7a94f5" (UID: "38f287d0-6955-4531-8816-c83ecd7a94f5"). InnerVolumeSpecName "kube-api-access-lpdzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:54:56.426007 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:56.425967    2584 generic.go:356] "Generic (PLEG): container finished" podID="38f287d0-6955-4531-8816-c83ecd7a94f5" containerID="998ba11fc52a93ffc9cfb6c62e1013bb7540221f720216d3a7f5789c253d407a" exitCode=0
Jul 06 01:54:56.426183 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:56.426008    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8" event={"ID":"38f287d0-6955-4531-8816-c83ecd7a94f5","Type":"ContainerDied","Data":"998ba11fc52a93ffc9cfb6c62e1013bb7540221f720216d3a7f5789c253d407a"}
Jul 06 01:54:56.426183 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:56.426062    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8" event={"ID":"38f287d0-6955-4531-8816-c83ecd7a94f5","Type":"ContainerDied","Data":"3215d71bb02889467df3a5ed9e75514c4ceebb560e55665ebfeda6cb7bf3f23a"}
Jul 06 01:54:56.426183 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:56.426083    2584 scope.go:117] "RemoveContainer" containerID="998ba11fc52a93ffc9cfb6c62e1013bb7540221f720216d3a7f5789c253d407a"
Jul 06 01:54:56.426183 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:56.426020    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8"
Jul 06 01:54:56.435526 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:56.435499    2584 scope.go:117] "RemoveContainer" containerID="998ba11fc52a93ffc9cfb6c62e1013bb7540221f720216d3a7f5789c253d407a"
Jul 06 01:54:56.435871 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:54:56.435848    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"998ba11fc52a93ffc9cfb6c62e1013bb7540221f720216d3a7f5789c253d407a\": container with ID starting with 998ba11fc52a93ffc9cfb6c62e1013bb7540221f720216d3a7f5789c253d407a not found: ID does not exist" containerID="998ba11fc52a93ffc9cfb6c62e1013bb7540221f720216d3a7f5789c253d407a"
Jul 06 01:54:56.435938 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:56.435881    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"998ba11fc52a93ffc9cfb6c62e1013bb7540221f720216d3a7f5789c253d407a"} err="failed to get container status \"998ba11fc52a93ffc9cfb6c62e1013bb7540221f720216d3a7f5789c253d407a\": rpc error: code = NotFound desc = could not find container \"998ba11fc52a93ffc9cfb6c62e1013bb7540221f720216d3a7f5789c253d407a\": container with ID starting with 998ba11fc52a93ffc9cfb6c62e1013bb7540221f720216d3a7f5789c253d407a not found: ID does not exist"
Jul 06 01:54:56.451669 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:56.449930    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8"]
Jul 06 01:54:56.454772 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:56.454096    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-adaa0b9e-c9ddcbd5f-rv4j8"]
Jul 06 01:54:56.455983 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:56.455954    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38f287d0-6955-4531-8816-c83ecd7a94f5-maas-api-tls\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:54:56.455983 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:56.455980    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpdzh\" (UniqueName: \"kubernetes.io/projected/38f287d0-6955-4531-8816-c83ecd7a94f5-kube-api-access-lpdzh\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:54:56.456147 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:56.455991    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38f287d0-6955-4531-8816-c83ecd7a94f5-openshift-service-ca\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:54:56.615321 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:54:56.615281    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38f287d0-6955-4531-8816-c83ecd7a94f5" path="/var/lib/kubelet/pods/38f287d0-6955-4531-8816-c83ecd7a94f5/volumes"
Jul 06 01:55:03.702130 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:03.702092    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v"]
Jul 06 01:55:03.702734 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:03.702714    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38f287d0-6955-4531-8816-c83ecd7a94f5" containerName="maas-api"
Jul 06 01:55:03.702824 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:03.702739    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="38f287d0-6955-4531-8816-c83ecd7a94f5" containerName="maas-api"
Jul 06 01:55:03.702884 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:03.702856    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="38f287d0-6955-4531-8816-c83ecd7a94f5" containerName="maas-api"
Jul 06 01:55:03.707483 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:03.707454    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v"
Jul 06 01:55:03.710350 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:03.710322    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-migrate-d5d69b37-serving-cert\""
Jul 06 01:55:03.710730 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:03.710337    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cfbht\""
Jul 06 01:55:03.718835 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:03.717505    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v"]
Jul 06 01:55:03.822534 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:03.822494    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0d4f9c2-9724-4471-83ba-d85ba44c8db7-openshift-service-ca\") pod \"maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v\" (UID: \"c0d4f9c2-9724-4471-83ba-d85ba44c8db7\") " pod="opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v"
Jul 06 01:55:03.822779 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:03.822593    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0d4f9c2-9724-4471-83ba-d85ba44c8db7-maas-api-tls\") pod \"maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v\" (UID: \"c0d4f9c2-9724-4471-83ba-d85ba44c8db7\") " pod="opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v"
Jul 06 01:55:03.822779 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:03.822614    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7cch\" (UniqueName: \"kubernetes.io/projected/c0d4f9c2-9724-4471-83ba-d85ba44c8db7-kube-api-access-d7cch\") pod \"maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v\" (UID: \"c0d4f9c2-9724-4471-83ba-d85ba44c8db7\") " pod="opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v"
Jul 06 01:55:03.923833 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:03.923787    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0d4f9c2-9724-4471-83ba-d85ba44c8db7-maas-api-tls\") pod \"maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v\" (UID: \"c0d4f9c2-9724-4471-83ba-d85ba44c8db7\") " pod="opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v"
Jul 06 01:55:03.924029 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:03.923841    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7cch\" (UniqueName: \"kubernetes.io/projected/c0d4f9c2-9724-4471-83ba-d85ba44c8db7-kube-api-access-d7cch\") pod \"maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v\" (UID: \"c0d4f9c2-9724-4471-83ba-d85ba44c8db7\") " pod="opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v"
Jul 06 01:55:03.924029 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:03.923907    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0d4f9c2-9724-4471-83ba-d85ba44c8db7-openshift-service-ca\") pod \"maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v\" (UID: \"c0d4f9c2-9724-4471-83ba-d85ba44c8db7\") " pod="opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v"
Jul 06 01:55:03.924029 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:55:03.923948    2584 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-migrate-d5d69b37-serving-cert: secret "maas-api-e2e-migrate-d5d69b37-serving-cert" not found
Jul 06 01:55:03.924029 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:55:03.924026    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0d4f9c2-9724-4471-83ba-d85ba44c8db7-maas-api-tls podName:c0d4f9c2-9724-4471-83ba-d85ba44c8db7 nodeName:}" failed. No retries permitted until 2026-07-06 01:55:04.424004136 +0000 UTC m=+1712.665771991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c0d4f9c2-9724-4471-83ba-d85ba44c8db7-maas-api-tls") pod "maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v" (UID: "c0d4f9c2-9724-4471-83ba-d85ba44c8db7") : secret "maas-api-e2e-migrate-d5d69b37-serving-cert" not found
Jul 06 01:55:03.924570 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:03.924549    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0d4f9c2-9724-4471-83ba-d85ba44c8db7-openshift-service-ca\") pod \"maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v\" (UID: \"c0d4f9c2-9724-4471-83ba-d85ba44c8db7\") " pod="opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v"
Jul 06 01:55:03.935350 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:03.935317    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7cch\" (UniqueName: \"kubernetes.io/projected/c0d4f9c2-9724-4471-83ba-d85ba44c8db7-kube-api-access-d7cch\") pod \"maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v\" (UID: \"c0d4f9c2-9724-4471-83ba-d85ba44c8db7\") " pod="opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v"
Jul 06 01:55:04.427803 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:04.427762    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0d4f9c2-9724-4471-83ba-d85ba44c8db7-maas-api-tls\") pod \"maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v\" (UID: \"c0d4f9c2-9724-4471-83ba-d85ba44c8db7\") " pod="opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v"
Jul 06 01:55:04.430260 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:04.430237    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0d4f9c2-9724-4471-83ba-d85ba44c8db7-maas-api-tls\") pod \"maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v\" (UID: \"c0d4f9c2-9724-4471-83ba-d85ba44c8db7\") " pod="opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v"
Jul 06 01:55:04.623685 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:04.623647    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v"
Jul 06 01:55:04.766716 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:04.766649    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v"]
Jul 06 01:55:04.769241 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:55:04.769207    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0d4f9c2_9724_4471_83ba_d85ba44c8db7.slice/crio-1af173318047c383af3edd138d46795576db020950e5153082078926523b09ba WatchSource:0}: Error finding container 1af173318047c383af3edd138d46795576db020950e5153082078926523b09ba: Status 404 returned error can't find the container with id 1af173318047c383af3edd138d46795576db020950e5153082078926523b09ba
Jul 06 01:55:05.470889 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:05.470847    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v" event={"ID":"c0d4f9c2-9724-4471-83ba-d85ba44c8db7","Type":"ContainerStarted","Data":"1af173318047c383af3edd138d46795576db020950e5153082078926523b09ba"}
Jul 06 01:55:06.477851 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:06.477812    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v" event={"ID":"c0d4f9c2-9724-4471-83ba-d85ba44c8db7","Type":"ContainerStarted","Data":"e935a588c5de26f19bf8fc4559e20a074005c2df9c593eb37e07b4ee79955517"}
Jul 06 01:55:06.478242 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:06.477893    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v"
Jul 06 01:55:06.497293 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:06.497236    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v" podStartSLOduration=2.508710899 podStartE2EDuration="3.497217014s" totalImagesPullingTime="988.506115ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:55:06.495550459 +0000 UTC m=+1714.737318326" watchObservedRunningTime="2026-07-06 01:55:06.497217014 +0000 UTC m=+1714.738984958"
Jul 06 01:55:08.598090 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:08.598053    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v"]
Jul 06 01:55:08.598590 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:08.598280    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v" podUID="c0d4f9c2-9724-4471-83ba-d85ba44c8db7" containerName="maas-api" containerID="cri-o://e935a588c5de26f19bf8fc4559e20a074005c2df9c593eb37e07b4ee79955517" gracePeriod=30
Jul 06 01:55:08.856392 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:08.856321    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v"
Jul 06 01:55:08.965370 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:08.965324    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0d4f9c2-9724-4471-83ba-d85ba44c8db7-maas-api-tls\") pod \"c0d4f9c2-9724-4471-83ba-d85ba44c8db7\" (UID: \"c0d4f9c2-9724-4471-83ba-d85ba44c8db7\") "
Jul 06 01:55:08.965534 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:08.965440    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0d4f9c2-9724-4471-83ba-d85ba44c8db7-openshift-service-ca\") pod \"c0d4f9c2-9724-4471-83ba-d85ba44c8db7\" (UID: \"c0d4f9c2-9724-4471-83ba-d85ba44c8db7\") "
Jul 06 01:55:08.965534 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:08.965467    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7cch\" (UniqueName: \"kubernetes.io/projected/c0d4f9c2-9724-4471-83ba-d85ba44c8db7-kube-api-access-d7cch\") pod \"c0d4f9c2-9724-4471-83ba-d85ba44c8db7\" (UID: \"c0d4f9c2-9724-4471-83ba-d85ba44c8db7\") "
Jul 06 01:55:08.965855 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:08.965829    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0d4f9c2-9724-4471-83ba-d85ba44c8db7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c0d4f9c2-9724-4471-83ba-d85ba44c8db7" (UID: "c0d4f9c2-9724-4471-83ba-d85ba44c8db7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:55:08.967575 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:08.967551    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0d4f9c2-9724-4471-83ba-d85ba44c8db7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c0d4f9c2-9724-4471-83ba-d85ba44c8db7" (UID: "c0d4f9c2-9724-4471-83ba-d85ba44c8db7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:55:08.967682 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:08.967637    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0d4f9c2-9724-4471-83ba-d85ba44c8db7-kube-api-access-d7cch" (OuterVolumeSpecName: "kube-api-access-d7cch") pod "c0d4f9c2-9724-4471-83ba-d85ba44c8db7" (UID: "c0d4f9c2-9724-4471-83ba-d85ba44c8db7"). InnerVolumeSpecName "kube-api-access-d7cch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:55:09.066350 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:09.066313    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0d4f9c2-9724-4471-83ba-d85ba44c8db7-openshift-service-ca\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:55:09.066350 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:09.066346    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7cch\" (UniqueName: \"kubernetes.io/projected/c0d4f9c2-9724-4471-83ba-d85ba44c8db7-kube-api-access-d7cch\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:55:09.066562 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:09.066361    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0d4f9c2-9724-4471-83ba-d85ba44c8db7-maas-api-tls\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:55:09.495689 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:09.495597    2584 generic.go:356] "Generic (PLEG): container finished" podID="c0d4f9c2-9724-4471-83ba-d85ba44c8db7" containerID="e935a588c5de26f19bf8fc4559e20a074005c2df9c593eb37e07b4ee79955517" exitCode=0
Jul 06 01:55:09.495689 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:09.495664    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v"
Jul 06 01:55:09.495904 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:09.495703    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v" event={"ID":"c0d4f9c2-9724-4471-83ba-d85ba44c8db7","Type":"ContainerDied","Data":"e935a588c5de26f19bf8fc4559e20a074005c2df9c593eb37e07b4ee79955517"}
Jul 06 01:55:09.495904 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:09.495758    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v" event={"ID":"c0d4f9c2-9724-4471-83ba-d85ba44c8db7","Type":"ContainerDied","Data":"1af173318047c383af3edd138d46795576db020950e5153082078926523b09ba"}
Jul 06 01:55:09.495904 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:09.495780    2584 scope.go:117] "RemoveContainer" containerID="e935a588c5de26f19bf8fc4559e20a074005c2df9c593eb37e07b4ee79955517"
Jul 06 01:55:09.504937 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:09.504913    2584 scope.go:117] "RemoveContainer" containerID="e935a588c5de26f19bf8fc4559e20a074005c2df9c593eb37e07b4ee79955517"
Jul 06 01:55:09.505254 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:55:09.505235    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e935a588c5de26f19bf8fc4559e20a074005c2df9c593eb37e07b4ee79955517\": container with ID starting with e935a588c5de26f19bf8fc4559e20a074005c2df9c593eb37e07b4ee79955517 not found: ID does not exist" containerID="e935a588c5de26f19bf8fc4559e20a074005c2df9c593eb37e07b4ee79955517"
Jul 06 01:55:09.505306 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:09.505267    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e935a588c5de26f19bf8fc4559e20a074005c2df9c593eb37e07b4ee79955517"} err="failed to get container status \"e935a588c5de26f19bf8fc4559e20a074005c2df9c593eb37e07b4ee79955517\": rpc error: code = NotFound desc = could not find container \"e935a588c5de26f19bf8fc4559e20a074005c2df9c593eb37e07b4ee79955517\": container with ID starting with e935a588c5de26f19bf8fc4559e20a074005c2df9c593eb37e07b4ee79955517 not found: ID does not exist"
Jul 06 01:55:09.517828 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:09.517794    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v"]
Jul 06 01:55:09.525191 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:09.525156    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-migrate-d5d69b37-6889bd597f-zfm6v"]
Jul 06 01:55:10.615768 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:10.615737    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0d4f9c2-9724-4471-83ba-d85ba44c8db7" path="/var/lib/kubelet/pods/c0d4f9c2-9724-4471-83ba-d85ba44c8db7/volumes"
Jul 06 01:55:15.870852 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:15.870816    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp"]
Jul 06 01:55:15.871331 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:15.871224    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0d4f9c2-9724-4471-83ba-d85ba44c8db7" containerName="maas-api"
Jul 06 01:55:15.871331 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:15.871239    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0d4f9c2-9724-4471-83ba-d85ba44c8db7" containerName="maas-api"
Jul 06 01:55:15.871445 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:15.871341    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0d4f9c2-9724-4471-83ba-d85ba44c8db7" containerName="maas-api"
Jul 06 01:55:15.875891 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:15.875864    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp"
Jul 06 01:55:15.878562 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:15.878524    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cfbht\""
Jul 06 01:55:15.878562 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:15.878552    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-a25d8b7a-serving-cert\""
Jul 06 01:55:15.885249 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:15.885136    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp"]
Jul 06 01:55:16.035717 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:16.035677    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d2f0a58-3726-4b42-93cb-3fed4de41c4a-openshift-service-ca\") pod \"maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp\" (UID: \"9d2f0a58-3726-4b42-93cb-3fed4de41c4a\") " pod="opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp"
Jul 06 01:55:16.035912 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:16.035735    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d2f0a58-3726-4b42-93cb-3fed4de41c4a-maas-api-tls\") pod \"maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp\" (UID: \"9d2f0a58-3726-4b42-93cb-3fed4de41c4a\") " pod="opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp"
Jul 06 01:55:16.035912 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:16.035766    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fhcb\" (UniqueName: \"kubernetes.io/projected/9d2f0a58-3726-4b42-93cb-3fed4de41c4a-kube-api-access-6fhcb\") pod \"maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp\" (UID: \"9d2f0a58-3726-4b42-93cb-3fed4de41c4a\") " pod="opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp"
Jul 06 01:55:16.136554 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:16.136469    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d2f0a58-3726-4b42-93cb-3fed4de41c4a-maas-api-tls\") pod \"maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp\" (UID: \"9d2f0a58-3726-4b42-93cb-3fed4de41c4a\") " pod="opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp"
Jul 06 01:55:16.136554 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:16.136509    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fhcb\" (UniqueName: \"kubernetes.io/projected/9d2f0a58-3726-4b42-93cb-3fed4de41c4a-kube-api-access-6fhcb\") pod \"maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp\" (UID: \"9d2f0a58-3726-4b42-93cb-3fed4de41c4a\") " pod="opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp"
Jul 06 01:55:16.136769 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:16.136662    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d2f0a58-3726-4b42-93cb-3fed4de41c4a-openshift-service-ca\") pod \"maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp\" (UID: \"9d2f0a58-3726-4b42-93cb-3fed4de41c4a\") " pod="opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp"
Jul 06 01:55:16.137303 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:16.137279    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d2f0a58-3726-4b42-93cb-3fed4de41c4a-openshift-service-ca\") pod \"maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp\" (UID: \"9d2f0a58-3726-4b42-93cb-3fed4de41c4a\") " pod="opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp"
Jul 06 01:55:16.138990 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:16.138969    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d2f0a58-3726-4b42-93cb-3fed4de41c4a-maas-api-tls\") pod \"maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp\" (UID: \"9d2f0a58-3726-4b42-93cb-3fed4de41c4a\") " pod="opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp"
Jul 06 01:55:16.145546 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:16.145517    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fhcb\" (UniqueName: \"kubernetes.io/projected/9d2f0a58-3726-4b42-93cb-3fed4de41c4a-kube-api-access-6fhcb\") pod \"maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp\" (UID: \"9d2f0a58-3726-4b42-93cb-3fed4de41c4a\") " pod="opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp"
Jul 06 01:55:16.192453 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:16.192413    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp"
Jul 06 01:55:16.336593 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:16.336520    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp"]
Jul 06 01:55:16.339137 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:55:16.339108    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d2f0a58_3726_4b42_93cb_3fed4de41c4a.slice/crio-d47be940734bbce509605707bf7a06c47a3465c3a7e288707357f9b24be47257 WatchSource:0}: Error finding container d47be940734bbce509605707bf7a06c47a3465c3a7e288707357f9b24be47257: Status 404 returned error can't find the container with id d47be940734bbce509605707bf7a06c47a3465c3a7e288707357f9b24be47257
Jul 06 01:55:16.535025 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:16.534933    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp" event={"ID":"9d2f0a58-3726-4b42-93cb-3fed4de41c4a","Type":"ContainerStarted","Data":"d47be940734bbce509605707bf7a06c47a3465c3a7e288707357f9b24be47257"}
Jul 06 01:55:17.545544 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:17.545501    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp" event={"ID":"9d2f0a58-3726-4b42-93cb-3fed4de41c4a","Type":"ContainerStarted","Data":"56a5d668aff049ef30220f19f6d5136eb13f58ff39b458ebe6da454e24d93d57"}
Jul 06 01:55:17.545978 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:17.545655    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp"
Jul 06 01:55:17.565392 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:17.565337    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp" podStartSLOduration=2.21600732 podStartE2EDuration="2.565321356s" totalImagesPullingTime="349.314036ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:55:17.563386651 +0000 UTC m=+1725.805154519" watchObservedRunningTime="2026-07-06 01:55:17.565321356 +0000 UTC m=+1725.807089223"
Jul 06 01:55:21.546440 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:21.546374    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp"]
Jul 06 01:55:21.546937 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:21.546598    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp" podUID="9d2f0a58-3726-4b42-93cb-3fed4de41c4a" containerName="maas-api" containerID="cri-o://56a5d668aff049ef30220f19f6d5136eb13f58ff39b458ebe6da454e24d93d57" gracePeriod=30
Jul 06 01:55:21.553076 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:21.553048    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp"
Jul 06 01:55:21.804038 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:21.803970    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp"
Jul 06 01:55:21.891756 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:21.891713    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fhcb\" (UniqueName: \"kubernetes.io/projected/9d2f0a58-3726-4b42-93cb-3fed4de41c4a-kube-api-access-6fhcb\") pod \"9d2f0a58-3726-4b42-93cb-3fed4de41c4a\" (UID: \"9d2f0a58-3726-4b42-93cb-3fed4de41c4a\") "
Jul 06 01:55:21.891756 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:21.891764    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d2f0a58-3726-4b42-93cb-3fed4de41c4a-openshift-service-ca\") pod \"9d2f0a58-3726-4b42-93cb-3fed4de41c4a\" (UID: \"9d2f0a58-3726-4b42-93cb-3fed4de41c4a\") "
Jul 06 01:55:21.891983 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:21.891894    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d2f0a58-3726-4b42-93cb-3fed4de41c4a-maas-api-tls\") pod \"9d2f0a58-3726-4b42-93cb-3fed4de41c4a\" (UID: \"9d2f0a58-3726-4b42-93cb-3fed4de41c4a\") "
Jul 06 01:55:21.892231 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:21.892193    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d2f0a58-3726-4b42-93cb-3fed4de41c4a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9d2f0a58-3726-4b42-93cb-3fed4de41c4a" (UID: "9d2f0a58-3726-4b42-93cb-3fed4de41c4a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:55:21.894094 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:21.894056    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d2f0a58-3726-4b42-93cb-3fed4de41c4a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9d2f0a58-3726-4b42-93cb-3fed4de41c4a" (UID: "9d2f0a58-3726-4b42-93cb-3fed4de41c4a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:55:21.894263 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:21.894162    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d2f0a58-3726-4b42-93cb-3fed4de41c4a-kube-api-access-6fhcb" (OuterVolumeSpecName: "kube-api-access-6fhcb") pod "9d2f0a58-3726-4b42-93cb-3fed4de41c4a" (UID: "9d2f0a58-3726-4b42-93cb-3fed4de41c4a"). InnerVolumeSpecName "kube-api-access-6fhcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:55:21.993207 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:21.993162    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d2f0a58-3726-4b42-93cb-3fed4de41c4a-maas-api-tls\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:55:21.993207 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:21.993197    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fhcb\" (UniqueName: \"kubernetes.io/projected/9d2f0a58-3726-4b42-93cb-3fed4de41c4a-kube-api-access-6fhcb\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:55:21.993207 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:21.993207    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d2f0a58-3726-4b42-93cb-3fed4de41c4a-openshift-service-ca\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:55:22.579004 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:22.578963    2584 generic.go:356] "Generic (PLEG): container finished" podID="9d2f0a58-3726-4b42-93cb-3fed4de41c4a" containerID="56a5d668aff049ef30220f19f6d5136eb13f58ff39b458ebe6da454e24d93d57" exitCode=0
Jul 06 01:55:22.579385 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:22.579010    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp"
Jul 06 01:55:22.579385 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:22.579046    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp" event={"ID":"9d2f0a58-3726-4b42-93cb-3fed4de41c4a","Type":"ContainerDied","Data":"56a5d668aff049ef30220f19f6d5136eb13f58ff39b458ebe6da454e24d93d57"}
Jul 06 01:55:22.579385 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:22.579100    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp" event={"ID":"9d2f0a58-3726-4b42-93cb-3fed4de41c4a","Type":"ContainerDied","Data":"d47be940734bbce509605707bf7a06c47a3465c3a7e288707357f9b24be47257"}
Jul 06 01:55:22.579385 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:22.579122    2584 scope.go:117] "RemoveContainer" containerID="56a5d668aff049ef30220f19f6d5136eb13f58ff39b458ebe6da454e24d93d57"
Jul 06 01:55:22.589158 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:22.589135    2584 scope.go:117] "RemoveContainer" containerID="56a5d668aff049ef30220f19f6d5136eb13f58ff39b458ebe6da454e24d93d57"
Jul 06 01:55:22.589568 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:55:22.589486    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56a5d668aff049ef30220f19f6d5136eb13f58ff39b458ebe6da454e24d93d57\": container with ID starting with 56a5d668aff049ef30220f19f6d5136eb13f58ff39b458ebe6da454e24d93d57 not found: ID does not exist" containerID="56a5d668aff049ef30220f19f6d5136eb13f58ff39b458ebe6da454e24d93d57"
Jul 06 01:55:22.589568 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:22.589530    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56a5d668aff049ef30220f19f6d5136eb13f58ff39b458ebe6da454e24d93d57"} err="failed to get container status \"56a5d668aff049ef30220f19f6d5136eb13f58ff39b458ebe6da454e24d93d57\": rpc error: code = NotFound desc = could not find container \"56a5d668aff049ef30220f19f6d5136eb13f58ff39b458ebe6da454e24d93d57\": container with ID starting with 56a5d668aff049ef30220f19f6d5136eb13f58ff39b458ebe6da454e24d93d57 not found: ID does not exist"
Jul 06 01:55:22.603862 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:22.603826    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp"]
Jul 06 01:55:22.616023 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:22.615993    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-a25d8b7a-76d5cc5c9d-pb4rp"]
Jul 06 01:55:24.615219 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:24.615181    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d2f0a58-3726-4b42-93cb-3fed4de41c4a" path="/var/lib/kubelet/pods/9d2f0a58-3726-4b42-93cb-3fed4de41c4a/volumes"
Jul 06 01:55:35.040243 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:35.040202    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx"]
Jul 06 01:55:35.040809 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:35.040793    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d2f0a58-3726-4b42-93cb-3fed4de41c4a" containerName="maas-api"
Jul 06 01:55:35.040858 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:35.040813    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d2f0a58-3726-4b42-93cb-3fed4de41c4a" containerName="maas-api"
Jul 06 01:55:35.040946 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:35.040935    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d2f0a58-3726-4b42-93cb-3fed4de41c4a" containerName="maas-api"
Jul 06 01:55:35.044454 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:35.044429    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx"
Jul 06 01:55:35.047266 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:35.047234    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-2cf0b5a9-serving-cert\""
Jul 06 01:55:35.047393 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:35.047361    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cfbht\""
Jul 06 01:55:35.054247 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:35.053808    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx"]
Jul 06 01:55:35.109065 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:35.109030    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21f97356-c6bb-4cab-aa5e-937675963317-maas-api-tls\") pod \"maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx\" (UID: \"21f97356-c6bb-4cab-aa5e-937675963317\") " pod="opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx"
Jul 06 01:55:35.109290 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:35.109083    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4jsp\" (UniqueName: \"kubernetes.io/projected/21f97356-c6bb-4cab-aa5e-937675963317-kube-api-access-g4jsp\") pod \"maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx\" (UID: \"21f97356-c6bb-4cab-aa5e-937675963317\") " pod="opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx"
Jul 06 01:55:35.109290 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:35.109195    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21f97356-c6bb-4cab-aa5e-937675963317-openshift-service-ca\") pod \"maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx\" (UID: \"21f97356-c6bb-4cab-aa5e-937675963317\") " pod="opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx"
Jul 06 01:55:35.210001 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:35.209955    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21f97356-c6bb-4cab-aa5e-937675963317-openshift-service-ca\") pod \"maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx\" (UID: \"21f97356-c6bb-4cab-aa5e-937675963317\") " pod="opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx"
Jul 06 01:55:35.210001 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:35.210003    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21f97356-c6bb-4cab-aa5e-937675963317-maas-api-tls\") pod \"maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx\" (UID: \"21f97356-c6bb-4cab-aa5e-937675963317\") " pod="opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx"
Jul 06 01:55:35.210273 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:35.210063    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4jsp\" (UniqueName: \"kubernetes.io/projected/21f97356-c6bb-4cab-aa5e-937675963317-kube-api-access-g4jsp\") pod \"maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx\" (UID: \"21f97356-c6bb-4cab-aa5e-937675963317\") " pod="opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx"
Jul 06 01:55:35.210273 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:55:35.210185    2584 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-2cf0b5a9-serving-cert: secret "maas-api-e2e-derive-2cf0b5a9-serving-cert" not found
Jul 06 01:55:35.210273 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:55:35.210255    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f97356-c6bb-4cab-aa5e-937675963317-maas-api-tls podName:21f97356-c6bb-4cab-aa5e-937675963317 nodeName:}" failed. No retries permitted until 2026-07-06 01:55:35.710237372 +0000 UTC m=+1743.952005216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/21f97356-c6bb-4cab-aa5e-937675963317-maas-api-tls") pod "maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx" (UID: "21f97356-c6bb-4cab-aa5e-937675963317") : secret "maas-api-e2e-derive-2cf0b5a9-serving-cert" not found
Jul 06 01:55:35.210740 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:35.210720    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21f97356-c6bb-4cab-aa5e-937675963317-openshift-service-ca\") pod \"maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx\" (UID: \"21f97356-c6bb-4cab-aa5e-937675963317\") " pod="opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx"
Jul 06 01:55:35.221580 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:35.221546    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4jsp\" (UniqueName: \"kubernetes.io/projected/21f97356-c6bb-4cab-aa5e-937675963317-kube-api-access-g4jsp\") pod \"maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx\" (UID: \"21f97356-c6bb-4cab-aa5e-937675963317\") " pod="opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx"
Jul 06 01:55:35.715780 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:35.715742    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21f97356-c6bb-4cab-aa5e-937675963317-maas-api-tls\") pod \"maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx\" (UID: \"21f97356-c6bb-4cab-aa5e-937675963317\") " pod="opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx"
Jul 06 01:55:35.718186 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:35.718165    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21f97356-c6bb-4cab-aa5e-937675963317-maas-api-tls\") pod \"maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx\" (UID: \"21f97356-c6bb-4cab-aa5e-937675963317\") " pod="opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx"
Jul 06 01:55:35.958424 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:35.958374    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx"
Jul 06 01:55:36.108181 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:36.108114    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx"]
Jul 06 01:55:36.110810 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:55:36.110776    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f97356_c6bb_4cab_aa5e_937675963317.slice/crio-140b36754c9e47aa6810d18d9ba9b371c14915fe7704f1782973e379d088bbb1 WatchSource:0}: Error finding container 140b36754c9e47aa6810d18d9ba9b371c14915fe7704f1782973e379d088bbb1: Status 404 returned error can't find the container with id 140b36754c9e47aa6810d18d9ba9b371c14915fe7704f1782973e379d088bbb1
Jul 06 01:55:36.652327 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:36.652289    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx" event={"ID":"21f97356-c6bb-4cab-aa5e-937675963317","Type":"ContainerStarted","Data":"2b5a636c9237b14e900f0c2c6bc8bd1f8065fc8d5f93403f2f4c244baba7ecee"}
Jul 06 01:55:36.652537 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:36.652343    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx" event={"ID":"21f97356-c6bb-4cab-aa5e-937675963317","Type":"ContainerStarted","Data":"140b36754c9e47aa6810d18d9ba9b371c14915fe7704f1782973e379d088bbb1"}
Jul 06 01:55:36.652537 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:36.652378    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx"
Jul 06 01:55:36.672431 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:36.672368    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx" podStartSLOduration=1.291468117 podStartE2EDuration="1.67235033s" totalImagesPullingTime="380.882213ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:55:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:55:36.670368962 +0000 UTC m=+1744.912136826" watchObservedRunningTime="2026-07-06 01:55:36.67235033 +0000 UTC m=+1744.914118197"
Jul 06 01:55:37.543303 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:37.543258    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:55:39.857021 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:39.856987    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx"]
Jul 06 01:55:39.857467 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:39.857210    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx" podUID="21f97356-c6bb-4cab-aa5e-937675963317" containerName="maas-api" containerID="cri-o://2b5a636c9237b14e900f0c2c6bc8bd1f8065fc8d5f93403f2f4c244baba7ecee" gracePeriod=30
Jul 06 01:55:40.111153 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:40.111086    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx"
Jul 06 01:55:40.156930 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:40.156894    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4jsp\" (UniqueName: \"kubernetes.io/projected/21f97356-c6bb-4cab-aa5e-937675963317-kube-api-access-g4jsp\") pod \"21f97356-c6bb-4cab-aa5e-937675963317\" (UID: \"21f97356-c6bb-4cab-aa5e-937675963317\") "
Jul 06 01:55:40.157125 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:40.156945    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21f97356-c6bb-4cab-aa5e-937675963317-openshift-service-ca\") pod \"21f97356-c6bb-4cab-aa5e-937675963317\" (UID: \"21f97356-c6bb-4cab-aa5e-937675963317\") "
Jul 06 01:55:40.157125 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:40.156996    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21f97356-c6bb-4cab-aa5e-937675963317-maas-api-tls\") pod \"21f97356-c6bb-4cab-aa5e-937675963317\" (UID: \"21f97356-c6bb-4cab-aa5e-937675963317\") "
Jul 06 01:55:40.157391 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:40.157365    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21f97356-c6bb-4cab-aa5e-937675963317-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "21f97356-c6bb-4cab-aa5e-937675963317" (UID: "21f97356-c6bb-4cab-aa5e-937675963317"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:55:40.159218 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:40.159185    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21f97356-c6bb-4cab-aa5e-937675963317-kube-api-access-g4jsp" (OuterVolumeSpecName: "kube-api-access-g4jsp") pod "21f97356-c6bb-4cab-aa5e-937675963317" (UID: "21f97356-c6bb-4cab-aa5e-937675963317"). InnerVolumeSpecName "kube-api-access-g4jsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:55:40.159218 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:40.159186    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21f97356-c6bb-4cab-aa5e-937675963317-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "21f97356-c6bb-4cab-aa5e-937675963317" (UID: "21f97356-c6bb-4cab-aa5e-937675963317"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:55:40.258120 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:40.258068    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4jsp\" (UniqueName: \"kubernetes.io/projected/21f97356-c6bb-4cab-aa5e-937675963317-kube-api-access-g4jsp\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:55:40.258120 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:40.258113    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21f97356-c6bb-4cab-aa5e-937675963317-openshift-service-ca\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:55:40.258120 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:40.258124    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21f97356-c6bb-4cab-aa5e-937675963317-maas-api-tls\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:55:40.673217 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:40.673183    2584 generic.go:356] "Generic (PLEG): container finished" podID="21f97356-c6bb-4cab-aa5e-937675963317" containerID="2b5a636c9237b14e900f0c2c6bc8bd1f8065fc8d5f93403f2f4c244baba7ecee" exitCode=0
Jul 06 01:55:40.673393 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:40.673232    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx"
Jul 06 01:55:40.673393 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:40.673264    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx" event={"ID":"21f97356-c6bb-4cab-aa5e-937675963317","Type":"ContainerDied","Data":"2b5a636c9237b14e900f0c2c6bc8bd1f8065fc8d5f93403f2f4c244baba7ecee"}
Jul 06 01:55:40.673393 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:40.673318    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx" event={"ID":"21f97356-c6bb-4cab-aa5e-937675963317","Type":"ContainerDied","Data":"140b36754c9e47aa6810d18d9ba9b371c14915fe7704f1782973e379d088bbb1"}
Jul 06 01:55:40.673393 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:40.673343    2584 scope.go:117] "RemoveContainer" containerID="2b5a636c9237b14e900f0c2c6bc8bd1f8065fc8d5f93403f2f4c244baba7ecee"
Jul 06 01:55:40.683051 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:40.683028    2584 scope.go:117] "RemoveContainer" containerID="2b5a636c9237b14e900f0c2c6bc8bd1f8065fc8d5f93403f2f4c244baba7ecee"
Jul 06 01:55:40.683420 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:55:40.683390    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b5a636c9237b14e900f0c2c6bc8bd1f8065fc8d5f93403f2f4c244baba7ecee\": container with ID starting with 2b5a636c9237b14e900f0c2c6bc8bd1f8065fc8d5f93403f2f4c244baba7ecee not found: ID does not exist" containerID="2b5a636c9237b14e900f0c2c6bc8bd1f8065fc8d5f93403f2f4c244baba7ecee"
Jul 06 01:55:40.683534 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:40.683427    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b5a636c9237b14e900f0c2c6bc8bd1f8065fc8d5f93403f2f4c244baba7ecee"} err="failed to get container status \"2b5a636c9237b14e900f0c2c6bc8bd1f8065fc8d5f93403f2f4c244baba7ecee\": rpc error: code = NotFound desc = could not find container \"2b5a636c9237b14e900f0c2c6bc8bd1f8065fc8d5f93403f2f4c244baba7ecee\": container with ID starting with 2b5a636c9237b14e900f0c2c6bc8bd1f8065fc8d5f93403f2f4c244baba7ecee not found: ID does not exist"
Jul 06 01:55:40.691823 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:40.691782    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx"]
Jul 06 01:55:40.696827 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:40.696791    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-2cf0b5a9-5fbdc874d7-tsxfx"]
Jul 06 01:55:42.616075 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:42.616041    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21f97356-c6bb-4cab-aa5e-937675963317" path="/var/lib/kubelet/pods/21f97356-c6bb-4cab-aa5e-937675963317/volumes"
Jul 06 01:55:46.142004 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:55:46.141957    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:57:08.139117 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:08.139079    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:57:15.653565 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:15.653528    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:57:24.049816 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:24.049781    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:57:25.064807 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:25.064770    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6"]
Jul 06 01:57:25.065312 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:25.065298    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f97356-c6bb-4cab-aa5e-937675963317" containerName="maas-api"
Jul 06 01:57:25.065359 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:25.065314    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f97356-c6bb-4cab-aa5e-937675963317" containerName="maas-api"
Jul 06 01:57:25.065426 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:25.065415    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="21f97356-c6bb-4cab-aa5e-937675963317" containerName="maas-api"
Jul 06 01:57:25.068844 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:25.068822    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6"
Jul 06 01:57:25.072681 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:25.072653    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-5a7d0b17-serving-cert\""
Jul 06 01:57:25.072823 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:25.072660    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cfbht\""
Jul 06 01:57:25.087399 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:25.087359    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6"]
Jul 06 01:57:25.108599 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:25.108564    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-697gl\" (UniqueName: \"kubernetes.io/projected/527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4-kube-api-access-697gl\") pod \"maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6\" (UID: \"527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4\") " pod="opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6"
Jul 06 01:57:25.108781 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:25.108637    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4-openshift-service-ca\") pod \"maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6\" (UID: \"527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4\") " pod="opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6"
Jul 06 01:57:25.108781 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:25.108659    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4-maas-api-tls\") pod \"maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6\" (UID: \"527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4\") " pod="opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6"
Jul 06 01:57:25.209460 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:25.209416    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4-openshift-service-ca\") pod \"maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6\" (UID: \"527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4\") " pod="opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6"
Jul 06 01:57:25.209460 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:25.209455    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4-maas-api-tls\") pod \"maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6\" (UID: \"527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4\") " pod="opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6"
Jul 06 01:57:25.209775 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:25.209512    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-697gl\" (UniqueName: \"kubernetes.io/projected/527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4-kube-api-access-697gl\") pod \"maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6\" (UID: \"527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4\") " pod="opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6"
Jul 06 01:57:25.209775 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:57:25.209649    2584 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-5a7d0b17-serving-cert: secret "maas-api-e2e-mt-5a7d0b17-serving-cert" not found
Jul 06 01:57:25.209775 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:57:25.209721    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4-maas-api-tls podName:527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4 nodeName:}" failed. No retries permitted until 2026-07-06 01:57:25.709702008 +0000 UTC m=+1853.951469872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4-maas-api-tls") pod "maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6" (UID: "527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4") : secret "maas-api-e2e-mt-5a7d0b17-serving-cert" not found
Jul 06 01:57:25.210165 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:25.210145    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4-openshift-service-ca\") pod \"maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6\" (UID: \"527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4\") " pod="opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6"
Jul 06 01:57:25.219113 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:25.219084    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-697gl\" (UniqueName: \"kubernetes.io/projected/527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4-kube-api-access-697gl\") pod \"maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6\" (UID: \"527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4\") " pod="opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6"
Jul 06 01:57:25.714704 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:25.714668    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4-maas-api-tls\") pod \"maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6\" (UID: \"527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4\") " pod="opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6"
Jul 06 01:57:25.717333 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:25.717307    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4-maas-api-tls\") pod \"maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6\" (UID: \"527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4\") " pod="opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6"
Jul 06 01:57:25.981610 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:25.981515    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6"
Jul 06 01:57:26.135121 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:26.135093    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6"]
Jul 06 01:57:26.138053 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:57:26.138025    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod527ecf3c_1ec6_4ca5_a553_4ae58d97c2e4.slice/crio-8d2fddb9ce2fefd540555bbb8d6000590cab061380b4d973004506d8e3f79ff5 WatchSource:0}: Error finding container 8d2fddb9ce2fefd540555bbb8d6000590cab061380b4d973004506d8e3f79ff5: Status 404 returned error can't find the container with id 8d2fddb9ce2fefd540555bbb8d6000590cab061380b4d973004506d8e3f79ff5
Jul 06 01:57:26.194558 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:26.194524    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6" event={"ID":"527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4","Type":"ContainerStarted","Data":"8d2fddb9ce2fefd540555bbb8d6000590cab061380b4d973004506d8e3f79ff5"}
Jul 06 01:57:27.201257 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:27.201220    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6" event={"ID":"527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4","Type":"ContainerStarted","Data":"728029b74578a9ab864cb4c47f3a8817fc0d84e70fa8161219e1874a70a7c986"}
Jul 06 01:57:27.201687 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:27.201352    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6"
Jul 06 01:57:27.224968 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:27.224908    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6" podStartSLOduration=1.706266195 podStartE2EDuration="2.224890449s" totalImagesPullingTime="518.624254ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:57:27.223214434 +0000 UTC m=+1855.464982303" watchObservedRunningTime="2026-07-06 01:57:27.224890449 +0000 UTC m=+1855.466658316"
Jul 06 01:57:33.211554 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:33.211522    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6"
Jul 06 01:57:34.047413 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:34.047370    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:57:37.403816 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:37.403776    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6"]
Jul 06 01:57:37.404367 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:37.404077    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6" podUID="527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4" containerName="maas-api" containerID="cri-o://728029b74578a9ab864cb4c47f3a8817fc0d84e70fa8161219e1874a70a7c986" gracePeriod=30
Jul 06 01:57:37.665572 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:37.665494    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6"
Jul 06 01:57:37.834804 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:37.834758    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4-openshift-service-ca\") pod \"527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4\" (UID: \"527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4\") "
Jul 06 01:57:37.835008 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:37.834823    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4-maas-api-tls\") pod \"527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4\" (UID: \"527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4\") "
Jul 06 01:57:37.835008 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:37.834928    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-697gl\" (UniqueName: \"kubernetes.io/projected/527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4-kube-api-access-697gl\") pod \"527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4\" (UID: \"527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4\") "
Jul 06 01:57:37.835262 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:37.835230    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4" (UID: "527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:57:37.837087 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:37.837050    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4" (UID: "527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:57:37.837206 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:37.837105    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4-kube-api-access-697gl" (OuterVolumeSpecName: "kube-api-access-697gl") pod "527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4" (UID: "527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4"). InnerVolumeSpecName "kube-api-access-697gl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:57:37.936405 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:37.936308    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-697gl\" (UniqueName: \"kubernetes.io/projected/527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4-kube-api-access-697gl\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:57:37.936405 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:37.936344    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4-openshift-service-ca\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:57:37.936405 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:37.936354    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4-maas-api-tls\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 01:57:38.263406 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:38.263309    2584 generic.go:356] "Generic (PLEG): container finished" podID="527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4" containerID="728029b74578a9ab864cb4c47f3a8817fc0d84e70fa8161219e1874a70a7c986" exitCode=0
Jul 06 01:57:38.263406 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:38.263349    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6"
Jul 06 01:57:38.263406 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:38.263367    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6" event={"ID":"527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4","Type":"ContainerDied","Data":"728029b74578a9ab864cb4c47f3a8817fc0d84e70fa8161219e1874a70a7c986"}
Jul 06 01:57:38.263406 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:38.263412    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6" event={"ID":"527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4","Type":"ContainerDied","Data":"8d2fddb9ce2fefd540555bbb8d6000590cab061380b4d973004506d8e3f79ff5"}
Jul 06 01:57:38.263826 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:38.263435    2584 scope.go:117] "RemoveContainer" containerID="728029b74578a9ab864cb4c47f3a8817fc0d84e70fa8161219e1874a70a7c986"
Jul 06 01:57:38.273372 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:38.273346    2584 scope.go:117] "RemoveContainer" containerID="728029b74578a9ab864cb4c47f3a8817fc0d84e70fa8161219e1874a70a7c986"
Jul 06 01:57:38.273746 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:57:38.273723    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"728029b74578a9ab864cb4c47f3a8817fc0d84e70fa8161219e1874a70a7c986\": container with ID starting with 728029b74578a9ab864cb4c47f3a8817fc0d84e70fa8161219e1874a70a7c986 not found: ID does not exist" containerID="728029b74578a9ab864cb4c47f3a8817fc0d84e70fa8161219e1874a70a7c986"
Jul 06 01:57:38.273804 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:38.273755    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"728029b74578a9ab864cb4c47f3a8817fc0d84e70fa8161219e1874a70a7c986"} err="failed to get container status \"728029b74578a9ab864cb4c47f3a8817fc0d84e70fa8161219e1874a70a7c986\": rpc error: code = NotFound desc = could not find container \"728029b74578a9ab864cb4c47f3a8817fc0d84e70fa8161219e1874a70a7c986\": container with ID starting with 728029b74578a9ab864cb4c47f3a8817fc0d84e70fa8161219e1874a70a7c986 not found: ID does not exist"
Jul 06 01:57:38.288417 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:38.288383    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6"]
Jul 06 01:57:38.292617 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:38.292587    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-5a7d0b17-68d6d78db-8lxs6"]
Jul 06 01:57:38.616973 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:38.616935    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4" path="/var/lib/kubelet/pods/527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4/volumes"
Jul 06 01:57:41.437046 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:57:41.437004    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:58:07.590716 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:07.590675    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f"]
Jul 06 01:58:07.591184 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:07.591056    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4" containerName="maas-api"
Jul 06 01:58:07.591184 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:07.591067    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4" containerName="maas-api"
Jul 06 01:58:07.591184 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:07.591136    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="527ecf3c-1ec6-4ca5-a553-4ae58d97c2e4" containerName="maas-api"
Jul 06 01:58:07.594216 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:07.594197    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f"
Jul 06 01:58:07.597132 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:07.597110    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-95397071-serving-cert\""
Jul 06 01:58:07.597287 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:07.597133    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cfbht\""
Jul 06 01:58:07.605947 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:07.605916    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f"]
Jul 06 01:58:07.709700 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:07.709658    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwjmp\" (UniqueName: \"kubernetes.io/projected/489c7434-1c8c-434e-ab74-7f81d0329c35-kube-api-access-wwjmp\") pod \"maas-api-e2e-mt-95397071-647d4bcccb-wkm4f\" (UID: \"489c7434-1c8c-434e-ab74-7f81d0329c35\") " pod="opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f"
Jul 06 01:58:07.709915 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:07.709712    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/489c7434-1c8c-434e-ab74-7f81d0329c35-maas-api-tls\") pod \"maas-api-e2e-mt-95397071-647d4bcccb-wkm4f\" (UID: \"489c7434-1c8c-434e-ab74-7f81d0329c35\") " pod="opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f"
Jul 06 01:58:07.709915 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:07.709806    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/489c7434-1c8c-434e-ab74-7f81d0329c35-openshift-service-ca\") pod \"maas-api-e2e-mt-95397071-647d4bcccb-wkm4f\" (UID: \"489c7434-1c8c-434e-ab74-7f81d0329c35\") " pod="opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f"
Jul 06 01:58:07.811095 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:07.811048    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwjmp\" (UniqueName: \"kubernetes.io/projected/489c7434-1c8c-434e-ab74-7f81d0329c35-kube-api-access-wwjmp\") pod \"maas-api-e2e-mt-95397071-647d4bcccb-wkm4f\" (UID: \"489c7434-1c8c-434e-ab74-7f81d0329c35\") " pod="opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f"
Jul 06 01:58:07.811312 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:07.811122    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/489c7434-1c8c-434e-ab74-7f81d0329c35-maas-api-tls\") pod \"maas-api-e2e-mt-95397071-647d4bcccb-wkm4f\" (UID: \"489c7434-1c8c-434e-ab74-7f81d0329c35\") " pod="opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f"
Jul 06 01:58:07.811312 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:07.811178    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/489c7434-1c8c-434e-ab74-7f81d0329c35-openshift-service-ca\") pod \"maas-api-e2e-mt-95397071-647d4bcccb-wkm4f\" (UID: \"489c7434-1c8c-434e-ab74-7f81d0329c35\") " pod="opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f"
Jul 06 01:58:07.811312 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:58:07.811282    2584 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-95397071-serving-cert: secret "maas-api-e2e-mt-95397071-serving-cert" not found
Jul 06 01:58:07.811442 ip-10-0-128-8 kubenswrapper[2584]: E0706 01:58:07.811361    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/489c7434-1c8c-434e-ab74-7f81d0329c35-maas-api-tls podName:489c7434-1c8c-434e-ab74-7f81d0329c35 nodeName:}" failed. No retries permitted until 2026-07-06 01:58:08.311344746 +0000 UTC m=+1896.553112591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/489c7434-1c8c-434e-ab74-7f81d0329c35-maas-api-tls") pod "maas-api-e2e-mt-95397071-647d4bcccb-wkm4f" (UID: "489c7434-1c8c-434e-ab74-7f81d0329c35") : secret "maas-api-e2e-mt-95397071-serving-cert" not found
Jul 06 01:58:07.811899 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:07.811877    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/489c7434-1c8c-434e-ab74-7f81d0329c35-openshift-service-ca\") pod \"maas-api-e2e-mt-95397071-647d4bcccb-wkm4f\" (UID: \"489c7434-1c8c-434e-ab74-7f81d0329c35\") " pod="opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f"
Jul 06 01:58:07.822109 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:07.822083    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwjmp\" (UniqueName: \"kubernetes.io/projected/489c7434-1c8c-434e-ab74-7f81d0329c35-kube-api-access-wwjmp\") pod \"maas-api-e2e-mt-95397071-647d4bcccb-wkm4f\" (UID: \"489c7434-1c8c-434e-ab74-7f81d0329c35\") " pod="opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f"
Jul 06 01:58:08.316883 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:08.316839    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/489c7434-1c8c-434e-ab74-7f81d0329c35-maas-api-tls\") pod \"maas-api-e2e-mt-95397071-647d4bcccb-wkm4f\" (UID: \"489c7434-1c8c-434e-ab74-7f81d0329c35\") " pod="opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f"
Jul 06 01:58:08.319497 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:08.319468    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/489c7434-1c8c-434e-ab74-7f81d0329c35-maas-api-tls\") pod \"maas-api-e2e-mt-95397071-647d4bcccb-wkm4f\" (UID: \"489c7434-1c8c-434e-ab74-7f81d0329c35\") " pod="opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f"
Jul 06 01:58:08.506744 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:08.506692    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f"
Jul 06 01:58:08.659504 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:08.659461    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f"]
Jul 06 01:58:08.665523 ip-10-0-128-8 kubenswrapper[2584]: W0706 01:58:08.665490    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod489c7434_1c8c_434e_ab74_7f81d0329c35.slice/crio-5221c61208bdefb4c15af2ba6407ee1ae3561ab0283901773abf0c10b119e972 WatchSource:0}: Error finding container 5221c61208bdefb4c15af2ba6407ee1ae3561ab0283901773abf0c10b119e972: Status 404 returned error can't find the container with id 5221c61208bdefb4c15af2ba6407ee1ae3561ab0283901773abf0c10b119e972
Jul 06 01:58:09.428961 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:09.428924    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f" event={"ID":"489c7434-1c8c-434e-ab74-7f81d0329c35","Type":"ContainerStarted","Data":"af6a0e22d1f3ccbcb689569692c30e22319676a851a24016dbdeb59ef77fa243"}
Jul 06 01:58:09.429180 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:09.428980    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f" event={"ID":"489c7434-1c8c-434e-ab74-7f81d0329c35","Type":"ContainerStarted","Data":"5221c61208bdefb4c15af2ba6407ee1ae3561ab0283901773abf0c10b119e972"}
Jul 06 01:58:09.429180 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:09.429007    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f"
Jul 06 01:58:09.451209 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:09.451145    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f" podStartSLOduration=2.074441678 podStartE2EDuration="2.45112329s" totalImagesPullingTime="376.681612ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:58:09.450805548 +0000 UTC m=+1897.692573415" watchObservedRunningTime="2026-07-06 01:58:09.45112329 +0000 UTC m=+1897.692891154"
Jul 06 01:58:13.640458 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:13.640405    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 01:58:15.440293 ip-10-0-128-8 kubenswrapper[2584]: I0706 01:58:15.440263    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f"
Jul 06 02:00:00.138123 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:00:00.138086    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-mt-95397071-29721720-zdvzm"]
Jul 06 02:00:00.141669 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:00:00.141646    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-mt-95397071-29721720-zdvzm"
Jul 06 02:00:00.156869 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:00:00.156837    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-mt-95397071-29721720-zdvzm"]
Jul 06 02:00:00.166945 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:00:00.166911    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8lq4\" (UniqueName: \"kubernetes.io/projected/a4d1d5a6-2fcf-4607-aa4b-626b15f5ba9a-kube-api-access-b8lq4\") pod \"maas-api-key-cleanup-e2e-mt-95397071-29721720-zdvzm\" (UID: \"a4d1d5a6-2fcf-4607-aa4b-626b15f5ba9a\") " pod="opendatahub/maas-api-key-cleanup-e2e-mt-95397071-29721720-zdvzm"
Jul 06 02:00:00.267872 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:00:00.267834    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8lq4\" (UniqueName: \"kubernetes.io/projected/a4d1d5a6-2fcf-4607-aa4b-626b15f5ba9a-kube-api-access-b8lq4\") pod \"maas-api-key-cleanup-e2e-mt-95397071-29721720-zdvzm\" (UID: \"a4d1d5a6-2fcf-4607-aa4b-626b15f5ba9a\") " pod="opendatahub/maas-api-key-cleanup-e2e-mt-95397071-29721720-zdvzm"
Jul 06 02:00:00.277042 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:00:00.277008    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8lq4\" (UniqueName: \"kubernetes.io/projected/a4d1d5a6-2fcf-4607-aa4b-626b15f5ba9a-kube-api-access-b8lq4\") pod \"maas-api-key-cleanup-e2e-mt-95397071-29721720-zdvzm\" (UID: \"a4d1d5a6-2fcf-4607-aa4b-626b15f5ba9a\") " pod="opendatahub/maas-api-key-cleanup-e2e-mt-95397071-29721720-zdvzm"
Jul 06 02:00:00.452314 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:00:00.452219    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-mt-95397071-29721720-zdvzm"
Jul 06 02:00:00.586113 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:00:00.586085    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-mt-95397071-29721720-zdvzm"]
Jul 06 02:00:00.588326 ip-10-0-128-8 kubenswrapper[2584]: W0706 02:00:00.588293    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4d1d5a6_2fcf_4607_aa4b_626b15f5ba9a.slice/crio-1d88617a3426609636cf69245bf12c3650ed329ee3cceff0db9e20b112e1f33b WatchSource:0}: Error finding container 1d88617a3426609636cf69245bf12c3650ed329ee3cceff0db9e20b112e1f33b: Status 404 returned error can't find the container with id 1d88617a3426609636cf69245bf12c3650ed329ee3cceff0db9e20b112e1f33b
Jul 06 02:00:00.985590 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:00:00.985547    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-mt-95397071-29721720-zdvzm" event={"ID":"a4d1d5a6-2fcf-4607-aa4b-626b15f5ba9a","Type":"ContainerStarted","Data":"5783b4721fa1ac7957955b4e4c4c0bfcaf3e15534a1e9545e3231977e45bdbeb"}
Jul 06 02:00:00.985811 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:00:00.985615    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-mt-95397071-29721720-zdvzm" event={"ID":"a4d1d5a6-2fcf-4607-aa4b-626b15f5ba9a","Type":"ContainerStarted","Data":"1d88617a3426609636cf69245bf12c3650ed329ee3cceff0db9e20b112e1f33b"}
Jul 06 02:00:01.002109 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:00:01.002055    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-mt-95397071-29721720-zdvzm" podStartSLOduration=1.002039409 podStartE2EDuration="1.002039409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:00:01.000542277 +0000 UTC m=+2009.242310166" watchObservedRunningTime="2026-07-06 02:00:01.002039409 +0000 UTC m=+2009.243807276"
Jul 06 02:00:01.992081 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:00:01.992038    2584 generic.go:356] "Generic (PLEG): container finished" podID="a4d1d5a6-2fcf-4607-aa4b-626b15f5ba9a" containerID="5783b4721fa1ac7957955b4e4c4c0bfcaf3e15534a1e9545e3231977e45bdbeb" exitCode=0
Jul 06 02:00:01.992466 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:00:01.992102    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-mt-95397071-29721720-zdvzm" event={"ID":"a4d1d5a6-2fcf-4607-aa4b-626b15f5ba9a","Type":"ContainerDied","Data":"5783b4721fa1ac7957955b4e4c4c0bfcaf3e15534a1e9545e3231977e45bdbeb"}
Jul 06 02:00:03.139521 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:00:03.139494    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-mt-95397071-29721720-zdvzm"
Jul 06 02:00:03.195807 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:00:03.195771    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8lq4\" (UniqueName: \"kubernetes.io/projected/a4d1d5a6-2fcf-4607-aa4b-626b15f5ba9a-kube-api-access-b8lq4\") pod \"a4d1d5a6-2fcf-4607-aa4b-626b15f5ba9a\" (UID: \"a4d1d5a6-2fcf-4607-aa4b-626b15f5ba9a\") "
Jul 06 02:00:03.197946 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:00:03.197911    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4d1d5a6-2fcf-4607-aa4b-626b15f5ba9a-kube-api-access-b8lq4" (OuterVolumeSpecName: "kube-api-access-b8lq4") pod "a4d1d5a6-2fcf-4607-aa4b-626b15f5ba9a" (UID: "a4d1d5a6-2fcf-4607-aa4b-626b15f5ba9a"). InnerVolumeSpecName "kube-api-access-b8lq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:00:03.297329 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:00:03.297235    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8lq4\" (UniqueName: \"kubernetes.io/projected/a4d1d5a6-2fcf-4607-aa4b-626b15f5ba9a-kube-api-access-b8lq4\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:00:04.003865 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:00:04.003829    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-mt-95397071-29721720-zdvzm"
Jul 06 02:00:04.003865 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:00:04.003847    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-mt-95397071-29721720-zdvzm" event={"ID":"a4d1d5a6-2fcf-4607-aa4b-626b15f5ba9a","Type":"ContainerDied","Data":"1d88617a3426609636cf69245bf12c3650ed329ee3cceff0db9e20b112e1f33b"}
Jul 06 02:00:04.004142 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:00:04.003900    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d88617a3426609636cf69245bf12c3650ed329ee3cceff0db9e20b112e1f33b"
Jul 06 02:01:16.958282 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:16.958234    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f"]
Jul 06 02:01:16.959214 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:16.959147    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f" podUID="489c7434-1c8c-434e-ab74-7f81d0329c35" containerName="maas-api" containerID="cri-o://af6a0e22d1f3ccbcb689569692c30e22319676a851a24016dbdeb59ef77fa243" gracePeriod=30
Jul 06 02:01:16.990094 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:16.990004    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-mt-95397071-29721720-zdvzm"]
Jul 06 02:01:16.992441 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:16.992408    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-mt-95397071-29721720-zdvzm"]
Jul 06 02:01:17.218354 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:17.218282    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f"
Jul 06 02:01:17.371370 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:17.371338    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwjmp\" (UniqueName: \"kubernetes.io/projected/489c7434-1c8c-434e-ab74-7f81d0329c35-kube-api-access-wwjmp\") pod \"489c7434-1c8c-434e-ab74-7f81d0329c35\" (UID: \"489c7434-1c8c-434e-ab74-7f81d0329c35\") "
Jul 06 02:01:17.371554 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:17.371420    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/489c7434-1c8c-434e-ab74-7f81d0329c35-openshift-service-ca\") pod \"489c7434-1c8c-434e-ab74-7f81d0329c35\" (UID: \"489c7434-1c8c-434e-ab74-7f81d0329c35\") "
Jul 06 02:01:17.371554 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:17.371461    2584 generic.go:356] "Generic (PLEG): container finished" podID="489c7434-1c8c-434e-ab74-7f81d0329c35" containerID="af6a0e22d1f3ccbcb689569692c30e22319676a851a24016dbdeb59ef77fa243" exitCode=0
Jul 06 02:01:17.371554 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:17.371507    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/489c7434-1c8c-434e-ab74-7f81d0329c35-maas-api-tls\") pod \"489c7434-1c8c-434e-ab74-7f81d0329c35\" (UID: \"489c7434-1c8c-434e-ab74-7f81d0329c35\") "
Jul 06 02:01:17.371756 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:17.371561    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f"
Jul 06 02:01:17.371756 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:17.371581    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f" event={"ID":"489c7434-1c8c-434e-ab74-7f81d0329c35","Type":"ContainerDied","Data":"af6a0e22d1f3ccbcb689569692c30e22319676a851a24016dbdeb59ef77fa243"}
Jul 06 02:01:17.371866 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:17.371762    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f" event={"ID":"489c7434-1c8c-434e-ab74-7f81d0329c35","Type":"ContainerDied","Data":"5221c61208bdefb4c15af2ba6407ee1ae3561ab0283901773abf0c10b119e972"}
Jul 06 02:01:17.371866 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:17.371805    2584 scope.go:117] "RemoveContainer" containerID="af6a0e22d1f3ccbcb689569692c30e22319676a851a24016dbdeb59ef77fa243"
Jul 06 02:01:17.371968 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:17.371859    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/489c7434-1c8c-434e-ab74-7f81d0329c35-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "489c7434-1c8c-434e-ab74-7f81d0329c35" (UID: "489c7434-1c8c-434e-ab74-7f81d0329c35"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:01:17.374253 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:17.374219    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/489c7434-1c8c-434e-ab74-7f81d0329c35-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "489c7434-1c8c-434e-ab74-7f81d0329c35" (UID: "489c7434-1c8c-434e-ab74-7f81d0329c35"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:01:17.374253 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:17.374213    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/489c7434-1c8c-434e-ab74-7f81d0329c35-kube-api-access-wwjmp" (OuterVolumeSpecName: "kube-api-access-wwjmp") pod "489c7434-1c8c-434e-ab74-7f81d0329c35" (UID: "489c7434-1c8c-434e-ab74-7f81d0329c35"). InnerVolumeSpecName "kube-api-access-wwjmp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:01:17.393986 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:17.393962    2584 scope.go:117] "RemoveContainer" containerID="af6a0e22d1f3ccbcb689569692c30e22319676a851a24016dbdeb59ef77fa243"
Jul 06 02:01:17.394351 ip-10-0-128-8 kubenswrapper[2584]: E0706 02:01:17.394324    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af6a0e22d1f3ccbcb689569692c30e22319676a851a24016dbdeb59ef77fa243\": container with ID starting with af6a0e22d1f3ccbcb689569692c30e22319676a851a24016dbdeb59ef77fa243 not found: ID does not exist" containerID="af6a0e22d1f3ccbcb689569692c30e22319676a851a24016dbdeb59ef77fa243"
Jul 06 02:01:17.394456 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:17.394359    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af6a0e22d1f3ccbcb689569692c30e22319676a851a24016dbdeb59ef77fa243"} err="failed to get container status \"af6a0e22d1f3ccbcb689569692c30e22319676a851a24016dbdeb59ef77fa243\": rpc error: code = NotFound desc = could not find container \"af6a0e22d1f3ccbcb689569692c30e22319676a851a24016dbdeb59ef77fa243\": container with ID starting with af6a0e22d1f3ccbcb689569692c30e22319676a851a24016dbdeb59ef77fa243 not found: ID does not exist"
Jul 06 02:01:17.472982 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:17.472879    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/489c7434-1c8c-434e-ab74-7f81d0329c35-openshift-service-ca\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:01:17.472982 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:17.472922    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/489c7434-1c8c-434e-ab74-7f81d0329c35-maas-api-tls\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:01:17.472982 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:17.472937    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwjmp\" (UniqueName: \"kubernetes.io/projected/489c7434-1c8c-434e-ab74-7f81d0329c35-kube-api-access-wwjmp\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:01:17.698066 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:17.698027    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f"]
Jul 06 02:01:17.699843 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:17.699809    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-95397071-647d4bcccb-wkm4f"]
Jul 06 02:01:18.615774 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:18.615735    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="489c7434-1c8c-434e-ab74-7f81d0329c35" path="/var/lib/kubelet/pods/489c7434-1c8c-434e-ab74-7f81d0329c35/volumes"
Jul 06 02:01:18.616155 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:18.616075    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4d1d5a6-2fcf-4607-aa4b-626b15f5ba9a" path="/var/lib/kubelet/pods/a4d1d5a6-2fcf-4607-aa4b-626b15f5ba9a/volumes"
Jul 06 02:01:19.734004 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:19.733961    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:01:29.634256 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:29.634215    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:01:41.037638 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:01:41.037597    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:02:20.746664 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:20.746364    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx"]
Jul 06 02:02:20.749687 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:20.747990    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="489c7434-1c8c-434e-ab74-7f81d0329c35" containerName="maas-api"
Jul 06 02:02:20.749687 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:20.748018    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="489c7434-1c8c-434e-ab74-7f81d0329c35" containerName="maas-api"
Jul 06 02:02:20.749687 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:20.748038    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4d1d5a6-2fcf-4607-aa4b-626b15f5ba9a" containerName="cleanup"
Jul 06 02:02:20.749687 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:20.748047    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4d1d5a6-2fcf-4607-aa4b-626b15f5ba9a" containerName="cleanup"
Jul 06 02:02:20.749687 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:20.748145    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4d1d5a6-2fcf-4607-aa4b-626b15f5ba9a" containerName="cleanup"
Jul 06 02:02:20.749687 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:20.748155    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="489c7434-1c8c-434e-ab74-7f81d0329c35" containerName="maas-api"
Jul 06 02:02:20.751758 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:20.751727    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx"
Jul 06 02:02:20.755937 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:20.755751    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-f285a0-serving-cert\""
Jul 06 02:02:20.759017 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:20.758992    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cfbht\""
Jul 06 02:02:20.764225 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:20.764196    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx"]
Jul 06 02:02:20.861214 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:20.861162    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgwhm\" (UniqueName: \"kubernetes.io/projected/3812929b-6315-4ed5-9733-6ccf1450551b-kube-api-access-kgwhm\") pod \"maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx\" (UID: \"3812929b-6315-4ed5-9733-6ccf1450551b\") " pod="opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx"
Jul 06 02:02:20.861397 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:20.861222    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3812929b-6315-4ed5-9733-6ccf1450551b-maas-api-tls\") pod \"maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx\" (UID: \"3812929b-6315-4ed5-9733-6ccf1450551b\") " pod="opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx"
Jul 06 02:02:20.861397 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:20.861277    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3812929b-6315-4ed5-9733-6ccf1450551b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx\" (UID: \"3812929b-6315-4ed5-9733-6ccf1450551b\") " pod="opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx"
Jul 06 02:02:20.962165 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:20.962124    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgwhm\" (UniqueName: \"kubernetes.io/projected/3812929b-6315-4ed5-9733-6ccf1450551b-kube-api-access-kgwhm\") pod \"maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx\" (UID: \"3812929b-6315-4ed5-9733-6ccf1450551b\") " pod="opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx"
Jul 06 02:02:20.962165 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:20.962162    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3812929b-6315-4ed5-9733-6ccf1450551b-maas-api-tls\") pod \"maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx\" (UID: \"3812929b-6315-4ed5-9733-6ccf1450551b\") " pod="opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx"
Jul 06 02:02:20.962391 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:20.962291    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3812929b-6315-4ed5-9733-6ccf1450551b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx\" (UID: \"3812929b-6315-4ed5-9733-6ccf1450551b\") " pod="opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx"
Jul 06 02:02:20.962391 ip-10-0-128-8 kubenswrapper[2584]: E0706 02:02:20.962376    2584 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-f285a0-serving-cert: secret "maas-api-e2e-inf-a-f285a0-serving-cert" not found
Jul 06 02:02:20.962464 ip-10-0-128-8 kubenswrapper[2584]: E0706 02:02:20.962440    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3812929b-6315-4ed5-9733-6ccf1450551b-maas-api-tls podName:3812929b-6315-4ed5-9733-6ccf1450551b nodeName:}" failed. No retries permitted until 2026-07-06 02:02:21.46242416 +0000 UTC m=+2149.704192004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3812929b-6315-4ed5-9733-6ccf1450551b-maas-api-tls") pod "maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx" (UID: "3812929b-6315-4ed5-9733-6ccf1450551b") : secret "maas-api-e2e-inf-a-f285a0-serving-cert" not found
Jul 06 02:02:20.962966 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:20.962948    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3812929b-6315-4ed5-9733-6ccf1450551b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx\" (UID: \"3812929b-6315-4ed5-9733-6ccf1450551b\") " pod="opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx"
Jul 06 02:02:20.971103 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:20.971076    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgwhm\" (UniqueName: \"kubernetes.io/projected/3812929b-6315-4ed5-9733-6ccf1450551b-kube-api-access-kgwhm\") pod \"maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx\" (UID: \"3812929b-6315-4ed5-9733-6ccf1450551b\") " pod="opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx"
Jul 06 02:02:21.468395 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:21.468348    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3812929b-6315-4ed5-9733-6ccf1450551b-maas-api-tls\") pod \"maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx\" (UID: \"3812929b-6315-4ed5-9733-6ccf1450551b\") " pod="opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx"
Jul 06 02:02:21.470912 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:21.470888    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3812929b-6315-4ed5-9733-6ccf1450551b-maas-api-tls\") pod \"maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx\" (UID: \"3812929b-6315-4ed5-9733-6ccf1450551b\") " pod="opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx"
Jul 06 02:02:21.667394 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:21.667347    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx"
Jul 06 02:02:21.821212 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:21.821175    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx"]
Jul 06 02:02:21.823182 ip-10-0-128-8 kubenswrapper[2584]: W0706 02:02:21.823154    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3812929b_6315_4ed5_9733_6ccf1450551b.slice/crio-69ab9a6166eb8b45b5161ca72729554567fab046d4dc4f3a9fcdac4a3a25c012 WatchSource:0}: Error finding container 69ab9a6166eb8b45b5161ca72729554567fab046d4dc4f3a9fcdac4a3a25c012: Status 404 returned error can't find the container with id 69ab9a6166eb8b45b5161ca72729554567fab046d4dc4f3a9fcdac4a3a25c012
Jul 06 02:02:21.824608 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:21.824586    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 02:02:22.711613 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:22.711566    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx" event={"ID":"3812929b-6315-4ed5-9733-6ccf1450551b","Type":"ContainerStarted","Data":"bffd547fd48b51766bd1e12fd47af7ee005a142367f018fb7c21a770c8d7c6db"}
Jul 06 02:02:22.711846 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:22.711675    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx" event={"ID":"3812929b-6315-4ed5-9733-6ccf1450551b","Type":"ContainerStarted","Data":"69ab9a6166eb8b45b5161ca72729554567fab046d4dc4f3a9fcdac4a3a25c012"}
Jul 06 02:02:22.711846 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:22.711701    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx"
Jul 06 02:02:22.729086 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:22.729032    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx" podStartSLOduration=2.294864356 podStartE2EDuration="2.729014417s" totalImagesPullingTime="434.150061ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:02:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:02:22.727759932 +0000 UTC m=+2150.969527798" watchObservedRunningTime="2026-07-06 02:02:22.729014417 +0000 UTC m=+2150.970782284"
Jul 06 02:02:28.643275 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:28.643183    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:02:28.722748 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:28.722709    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx"
Jul 06 02:02:28.772701 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:28.772663    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47"]
Jul 06 02:02:28.778009 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:28.777976    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47"
Jul 06 02:02:28.781518 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:28.781488    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-782aa6-serving-cert\""
Jul 06 02:02:28.787511 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:28.787476    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47"]
Jul 06 02:02:28.842579 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:28.842543    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc7184a3-2539-4f3b-b35d-4e3cf1616c28-maas-api-tls\") pod \"maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47\" (UID: \"bc7184a3-2539-4f3b-b35d-4e3cf1616c28\") " pod="opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47"
Jul 06 02:02:28.842830 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:28.842614    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc7184a3-2539-4f3b-b35d-4e3cf1616c28-openshift-service-ca\") pod \"maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47\" (UID: \"bc7184a3-2539-4f3b-b35d-4e3cf1616c28\") " pod="opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47"
Jul 06 02:02:28.842830 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:28.842706    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vntlp\" (UniqueName: \"kubernetes.io/projected/bc7184a3-2539-4f3b-b35d-4e3cf1616c28-kube-api-access-vntlp\") pod \"maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47\" (UID: \"bc7184a3-2539-4f3b-b35d-4e3cf1616c28\") " pod="opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47"
Jul 06 02:02:28.943552 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:28.943448    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc7184a3-2539-4f3b-b35d-4e3cf1616c28-maas-api-tls\") pod \"maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47\" (UID: \"bc7184a3-2539-4f3b-b35d-4e3cf1616c28\") " pod="opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47"
Jul 06 02:02:28.943552 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:28.943508    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc7184a3-2539-4f3b-b35d-4e3cf1616c28-openshift-service-ca\") pod \"maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47\" (UID: \"bc7184a3-2539-4f3b-b35d-4e3cf1616c28\") " pod="opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47"
Jul 06 02:02:28.943552 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:28.943537    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vntlp\" (UniqueName: \"kubernetes.io/projected/bc7184a3-2539-4f3b-b35d-4e3cf1616c28-kube-api-access-vntlp\") pod \"maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47\" (UID: \"bc7184a3-2539-4f3b-b35d-4e3cf1616c28\") " pod="opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47"
Jul 06 02:02:28.944296 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:28.944268    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc7184a3-2539-4f3b-b35d-4e3cf1616c28-openshift-service-ca\") pod \"maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47\" (UID: \"bc7184a3-2539-4f3b-b35d-4e3cf1616c28\") " pod="opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47"
Jul 06 02:02:28.946118 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:28.946087    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc7184a3-2539-4f3b-b35d-4e3cf1616c28-maas-api-tls\") pod \"maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47\" (UID: \"bc7184a3-2539-4f3b-b35d-4e3cf1616c28\") " pod="opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47"
Jul 06 02:02:28.952527 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:28.952487    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vntlp\" (UniqueName: \"kubernetes.io/projected/bc7184a3-2539-4f3b-b35d-4e3cf1616c28-kube-api-access-vntlp\") pod \"maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47\" (UID: \"bc7184a3-2539-4f3b-b35d-4e3cf1616c28\") " pod="opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47"
Jul 06 02:02:29.095365 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:29.095328    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47"
Jul 06 02:02:29.242297 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:29.242269    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47"]
Jul 06 02:02:29.244422 ip-10-0-128-8 kubenswrapper[2584]: W0706 02:02:29.244389    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc7184a3_2539_4f3b_b35d_4e3cf1616c28.slice/crio-1dcc3923aeb6d40f2e622d9c0d7d4cd85eaaa2680316d9f9470804eea6174409 WatchSource:0}: Error finding container 1dcc3923aeb6d40f2e622d9c0d7d4cd85eaaa2680316d9f9470804eea6174409: Status 404 returned error can't find the container with id 1dcc3923aeb6d40f2e622d9c0d7d4cd85eaaa2680316d9f9470804eea6174409
Jul 06 02:02:29.746938 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:29.746905    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47" event={"ID":"bc7184a3-2539-4f3b-b35d-4e3cf1616c28","Type":"ContainerStarted","Data":"04c9608789c5ac208b096332bfd0b77018d29d4d25424f1ca41f3e7bc857bd26"}
Jul 06 02:02:29.747326 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:29.746955    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47" event={"ID":"bc7184a3-2539-4f3b-b35d-4e3cf1616c28","Type":"ContainerStarted","Data":"1dcc3923aeb6d40f2e622d9c0d7d4cd85eaaa2680316d9f9470804eea6174409"}
Jul 06 02:02:29.747326 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:29.747003    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47"
Jul 06 02:02:29.764025 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:29.763967    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47" podStartSLOduration=1.348750871 podStartE2EDuration="1.763951768s" totalImagesPullingTime="415.200897ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:02:29.762658589 +0000 UTC m=+2158.004426457" watchObservedRunningTime="2026-07-06 02:02:29.763951768 +0000 UTC m=+2158.005719634"
Jul 06 02:02:35.757614 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:35.757579    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47"
Jul 06 02:02:39.436380 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:02:39.436332    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:03:05.240203 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:05.240160    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:03:16.338715 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:16.338677    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:03:26.211722 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.211678    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"]
Jul 06 02:03:26.215437 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.215416    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:03:26.218233 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.218208    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-782aa6\"/\"openshift-service-ca.crt\""
Jul 06 02:03:26.219442 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.219412    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-782aa6\"/\"kube-root-ca.crt\""
Jul 06 02:03:26.219564 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.219466    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-782aa6\"/\"test-model-782aa6-kserve-self-signed-certs\""
Jul 06 02:03:26.219564 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.219466    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-782aa6\"/\"default-dockercfg-2w9x6\""
Jul 06 02:03:26.226961 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.226915    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"]
Jul 06 02:03:26.374436 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.374396    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f29ab474-fbbf-412b-93a9-22afb940cc0e-tls-certs\") pod \"test-model-782aa6-kserve-5cbd7bc7f5-tgvxk\" (UID: \"f29ab474-fbbf-412b-93a9-22afb940cc0e\") " pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:03:26.374689 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.374461    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f29ab474-fbbf-412b-93a9-22afb940cc0e-model-cache\") pod \"test-model-782aa6-kserve-5cbd7bc7f5-tgvxk\" (UID: \"f29ab474-fbbf-412b-93a9-22afb940cc0e\") " pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:03:26.374689 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.374531    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f29ab474-fbbf-412b-93a9-22afb940cc0e-home\") pod \"test-model-782aa6-kserve-5cbd7bc7f5-tgvxk\" (UID: \"f29ab474-fbbf-412b-93a9-22afb940cc0e\") " pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:03:26.374689 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.374597    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k9xg\" (UniqueName: \"kubernetes.io/projected/f29ab474-fbbf-412b-93a9-22afb940cc0e-kube-api-access-6k9xg\") pod \"test-model-782aa6-kserve-5cbd7bc7f5-tgvxk\" (UID: \"f29ab474-fbbf-412b-93a9-22afb940cc0e\") " pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:03:26.374689 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.374656    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f29ab474-fbbf-412b-93a9-22afb940cc0e-tmp-dir\") pod \"test-model-782aa6-kserve-5cbd7bc7f5-tgvxk\" (UID: \"f29ab474-fbbf-412b-93a9-22afb940cc0e\") " pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:03:26.374861 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.374696    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f29ab474-fbbf-412b-93a9-22afb940cc0e-dshm\") pod \"test-model-782aa6-kserve-5cbd7bc7f5-tgvxk\" (UID: \"f29ab474-fbbf-412b-93a9-22afb940cc0e\") " pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:03:26.476129 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.476024    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f29ab474-fbbf-412b-93a9-22afb940cc0e-tls-certs\") pod \"test-model-782aa6-kserve-5cbd7bc7f5-tgvxk\" (UID: \"f29ab474-fbbf-412b-93a9-22afb940cc0e\") " pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:03:26.476129 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.476085    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f29ab474-fbbf-412b-93a9-22afb940cc0e-model-cache\") pod \"test-model-782aa6-kserve-5cbd7bc7f5-tgvxk\" (UID: \"f29ab474-fbbf-412b-93a9-22afb940cc0e\") " pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:03:26.476129 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.476121    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f29ab474-fbbf-412b-93a9-22afb940cc0e-home\") pod \"test-model-782aa6-kserve-5cbd7bc7f5-tgvxk\" (UID: \"f29ab474-fbbf-412b-93a9-22afb940cc0e\") " pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:03:26.476381 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.476152    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k9xg\" (UniqueName: \"kubernetes.io/projected/f29ab474-fbbf-412b-93a9-22afb940cc0e-kube-api-access-6k9xg\") pod \"test-model-782aa6-kserve-5cbd7bc7f5-tgvxk\" (UID: \"f29ab474-fbbf-412b-93a9-22afb940cc0e\") " pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:03:26.476381 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.476186    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f29ab474-fbbf-412b-93a9-22afb940cc0e-tmp-dir\") pod \"test-model-782aa6-kserve-5cbd7bc7f5-tgvxk\" (UID: \"f29ab474-fbbf-412b-93a9-22afb940cc0e\") " pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:03:26.476381 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.476219    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f29ab474-fbbf-412b-93a9-22afb940cc0e-dshm\") pod \"test-model-782aa6-kserve-5cbd7bc7f5-tgvxk\" (UID: \"f29ab474-fbbf-412b-93a9-22afb940cc0e\") " pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:03:26.476642 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.476594    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f29ab474-fbbf-412b-93a9-22afb940cc0e-model-cache\") pod \"test-model-782aa6-kserve-5cbd7bc7f5-tgvxk\" (UID: \"f29ab474-fbbf-412b-93a9-22afb940cc0e\") " pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:03:26.476722 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.476663    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f29ab474-fbbf-412b-93a9-22afb940cc0e-home\") pod \"test-model-782aa6-kserve-5cbd7bc7f5-tgvxk\" (UID: \"f29ab474-fbbf-412b-93a9-22afb940cc0e\") " pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:03:26.476722 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.476687    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f29ab474-fbbf-412b-93a9-22afb940cc0e-tmp-dir\") pod \"test-model-782aa6-kserve-5cbd7bc7f5-tgvxk\" (UID: \"f29ab474-fbbf-412b-93a9-22afb940cc0e\") " pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:03:26.478549 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.478525    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f29ab474-fbbf-412b-93a9-22afb940cc0e-dshm\") pod \"test-model-782aa6-kserve-5cbd7bc7f5-tgvxk\" (UID: \"f29ab474-fbbf-412b-93a9-22afb940cc0e\") " pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:03:26.478774 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.478752    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f29ab474-fbbf-412b-93a9-22afb940cc0e-tls-certs\") pod \"test-model-782aa6-kserve-5cbd7bc7f5-tgvxk\" (UID: \"f29ab474-fbbf-412b-93a9-22afb940cc0e\") " pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:03:26.484367 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.484341    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k9xg\" (UniqueName: \"kubernetes.io/projected/f29ab474-fbbf-412b-93a9-22afb940cc0e-kube-api-access-6k9xg\") pod \"test-model-782aa6-kserve-5cbd7bc7f5-tgvxk\" (UID: \"f29ab474-fbbf-412b-93a9-22afb940cc0e\") " pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:03:26.528360 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.528314    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:03:26.674440 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:26.674408    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"]
Jul 06 02:03:26.677460 ip-10-0-128-8 kubenswrapper[2584]: W0706 02:03:26.677431    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf29ab474_fbbf_412b_93a9_22afb940cc0e.slice/crio-57cfe0a2048ac782a148560d2f4c4ea878e59fbb9e44902cb07563241db17e0b WatchSource:0}: Error finding container 57cfe0a2048ac782a148560d2f4c4ea878e59fbb9e44902cb07563241db17e0b: Status 404 returned error can't find the container with id 57cfe0a2048ac782a148560d2f4c4ea878e59fbb9e44902cb07563241db17e0b
Jul 06 02:03:27.042749 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:27.042661    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk" event={"ID":"f29ab474-fbbf-412b-93a9-22afb940cc0e","Type":"ContainerStarted","Data":"9585114fcbd2a35e0b21d094e8f5d5beac22ae3742fdddcf723a05730ad59486"}
Jul 06 02:03:27.042749 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:27.042704    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk" event={"ID":"f29ab474-fbbf-412b-93a9-22afb940cc0e","Type":"ContainerStarted","Data":"57cfe0a2048ac782a148560d2f4c4ea878e59fbb9e44902cb07563241db17e0b"}
Jul 06 02:03:27.061051 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:27.060994    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk" podStartSLOduration=1.060978056 podStartE2EDuration="1.060978056s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:03:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:03:27.059037174 +0000 UTC m=+2215.300805043" watchObservedRunningTime="2026-07-06 02:03:27.060978056 +0000 UTC m=+2215.302745923"
Jul 06 02:03:30.239132 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:30.239075    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:03:36.528713 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:36.528667    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:03:36.529330 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:36.528994    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:03:36.541762 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:36.541728    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:03:37.106466 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:37.106437    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:03:43.243449 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:43.243409    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:03:48.026455 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:48.026420    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"]
Jul 06 02:03:48.917109 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:48.917072    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx"]
Jul 06 02:03:48.917406 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:48.917331    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx" podUID="3812929b-6315-4ed5-9733-6ccf1450551b" containerName="maas-api" containerID="cri-o://bffd547fd48b51766bd1e12fd47af7ee005a142367f018fb7c21a770c8d7c6db" gracePeriod=30
Jul 06 02:03:49.155935 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:49.155900    2584 generic.go:356] "Generic (PLEG): container finished" podID="3812929b-6315-4ed5-9733-6ccf1450551b" containerID="bffd547fd48b51766bd1e12fd47af7ee005a142367f018fb7c21a770c8d7c6db" exitCode=0
Jul 06 02:03:49.156282 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:49.155946    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx" event={"ID":"3812929b-6315-4ed5-9733-6ccf1450551b","Type":"ContainerDied","Data":"bffd547fd48b51766bd1e12fd47af7ee005a142367f018fb7c21a770c8d7c6db"}
Jul 06 02:03:49.174803 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:49.174728    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx"
Jul 06 02:03:49.293897 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:49.293861    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3812929b-6315-4ed5-9733-6ccf1450551b-maas-api-tls\") pod \"3812929b-6315-4ed5-9733-6ccf1450551b\" (UID: \"3812929b-6315-4ed5-9733-6ccf1450551b\") "
Jul 06 02:03:49.294085 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:49.293916    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3812929b-6315-4ed5-9733-6ccf1450551b-openshift-service-ca\") pod \"3812929b-6315-4ed5-9733-6ccf1450551b\" (UID: \"3812929b-6315-4ed5-9733-6ccf1450551b\") "
Jul 06 02:03:49.294085 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:49.293965    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgwhm\" (UniqueName: \"kubernetes.io/projected/3812929b-6315-4ed5-9733-6ccf1450551b-kube-api-access-kgwhm\") pod \"3812929b-6315-4ed5-9733-6ccf1450551b\" (UID: \"3812929b-6315-4ed5-9733-6ccf1450551b\") "
Jul 06 02:03:49.294384 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:49.294353    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3812929b-6315-4ed5-9733-6ccf1450551b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3812929b-6315-4ed5-9733-6ccf1450551b" (UID: "3812929b-6315-4ed5-9733-6ccf1450551b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:03:49.296146 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:49.296119    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3812929b-6315-4ed5-9733-6ccf1450551b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3812929b-6315-4ed5-9733-6ccf1450551b" (UID: "3812929b-6315-4ed5-9733-6ccf1450551b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:03:49.296236 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:49.296122    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3812929b-6315-4ed5-9733-6ccf1450551b-kube-api-access-kgwhm" (OuterVolumeSpecName: "kube-api-access-kgwhm") pod "3812929b-6315-4ed5-9733-6ccf1450551b" (UID: "3812929b-6315-4ed5-9733-6ccf1450551b"). InnerVolumeSpecName "kube-api-access-kgwhm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:03:49.395227 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:49.395182    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgwhm\" (UniqueName: \"kubernetes.io/projected/3812929b-6315-4ed5-9733-6ccf1450551b-kube-api-access-kgwhm\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:03:49.395227 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:49.395221    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3812929b-6315-4ed5-9733-6ccf1450551b-maas-api-tls\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:03:49.395451 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:49.395238    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3812929b-6315-4ed5-9733-6ccf1450551b-openshift-service-ca\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:03:50.162496 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:50.162460    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx"
Jul 06 02:03:50.162957 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:50.162508    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx" event={"ID":"3812929b-6315-4ed5-9733-6ccf1450551b","Type":"ContainerDied","Data":"69ab9a6166eb8b45b5161ca72729554567fab046d4dc4f3a9fcdac4a3a25c012"}
Jul 06 02:03:50.162957 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:50.162568    2584 scope.go:117] "RemoveContainer" containerID="bffd547fd48b51766bd1e12fd47af7ee005a142367f018fb7c21a770c8d7c6db"
Jul 06 02:03:50.184115 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:50.184081    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx"]
Jul 06 02:03:50.189504 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:50.189464    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f285a0-7b6579dd5f-gnhwx"]
Jul 06 02:03:50.616781 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:50.616735    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3812929b-6315-4ed5-9733-6ccf1450551b" path="/var/lib/kubelet/pods/3812929b-6315-4ed5-9733-6ccf1450551b/volumes"
Jul 06 02:03:59.543665 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:03:59.543554    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:04:03.049544 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:03.049498    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk" podUID="f29ab474-fbbf-412b-93a9-22afb940cc0e" containerName="main" containerID="cri-o://9585114fcbd2a35e0b21d094e8f5d5beac22ae3742fdddcf723a05730ad59486" gracePeriod=45
Jul 06 02:04:03.244423 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:03.244359    2584 generic.go:356] "Generic (PLEG): container finished" podID="f29ab474-fbbf-412b-93a9-22afb940cc0e" containerID="9585114fcbd2a35e0b21d094e8f5d5beac22ae3742fdddcf723a05730ad59486" exitCode=0
Jul 06 02:04:03.244776 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:03.244474    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk" event={"ID":"f29ab474-fbbf-412b-93a9-22afb940cc0e","Type":"ContainerDied","Data":"9585114fcbd2a35e0b21d094e8f5d5beac22ae3742fdddcf723a05730ad59486"}
Jul 06 02:04:03.318021 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:03.317997    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:04:03.436526 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:03.436490    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f29ab474-fbbf-412b-93a9-22afb940cc0e-model-cache\") pod \"f29ab474-fbbf-412b-93a9-22afb940cc0e\" (UID: \"f29ab474-fbbf-412b-93a9-22afb940cc0e\") "
Jul 06 02:04:03.436750 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:03.436557    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f29ab474-fbbf-412b-93a9-22afb940cc0e-tls-certs\") pod \"f29ab474-fbbf-412b-93a9-22afb940cc0e\" (UID: \"f29ab474-fbbf-412b-93a9-22afb940cc0e\") "
Jul 06 02:04:03.436750 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:03.436581    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f29ab474-fbbf-412b-93a9-22afb940cc0e-dshm\") pod \"f29ab474-fbbf-412b-93a9-22afb940cc0e\" (UID: \"f29ab474-fbbf-412b-93a9-22afb940cc0e\") "
Jul 06 02:04:03.436750 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:03.436610    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f29ab474-fbbf-412b-93a9-22afb940cc0e-home\") pod \"f29ab474-fbbf-412b-93a9-22afb940cc0e\" (UID: \"f29ab474-fbbf-412b-93a9-22afb940cc0e\") "
Jul 06 02:04:03.436750 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:03.436676    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6k9xg\" (UniqueName: \"kubernetes.io/projected/f29ab474-fbbf-412b-93a9-22afb940cc0e-kube-api-access-6k9xg\") pod \"f29ab474-fbbf-412b-93a9-22afb940cc0e\" (UID: \"f29ab474-fbbf-412b-93a9-22afb940cc0e\") "
Jul 06 02:04:03.436750 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:03.436692    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f29ab474-fbbf-412b-93a9-22afb940cc0e-tmp-dir\") pod \"f29ab474-fbbf-412b-93a9-22afb940cc0e\" (UID: \"f29ab474-fbbf-412b-93a9-22afb940cc0e\") "
Jul 06 02:04:03.437028 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:03.436828    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f29ab474-fbbf-412b-93a9-22afb940cc0e-model-cache" (OuterVolumeSpecName: "model-cache") pod "f29ab474-fbbf-412b-93a9-22afb940cc0e" (UID: "f29ab474-fbbf-412b-93a9-22afb940cc0e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:04:03.437028 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:03.436904    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f29ab474-fbbf-412b-93a9-22afb940cc0e-home" (OuterVolumeSpecName: "home") pod "f29ab474-fbbf-412b-93a9-22afb940cc0e" (UID: "f29ab474-fbbf-412b-93a9-22afb940cc0e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:04:03.437028 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:03.436941    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f29ab474-fbbf-412b-93a9-22afb940cc0e-model-cache\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:04:03.437132 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:03.437027    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f29ab474-fbbf-412b-93a9-22afb940cc0e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f29ab474-fbbf-412b-93a9-22afb940cc0e" (UID: "f29ab474-fbbf-412b-93a9-22afb940cc0e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:04:03.438907 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:03.438886    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f29ab474-fbbf-412b-93a9-22afb940cc0e-dshm" (OuterVolumeSpecName: "dshm") pod "f29ab474-fbbf-412b-93a9-22afb940cc0e" (UID: "f29ab474-fbbf-412b-93a9-22afb940cc0e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:04:03.438985 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:03.438962    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f29ab474-fbbf-412b-93a9-22afb940cc0e-kube-api-access-6k9xg" (OuterVolumeSpecName: "kube-api-access-6k9xg") pod "f29ab474-fbbf-412b-93a9-22afb940cc0e" (UID: "f29ab474-fbbf-412b-93a9-22afb940cc0e"). InnerVolumeSpecName "kube-api-access-6k9xg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:04:03.439026 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:03.439005    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f29ab474-fbbf-412b-93a9-22afb940cc0e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f29ab474-fbbf-412b-93a9-22afb940cc0e" (UID: "f29ab474-fbbf-412b-93a9-22afb940cc0e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:04:03.537688 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:03.537602    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f29ab474-fbbf-412b-93a9-22afb940cc0e-dshm\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:04:03.537688 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:03.537679    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f29ab474-fbbf-412b-93a9-22afb940cc0e-home\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:04:03.537688 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:03.537690    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6k9xg\" (UniqueName: \"kubernetes.io/projected/f29ab474-fbbf-412b-93a9-22afb940cc0e-kube-api-access-6k9xg\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:04:03.537688 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:03.537700    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f29ab474-fbbf-412b-93a9-22afb940cc0e-tmp-dir\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:04:03.537688 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:03.537711    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f29ab474-fbbf-412b-93a9-22afb940cc0e-tls-certs\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:04:04.252614 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:04.252576    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk" event={"ID":"f29ab474-fbbf-412b-93a9-22afb940cc0e","Type":"ContainerDied","Data":"57cfe0a2048ac782a148560d2f4c4ea878e59fbb9e44902cb07563241db17e0b"}
Jul 06 02:04:04.253032 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:04.252646    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"
Jul 06 02:04:04.253032 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:04.252654    2584 scope.go:117] "RemoveContainer" containerID="9585114fcbd2a35e0b21d094e8f5d5beac22ae3742fdddcf723a05730ad59486"
Jul 06 02:04:04.282980 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:04.282940    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"]
Jul 06 02:04:04.288955 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:04.288923    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-782aa6/test-model-782aa6-kserve-5cbd7bc7f5-tgvxk"]
Jul 06 02:04:04.615821 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:04.615783    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f29ab474-fbbf-412b-93a9-22afb940cc0e" path="/var/lib/kubelet/pods/f29ab474-fbbf-412b-93a9-22afb940cc0e/volumes"
Jul 06 02:04:31.738728 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:31.738685    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47"]
Jul 06 02:04:31.739369 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:31.738925    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47" podUID="bc7184a3-2539-4f3b-b35d-4e3cf1616c28" containerName="maas-api" containerID="cri-o://04c9608789c5ac208b096332bfd0b77018d29d4d25424f1ca41f3e7bc857bd26" gracePeriod=30
Jul 06 02:04:31.995111 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:31.995034    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47"
Jul 06 02:04:32.004320 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:32.004289    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc7184a3-2539-4f3b-b35d-4e3cf1616c28-maas-api-tls\") pod \"bc7184a3-2539-4f3b-b35d-4e3cf1616c28\" (UID: \"bc7184a3-2539-4f3b-b35d-4e3cf1616c28\") "
Jul 06 02:04:32.004452 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:32.004356    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc7184a3-2539-4f3b-b35d-4e3cf1616c28-openshift-service-ca\") pod \"bc7184a3-2539-4f3b-b35d-4e3cf1616c28\" (UID: \"bc7184a3-2539-4f3b-b35d-4e3cf1616c28\") "
Jul 06 02:04:32.004452 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:32.004449    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vntlp\" (UniqueName: \"kubernetes.io/projected/bc7184a3-2539-4f3b-b35d-4e3cf1616c28-kube-api-access-vntlp\") pod \"bc7184a3-2539-4f3b-b35d-4e3cf1616c28\" (UID: \"bc7184a3-2539-4f3b-b35d-4e3cf1616c28\") "
Jul 06 02:04:32.004771 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:32.004745    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc7184a3-2539-4f3b-b35d-4e3cf1616c28-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bc7184a3-2539-4f3b-b35d-4e3cf1616c28" (UID: "bc7184a3-2539-4f3b-b35d-4e3cf1616c28"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:04:32.006592 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:32.006567    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc7184a3-2539-4f3b-b35d-4e3cf1616c28-kube-api-access-vntlp" (OuterVolumeSpecName: "kube-api-access-vntlp") pod "bc7184a3-2539-4f3b-b35d-4e3cf1616c28" (UID: "bc7184a3-2539-4f3b-b35d-4e3cf1616c28"). InnerVolumeSpecName "kube-api-access-vntlp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:04:32.006698 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:32.006676    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc7184a3-2539-4f3b-b35d-4e3cf1616c28-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bc7184a3-2539-4f3b-b35d-4e3cf1616c28" (UID: "bc7184a3-2539-4f3b-b35d-4e3cf1616c28"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:04:32.105848 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:32.105805    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc7184a3-2539-4f3b-b35d-4e3cf1616c28-openshift-service-ca\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:04:32.105848 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:32.105843    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vntlp\" (UniqueName: \"kubernetes.io/projected/bc7184a3-2539-4f3b-b35d-4e3cf1616c28-kube-api-access-vntlp\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:04:32.105848 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:32.105853    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc7184a3-2539-4f3b-b35d-4e3cf1616c28-maas-api-tls\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:04:32.398238 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:32.398202    2584 generic.go:356] "Generic (PLEG): container finished" podID="bc7184a3-2539-4f3b-b35d-4e3cf1616c28" containerID="04c9608789c5ac208b096332bfd0b77018d29d4d25424f1ca41f3e7bc857bd26" exitCode=0
Jul 06 02:04:32.398449 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:32.398256    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47"
Jul 06 02:04:32.398449 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:32.398299    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47" event={"ID":"bc7184a3-2539-4f3b-b35d-4e3cf1616c28","Type":"ContainerDied","Data":"04c9608789c5ac208b096332bfd0b77018d29d4d25424f1ca41f3e7bc857bd26"}
Jul 06 02:04:32.398449 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:32.398368    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47" event={"ID":"bc7184a3-2539-4f3b-b35d-4e3cf1616c28","Type":"ContainerDied","Data":"1dcc3923aeb6d40f2e622d9c0d7d4cd85eaaa2680316d9f9470804eea6174409"}
Jul 06 02:04:32.398449 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:32.398401    2584 scope.go:117] "RemoveContainer" containerID="04c9608789c5ac208b096332bfd0b77018d29d4d25424f1ca41f3e7bc857bd26"
Jul 06 02:04:32.409013 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:32.408992    2584 scope.go:117] "RemoveContainer" containerID="04c9608789c5ac208b096332bfd0b77018d29d4d25424f1ca41f3e7bc857bd26"
Jul 06 02:04:32.409343 ip-10-0-128-8 kubenswrapper[2584]: E0706 02:04:32.409323    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04c9608789c5ac208b096332bfd0b77018d29d4d25424f1ca41f3e7bc857bd26\": container with ID starting with 04c9608789c5ac208b096332bfd0b77018d29d4d25424f1ca41f3e7bc857bd26 not found: ID does not exist" containerID="04c9608789c5ac208b096332bfd0b77018d29d4d25424f1ca41f3e7bc857bd26"
Jul 06 02:04:32.409390 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:32.409354    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04c9608789c5ac208b096332bfd0b77018d29d4d25424f1ca41f3e7bc857bd26"} err="failed to get container status \"04c9608789c5ac208b096332bfd0b77018d29d4d25424f1ca41f3e7bc857bd26\": rpc error: code = NotFound desc = could not find container \"04c9608789c5ac208b096332bfd0b77018d29d4d25424f1ca41f3e7bc857bd26\": container with ID starting with 04c9608789c5ac208b096332bfd0b77018d29d4d25424f1ca41f3e7bc857bd26 not found: ID does not exist"
Jul 06 02:04:32.422277 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:32.422242    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47"]
Jul 06 02:04:32.425970 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:32.425941    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-782aa6-cf7779c6c-bxs47"]
Jul 06 02:04:32.616746 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:32.616709    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc7184a3-2539-4f3b-b35d-4e3cf1616c28" path="/var/lib/kubelet/pods/bc7184a3-2539-4f3b-b35d-4e3cf1616c28/volumes"
Jul 06 02:04:34.946424 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:34.946387    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:04:41.653663 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:41.653600    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5"]
Jul 06 02:04:41.654256 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:41.654234    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3812929b-6315-4ed5-9733-6ccf1450551b" containerName="maas-api"
Jul 06 02:04:41.654300 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:41.654262    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3812929b-6315-4ed5-9733-6ccf1450551b" containerName="maas-api"
Jul 06 02:04:41.654300 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:41.654278    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f29ab474-fbbf-412b-93a9-22afb940cc0e" containerName="main"
Jul 06 02:04:41.654300 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:41.654287    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f29ab474-fbbf-412b-93a9-22afb940cc0e" containerName="main"
Jul 06 02:04:41.654397 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:41.654314    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc7184a3-2539-4f3b-b35d-4e3cf1616c28" containerName="maas-api"
Jul 06 02:04:41.654397 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:41.654323    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc7184a3-2539-4f3b-b35d-4e3cf1616c28" containerName="maas-api"
Jul 06 02:04:41.654468 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:41.654433    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc7184a3-2539-4f3b-b35d-4e3cf1616c28" containerName="maas-api"
Jul 06 02:04:41.654468 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:41.654446    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="f29ab474-fbbf-412b-93a9-22afb940cc0e" containerName="main"
Jul 06 02:04:41.654468 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:41.654461    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3812929b-6315-4ed5-9733-6ccf1450551b" containerName="maas-api"
Jul 06 02:04:41.658067 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:41.658042    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5"
Jul 06 02:04:41.661004 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:41.660964    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cfbht\""
Jul 06 02:04:41.661004 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:41.660964    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-0cd54e-serving-cert\""
Jul 06 02:04:41.678952 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:41.672353    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5"]
Jul 06 02:04:41.692134 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:41.692093    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc3bfa83-5727-46cd-9206-98ab8fe1e155-openshift-service-ca\") pod \"maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5\" (UID: \"bc3bfa83-5727-46cd-9206-98ab8fe1e155\") " pod="opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5"
Jul 06 02:04:41.692338 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:41.692150    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqfr8\" (UniqueName: \"kubernetes.io/projected/bc3bfa83-5727-46cd-9206-98ab8fe1e155-kube-api-access-fqfr8\") pod \"maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5\" (UID: \"bc3bfa83-5727-46cd-9206-98ab8fe1e155\") " pod="opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5"
Jul 06 02:04:41.692338 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:41.692239    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc3bfa83-5727-46cd-9206-98ab8fe1e155-maas-api-tls\") pod \"maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5\" (UID: \"bc3bfa83-5727-46cd-9206-98ab8fe1e155\") " pod="opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5"
Jul 06 02:04:41.793387 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:41.793336    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc3bfa83-5727-46cd-9206-98ab8fe1e155-openshift-service-ca\") pod \"maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5\" (UID: \"bc3bfa83-5727-46cd-9206-98ab8fe1e155\") " pod="opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5"
Jul 06 02:04:41.793387 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:41.793395    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqfr8\" (UniqueName: \"kubernetes.io/projected/bc3bfa83-5727-46cd-9206-98ab8fe1e155-kube-api-access-fqfr8\") pod \"maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5\" (UID: \"bc3bfa83-5727-46cd-9206-98ab8fe1e155\") " pod="opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5"
Jul 06 02:04:41.793613 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:41.793445    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc3bfa83-5727-46cd-9206-98ab8fe1e155-maas-api-tls\") pod \"maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5\" (UID: \"bc3bfa83-5727-46cd-9206-98ab8fe1e155\") " pod="opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5"
Jul 06 02:04:41.793613 ip-10-0-128-8 kubenswrapper[2584]: E0706 02:04:41.793591    2584 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-0cd54e-serving-cert: secret "maas-api-e2e-api-a-0cd54e-serving-cert" not found
Jul 06 02:04:41.793713 ip-10-0-128-8 kubenswrapper[2584]: E0706 02:04:41.793704    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc3bfa83-5727-46cd-9206-98ab8fe1e155-maas-api-tls podName:bc3bfa83-5727-46cd-9206-98ab8fe1e155 nodeName:}" failed. No retries permitted until 2026-07-06 02:04:42.293680951 +0000 UTC m=+2290.535448800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bc3bfa83-5727-46cd-9206-98ab8fe1e155-maas-api-tls") pod "maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5" (UID: "bc3bfa83-5727-46cd-9206-98ab8fe1e155") : secret "maas-api-e2e-api-a-0cd54e-serving-cert" not found
Jul 06 02:04:41.794164 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:41.794140    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc3bfa83-5727-46cd-9206-98ab8fe1e155-openshift-service-ca\") pod \"maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5\" (UID: \"bc3bfa83-5727-46cd-9206-98ab8fe1e155\") " pod="opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5"
Jul 06 02:04:41.802933 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:41.802904    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqfr8\" (UniqueName: \"kubernetes.io/projected/bc3bfa83-5727-46cd-9206-98ab8fe1e155-kube-api-access-fqfr8\") pod \"maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5\" (UID: \"bc3bfa83-5727-46cd-9206-98ab8fe1e155\") " pod="opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5"
Jul 06 02:04:42.299993 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:42.299957    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc3bfa83-5727-46cd-9206-98ab8fe1e155-maas-api-tls\") pod \"maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5\" (UID: \"bc3bfa83-5727-46cd-9206-98ab8fe1e155\") " pod="opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5"
Jul 06 02:04:42.302638 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:42.302595    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc3bfa83-5727-46cd-9206-98ab8fe1e155-maas-api-tls\") pod \"maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5\" (UID: \"bc3bfa83-5727-46cd-9206-98ab8fe1e155\") " pod="opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5"
Jul 06 02:04:42.578110 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:42.578019    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5"
Jul 06 02:04:42.728661 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:42.728606    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5"]
Jul 06 02:04:42.732318 ip-10-0-128-8 kubenswrapper[2584]: W0706 02:04:42.732277    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc3bfa83_5727_46cd_9206_98ab8fe1e155.slice/crio-194de11ed43a186752578ff631bf09170b2ce427eb5a9a9784418ad968c89fd4 WatchSource:0}: Error finding container 194de11ed43a186752578ff631bf09170b2ce427eb5a9a9784418ad968c89fd4: Status 404 returned error can't find the container with id 194de11ed43a186752578ff631bf09170b2ce427eb5a9a9784418ad968c89fd4
Jul 06 02:04:43.459679 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:43.459533    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5" event={"ID":"bc3bfa83-5727-46cd-9206-98ab8fe1e155","Type":"ContainerStarted","Data":"49a6faeda6ec982880277176d7c35065e34845b4d4c55d7c0c37b8b4735b92a4"}
Jul 06 02:04:43.459679 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:43.459609    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5"
Jul 06 02:04:43.459679 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:43.459659    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5" event={"ID":"bc3bfa83-5727-46cd-9206-98ab8fe1e155","Type":"ContainerStarted","Data":"194de11ed43a186752578ff631bf09170b2ce427eb5a9a9784418ad968c89fd4"}
Jul 06 02:04:43.477986 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:43.477931    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5" podStartSLOduration=2.098635748 podStartE2EDuration="2.477915677s" totalImagesPullingTime="379.279929ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:04:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:04:43.476279603 +0000 UTC m=+2291.718047487" watchObservedRunningTime="2026-07-06 02:04:43.477915677 +0000 UTC m=+2291.719683543"
Jul 06 02:04:49.433810 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:49.433774    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:04:49.470356 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:49.470328    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5"
Jul 06 02:04:49.665964 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:49.665924    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w"]
Jul 06 02:04:49.670373 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:49.670345    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w"
Jul 06 02:04:49.673089 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:49.673063    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-d40f48-serving-cert\""
Jul 06 02:04:49.679252 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:49.679224    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w"]
Jul 06 02:04:49.770003 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:49.769896    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61ef1dfa-4ccf-4491-bce6-c148941c3b1d-maas-api-tls\") pod \"maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w\" (UID: \"61ef1dfa-4ccf-4491-bce6-c148941c3b1d\") " pod="opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w"
Jul 06 02:04:49.770003 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:49.769964    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61ef1dfa-4ccf-4491-bce6-c148941c3b1d-openshift-service-ca\") pod \"maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w\" (UID: \"61ef1dfa-4ccf-4491-bce6-c148941c3b1d\") " pod="opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w"
Jul 06 02:04:49.770003 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:49.769992    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnbwr\" (UniqueName: \"kubernetes.io/projected/61ef1dfa-4ccf-4491-bce6-c148941c3b1d-kube-api-access-pnbwr\") pod \"maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w\" (UID: \"61ef1dfa-4ccf-4491-bce6-c148941c3b1d\") " pod="opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w"
Jul 06 02:04:49.870979 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:49.870933    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61ef1dfa-4ccf-4491-bce6-c148941c3b1d-openshift-service-ca\") pod \"maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w\" (UID: \"61ef1dfa-4ccf-4491-bce6-c148941c3b1d\") " pod="opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w"
Jul 06 02:04:49.870979 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:49.870983    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnbwr\" (UniqueName: \"kubernetes.io/projected/61ef1dfa-4ccf-4491-bce6-c148941c3b1d-kube-api-access-pnbwr\") pod \"maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w\" (UID: \"61ef1dfa-4ccf-4491-bce6-c148941c3b1d\") " pod="opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w"
Jul 06 02:04:49.871254 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:49.871077    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61ef1dfa-4ccf-4491-bce6-c148941c3b1d-maas-api-tls\") pod \"maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w\" (UID: \"61ef1dfa-4ccf-4491-bce6-c148941c3b1d\") " pod="opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w"
Jul 06 02:04:49.871254 ip-10-0-128-8 kubenswrapper[2584]: E0706 02:04:49.871207    2584 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-d40f48-serving-cert: secret "maas-api-e2e-api-b-d40f48-serving-cert" not found
Jul 06 02:04:49.871362 ip-10-0-128-8 kubenswrapper[2584]: E0706 02:04:49.871272    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61ef1dfa-4ccf-4491-bce6-c148941c3b1d-maas-api-tls podName:61ef1dfa-4ccf-4491-bce6-c148941c3b1d nodeName:}" failed. No retries permitted until 2026-07-06 02:04:50.371249902 +0000 UTC m=+2298.613017761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/61ef1dfa-4ccf-4491-bce6-c148941c3b1d-maas-api-tls") pod "maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w" (UID: "61ef1dfa-4ccf-4491-bce6-c148941c3b1d") : secret "maas-api-e2e-api-b-d40f48-serving-cert" not found
Jul 06 02:04:49.871802 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:49.871775    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61ef1dfa-4ccf-4491-bce6-c148941c3b1d-openshift-service-ca\") pod \"maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w\" (UID: \"61ef1dfa-4ccf-4491-bce6-c148941c3b1d\") " pod="opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w"
Jul 06 02:04:49.893398 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:49.893360    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnbwr\" (UniqueName: \"kubernetes.io/projected/61ef1dfa-4ccf-4491-bce6-c148941c3b1d-kube-api-access-pnbwr\") pod \"maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w\" (UID: \"61ef1dfa-4ccf-4491-bce6-c148941c3b1d\") " pod="opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w"
Jul 06 02:04:50.377071 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:50.377028    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61ef1dfa-4ccf-4491-bce6-c148941c3b1d-maas-api-tls\") pod \"maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w\" (UID: \"61ef1dfa-4ccf-4491-bce6-c148941c3b1d\") " pod="opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w"
Jul 06 02:04:50.379708 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:50.379681    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61ef1dfa-4ccf-4491-bce6-c148941c3b1d-maas-api-tls\") pod \"maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w\" (UID: \"61ef1dfa-4ccf-4491-bce6-c148941c3b1d\") " pod="opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w"
Jul 06 02:04:50.585066 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:50.585018    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w"
Jul 06 02:04:50.748358 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:50.748266    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w"]
Jul 06 02:04:50.750789 ip-10-0-128-8 kubenswrapper[2584]: W0706 02:04:50.750762    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61ef1dfa_4ccf_4491_bce6_c148941c3b1d.slice/crio-0dc1b618f91e60021846ab11a4dacb4ec46b949e04f2cfb78627af4774d654ac WatchSource:0}: Error finding container 0dc1b618f91e60021846ab11a4dacb4ec46b949e04f2cfb78627af4774d654ac: Status 404 returned error can't find the container with id 0dc1b618f91e60021846ab11a4dacb4ec46b949e04f2cfb78627af4774d654ac
Jul 06 02:04:51.504316 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:51.504280    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w" event={"ID":"61ef1dfa-4ccf-4491-bce6-c148941c3b1d","Type":"ContainerStarted","Data":"21a0076a3460978227e8a080dbd4967c696671d5cca9d4d6868afc5123caa08a"}
Jul 06 02:04:51.504515 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:51.504345    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w" event={"ID":"61ef1dfa-4ccf-4491-bce6-c148941c3b1d","Type":"ContainerStarted","Data":"0dc1b618f91e60021846ab11a4dacb4ec46b949e04f2cfb78627af4774d654ac"}
Jul 06 02:04:51.504515 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:51.504377    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w"
Jul 06 02:04:51.522537 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:51.522481    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w" podStartSLOduration=2.22743663 podStartE2EDuration="2.522465048s" totalImagesPullingTime="295.028418ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:04:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:04:51.52088714 +0000 UTC m=+2299.762655020" watchObservedRunningTime="2026-07-06 02:04:51.522465048 +0000 UTC m=+2299.764232916"
Jul 06 02:04:57.516286 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:04:57.516255    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w"
Jul 06 02:05:03.112818 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:03.112780    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5"]
Jul 06 02:05:03.113276 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:03.113032    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5" podUID="bc3bfa83-5727-46cd-9206-98ab8fe1e155" containerName="maas-api" containerID="cri-o://49a6faeda6ec982880277176d7c35065e34845b4d4c55d7c0c37b8b4735b92a4" gracePeriod=30
Jul 06 02:05:03.363771 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:03.363696    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5"
Jul 06 02:05:03.505010 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:03.504971    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc3bfa83-5727-46cd-9206-98ab8fe1e155-openshift-service-ca\") pod \"bc3bfa83-5727-46cd-9206-98ab8fe1e155\" (UID: \"bc3bfa83-5727-46cd-9206-98ab8fe1e155\") "
Jul 06 02:05:03.505191 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:03.505030    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqfr8\" (UniqueName: \"kubernetes.io/projected/bc3bfa83-5727-46cd-9206-98ab8fe1e155-kube-api-access-fqfr8\") pod \"bc3bfa83-5727-46cd-9206-98ab8fe1e155\" (UID: \"bc3bfa83-5727-46cd-9206-98ab8fe1e155\") "
Jul 06 02:05:03.505191 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:03.505079    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc3bfa83-5727-46cd-9206-98ab8fe1e155-maas-api-tls\") pod \"bc3bfa83-5727-46cd-9206-98ab8fe1e155\" (UID: \"bc3bfa83-5727-46cd-9206-98ab8fe1e155\") "
Jul 06 02:05:03.505450 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:03.505417    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc3bfa83-5727-46cd-9206-98ab8fe1e155-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bc3bfa83-5727-46cd-9206-98ab8fe1e155" (UID: "bc3bfa83-5727-46cd-9206-98ab8fe1e155"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:05:03.507288 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:03.507254    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc3bfa83-5727-46cd-9206-98ab8fe1e155-kube-api-access-fqfr8" (OuterVolumeSpecName: "kube-api-access-fqfr8") pod "bc3bfa83-5727-46cd-9206-98ab8fe1e155" (UID: "bc3bfa83-5727-46cd-9206-98ab8fe1e155"). InnerVolumeSpecName "kube-api-access-fqfr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:05:03.507403 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:03.507309    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc3bfa83-5727-46cd-9206-98ab8fe1e155-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bc3bfa83-5727-46cd-9206-98ab8fe1e155" (UID: "bc3bfa83-5727-46cd-9206-98ab8fe1e155"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:05:03.567328 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:03.567292    2584 generic.go:356] "Generic (PLEG): container finished" podID="bc3bfa83-5727-46cd-9206-98ab8fe1e155" containerID="49a6faeda6ec982880277176d7c35065e34845b4d4c55d7c0c37b8b4735b92a4" exitCode=0
Jul 06 02:05:03.567496 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:03.567407    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5"
Jul 06 02:05:03.567568 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:03.567406    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5" event={"ID":"bc3bfa83-5727-46cd-9206-98ab8fe1e155","Type":"ContainerDied","Data":"49a6faeda6ec982880277176d7c35065e34845b4d4c55d7c0c37b8b4735b92a4"}
Jul 06 02:05:03.567568 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:03.567543    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5" event={"ID":"bc3bfa83-5727-46cd-9206-98ab8fe1e155","Type":"ContainerDied","Data":"194de11ed43a186752578ff631bf09170b2ce427eb5a9a9784418ad968c89fd4"}
Jul 06 02:05:03.567683 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:03.567577    2584 scope.go:117] "RemoveContainer" containerID="49a6faeda6ec982880277176d7c35065e34845b4d4c55d7c0c37b8b4735b92a4"
Jul 06 02:05:03.576714 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:03.576692    2584 scope.go:117] "RemoveContainer" containerID="49a6faeda6ec982880277176d7c35065e34845b4d4c55d7c0c37b8b4735b92a4"
Jul 06 02:05:03.577025 ip-10-0-128-8 kubenswrapper[2584]: E0706 02:05:03.577009    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49a6faeda6ec982880277176d7c35065e34845b4d4c55d7c0c37b8b4735b92a4\": container with ID starting with 49a6faeda6ec982880277176d7c35065e34845b4d4c55d7c0c37b8b4735b92a4 not found: ID does not exist" containerID="49a6faeda6ec982880277176d7c35065e34845b4d4c55d7c0c37b8b4735b92a4"
Jul 06 02:05:03.577114 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:03.577034    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49a6faeda6ec982880277176d7c35065e34845b4d4c55d7c0c37b8b4735b92a4"} err="failed to get container status \"49a6faeda6ec982880277176d7c35065e34845b4d4c55d7c0c37b8b4735b92a4\": rpc error: code = NotFound desc = could not find container \"49a6faeda6ec982880277176d7c35065e34845b4d4c55d7c0c37b8b4735b92a4\": container with ID starting with 49a6faeda6ec982880277176d7c35065e34845b4d4c55d7c0c37b8b4735b92a4 not found: ID does not exist"
Jul 06 02:05:03.589496 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:03.589456    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5"]
Jul 06 02:05:03.591931 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:03.591900    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-0cd54e-6578fff745-bfpx5"]
Jul 06 02:05:03.606528 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:03.606490    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc3bfa83-5727-46cd-9206-98ab8fe1e155-openshift-service-ca\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:05:03.606528 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:03.606521    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqfr8\" (UniqueName: \"kubernetes.io/projected/bc3bfa83-5727-46cd-9206-98ab8fe1e155-kube-api-access-fqfr8\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:05:03.606528 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:03.606533    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc3bfa83-5727-46cd-9206-98ab8fe1e155-maas-api-tls\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:05:04.045173 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:04.045135    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:05:04.616320 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:04.616283    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc3bfa83-5727-46cd-9206-98ab8fe1e155" path="/var/lib/kubelet/pods/bc3bfa83-5727-46cd-9206-98ab8fe1e155/volumes"
Jul 06 02:05:09.961593 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:09.961552    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w"]
Jul 06 02:05:09.962110 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:09.961797    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w" podUID="61ef1dfa-4ccf-4491-bce6-c148941c3b1d" containerName="maas-api" containerID="cri-o://21a0076a3460978227e8a080dbd4967c696671d5cca9d4d6868afc5123caa08a" gracePeriod=30
Jul 06 02:05:10.226529 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:10.226457    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w"
Jul 06 02:05:10.365092 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:10.365054    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61ef1dfa-4ccf-4491-bce6-c148941c3b1d-maas-api-tls\") pod \"61ef1dfa-4ccf-4491-bce6-c148941c3b1d\" (UID: \"61ef1dfa-4ccf-4491-bce6-c148941c3b1d\") "
Jul 06 02:05:10.365300 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:10.365113    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61ef1dfa-4ccf-4491-bce6-c148941c3b1d-openshift-service-ca\") pod \"61ef1dfa-4ccf-4491-bce6-c148941c3b1d\" (UID: \"61ef1dfa-4ccf-4491-bce6-c148941c3b1d\") "
Jul 06 02:05:10.365300 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:10.365139    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnbwr\" (UniqueName: \"kubernetes.io/projected/61ef1dfa-4ccf-4491-bce6-c148941c3b1d-kube-api-access-pnbwr\") pod \"61ef1dfa-4ccf-4491-bce6-c148941c3b1d\" (UID: \"61ef1dfa-4ccf-4491-bce6-c148941c3b1d\") "
Jul 06 02:05:10.365562 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:10.365534    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61ef1dfa-4ccf-4491-bce6-c148941c3b1d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "61ef1dfa-4ccf-4491-bce6-c148941c3b1d" (UID: "61ef1dfa-4ccf-4491-bce6-c148941c3b1d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:05:10.367387 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:10.367357    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61ef1dfa-4ccf-4491-bce6-c148941c3b1d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "61ef1dfa-4ccf-4491-bce6-c148941c3b1d" (UID: "61ef1dfa-4ccf-4491-bce6-c148941c3b1d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:05:10.367477 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:10.367365    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61ef1dfa-4ccf-4491-bce6-c148941c3b1d-kube-api-access-pnbwr" (OuterVolumeSpecName: "kube-api-access-pnbwr") pod "61ef1dfa-4ccf-4491-bce6-c148941c3b1d" (UID: "61ef1dfa-4ccf-4491-bce6-c148941c3b1d"). InnerVolumeSpecName "kube-api-access-pnbwr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:05:10.466725 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:10.466681    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61ef1dfa-4ccf-4491-bce6-c148941c3b1d-maas-api-tls\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:05:10.466725 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:10.466715    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61ef1dfa-4ccf-4491-bce6-c148941c3b1d-openshift-service-ca\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:05:10.466725 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:10.466725    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnbwr\" (UniqueName: \"kubernetes.io/projected/61ef1dfa-4ccf-4491-bce6-c148941c3b1d-kube-api-access-pnbwr\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:05:10.611059 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:10.611026    2584 generic.go:356] "Generic (PLEG): container finished" podID="61ef1dfa-4ccf-4491-bce6-c148941c3b1d" containerID="21a0076a3460978227e8a080dbd4967c696671d5cca9d4d6868afc5123caa08a" exitCode=0
Jul 06 02:05:10.611240 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:10.611098    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w"
Jul 06 02:05:10.617133 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:10.617099    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w" event={"ID":"61ef1dfa-4ccf-4491-bce6-c148941c3b1d","Type":"ContainerDied","Data":"21a0076a3460978227e8a080dbd4967c696671d5cca9d4d6868afc5123caa08a"}
Jul 06 02:05:10.617294 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:10.617150    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w" event={"ID":"61ef1dfa-4ccf-4491-bce6-c148941c3b1d","Type":"ContainerDied","Data":"0dc1b618f91e60021846ab11a4dacb4ec46b949e04f2cfb78627af4774d654ac"}
Jul 06 02:05:10.617294 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:10.617182    2584 scope.go:117] "RemoveContainer" containerID="21a0076a3460978227e8a080dbd4967c696671d5cca9d4d6868afc5123caa08a"
Jul 06 02:05:10.628072 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:10.628052    2584 scope.go:117] "RemoveContainer" containerID="21a0076a3460978227e8a080dbd4967c696671d5cca9d4d6868afc5123caa08a"
Jul 06 02:05:10.628394 ip-10-0-128-8 kubenswrapper[2584]: E0706 02:05:10.628372    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21a0076a3460978227e8a080dbd4967c696671d5cca9d4d6868afc5123caa08a\": container with ID starting with 21a0076a3460978227e8a080dbd4967c696671d5cca9d4d6868afc5123caa08a not found: ID does not exist" containerID="21a0076a3460978227e8a080dbd4967c696671d5cca9d4d6868afc5123caa08a"
Jul 06 02:05:10.628454 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:10.628403    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21a0076a3460978227e8a080dbd4967c696671d5cca9d4d6868afc5123caa08a"} err="failed to get container status \"21a0076a3460978227e8a080dbd4967c696671d5cca9d4d6868afc5123caa08a\": rpc error: code = NotFound desc = could not find container \"21a0076a3460978227e8a080dbd4967c696671d5cca9d4d6868afc5123caa08a\": container with ID starting with 21a0076a3460978227e8a080dbd4967c696671d5cca9d4d6868afc5123caa08a not found: ID does not exist"
Jul 06 02:05:10.636896 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:10.636863    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w"]
Jul 06 02:05:10.640582 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:10.640555    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d40f48-8bdfbcd45-x926w"]
Jul 06 02:05:12.615886 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:12.615852    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61ef1dfa-4ccf-4491-bce6-c148941c3b1d" path="/var/lib/kubelet/pods/61ef1dfa-4ccf-4491-bce6-c148941c3b1d/volumes"
Jul 06 02:05:14.036320 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:14.036276    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:05:19.859155 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:19.859116    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr"]
Jul 06 02:05:19.860269 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:19.860239    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc3bfa83-5727-46cd-9206-98ab8fe1e155" containerName="maas-api"
Jul 06 02:05:19.860269 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:19.860270    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc3bfa83-5727-46cd-9206-98ab8fe1e155" containerName="maas-api"
Jul 06 02:05:19.860423 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:19.860334    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61ef1dfa-4ccf-4491-bce6-c148941c3b1d" containerName="maas-api"
Jul 06 02:05:19.860423 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:19.860344    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="61ef1dfa-4ccf-4491-bce6-c148941c3b1d" containerName="maas-api"
Jul 06 02:05:19.860502 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:19.860452    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="61ef1dfa-4ccf-4491-bce6-c148941c3b1d" containerName="maas-api"
Jul 06 02:05:19.860502 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:19.860465    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc3bfa83-5727-46cd-9206-98ab8fe1e155" containerName="maas-api"
Jul 06 02:05:19.865320 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:19.865298    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr"
Jul 06 02:05:19.868329 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:19.868306    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cfbht\""
Jul 06 02:05:19.868449 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:19.868328    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-388824-serving-cert\""
Jul 06 02:05:19.877199 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:19.877154    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr"]
Jul 06 02:05:19.941004 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:19.940961    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63425ea3-3e97-4981-ad33-dbe30ba8d001-openshift-service-ca\") pod \"maas-api-e2e-shared-a-388824-6755788d4b-9lxvr\" (UID: \"63425ea3-3e97-4981-ad33-dbe30ba8d001\") " pod="opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr"
Jul 06 02:05:19.941004 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:19.941000    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpqls\" (UniqueName: \"kubernetes.io/projected/63425ea3-3e97-4981-ad33-dbe30ba8d001-kube-api-access-kpqls\") pod \"maas-api-e2e-shared-a-388824-6755788d4b-9lxvr\" (UID: \"63425ea3-3e97-4981-ad33-dbe30ba8d001\") " pod="opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr"
Jul 06 02:05:19.941217 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:19.941101    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63425ea3-3e97-4981-ad33-dbe30ba8d001-maas-api-tls\") pod \"maas-api-e2e-shared-a-388824-6755788d4b-9lxvr\" (UID: \"63425ea3-3e97-4981-ad33-dbe30ba8d001\") " pod="opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr"
Jul 06 02:05:20.042445 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:20.042409    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63425ea3-3e97-4981-ad33-dbe30ba8d001-openshift-service-ca\") pod \"maas-api-e2e-shared-a-388824-6755788d4b-9lxvr\" (UID: \"63425ea3-3e97-4981-ad33-dbe30ba8d001\") " pod="opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr"
Jul 06 02:05:20.042445 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:20.042450    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpqls\" (UniqueName: \"kubernetes.io/projected/63425ea3-3e97-4981-ad33-dbe30ba8d001-kube-api-access-kpqls\") pod \"maas-api-e2e-shared-a-388824-6755788d4b-9lxvr\" (UID: \"63425ea3-3e97-4981-ad33-dbe30ba8d001\") " pod="opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr"
Jul 06 02:05:20.042704 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:20.042504    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63425ea3-3e97-4981-ad33-dbe30ba8d001-maas-api-tls\") pod \"maas-api-e2e-shared-a-388824-6755788d4b-9lxvr\" (UID: \"63425ea3-3e97-4981-ad33-dbe30ba8d001\") " pod="opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr"
Jul 06 02:05:20.042704 ip-10-0-128-8 kubenswrapper[2584]: E0706 02:05:20.042617    2584 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-388824-serving-cert: secret "maas-api-e2e-shared-a-388824-serving-cert" not found
Jul 06 02:05:20.042778 ip-10-0-128-8 kubenswrapper[2584]: E0706 02:05:20.042722    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63425ea3-3e97-4981-ad33-dbe30ba8d001-maas-api-tls podName:63425ea3-3e97-4981-ad33-dbe30ba8d001 nodeName:}" failed. No retries permitted until 2026-07-06 02:05:20.542700851 +0000 UTC m=+2328.784468695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/63425ea3-3e97-4981-ad33-dbe30ba8d001-maas-api-tls") pod "maas-api-e2e-shared-a-388824-6755788d4b-9lxvr" (UID: "63425ea3-3e97-4981-ad33-dbe30ba8d001") : secret "maas-api-e2e-shared-a-388824-serving-cert" not found
Jul 06 02:05:20.043092 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:20.043070    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63425ea3-3e97-4981-ad33-dbe30ba8d001-openshift-service-ca\") pod \"maas-api-e2e-shared-a-388824-6755788d4b-9lxvr\" (UID: \"63425ea3-3e97-4981-ad33-dbe30ba8d001\") " pod="opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr"
Jul 06 02:05:20.051998 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:20.051965    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpqls\" (UniqueName: \"kubernetes.io/projected/63425ea3-3e97-4981-ad33-dbe30ba8d001-kube-api-access-kpqls\") pod \"maas-api-e2e-shared-a-388824-6755788d4b-9lxvr\" (UID: \"63425ea3-3e97-4981-ad33-dbe30ba8d001\") " pod="opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr"
Jul 06 02:05:20.545918 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:20.545881    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63425ea3-3e97-4981-ad33-dbe30ba8d001-maas-api-tls\") pod \"maas-api-e2e-shared-a-388824-6755788d4b-9lxvr\" (UID: \"63425ea3-3e97-4981-ad33-dbe30ba8d001\") " pod="opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr"
Jul 06 02:05:20.548536 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:20.548507    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63425ea3-3e97-4981-ad33-dbe30ba8d001-maas-api-tls\") pod \"maas-api-e2e-shared-a-388824-6755788d4b-9lxvr\" (UID: \"63425ea3-3e97-4981-ad33-dbe30ba8d001\") " pod="opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr"
Jul 06 02:05:20.779569 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:20.779532    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr"
Jul 06 02:05:20.927273 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:20.927242    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr"]
Jul 06 02:05:20.929655 ip-10-0-128-8 kubenswrapper[2584]: W0706 02:05:20.929604    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63425ea3_3e97_4981_ad33_dbe30ba8d001.slice/crio-a0a5f5e06fe80e69215029c966ad3cb19241fc429fc3c0bc7ecd0afa8e14715d WatchSource:0}: Error finding container a0a5f5e06fe80e69215029c966ad3cb19241fc429fc3c0bc7ecd0afa8e14715d: Status 404 returned error can't find the container with id a0a5f5e06fe80e69215029c966ad3cb19241fc429fc3c0bc7ecd0afa8e14715d
Jul 06 02:05:21.667794 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:21.667759    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr" event={"ID":"63425ea3-3e97-4981-ad33-dbe30ba8d001","Type":"ContainerStarted","Data":"150126517d70226506c884b4f0e45da7a82e7683a82bff1a8ccf1e2db015316d"}
Jul 06 02:05:21.667951 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:21.667813    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr" event={"ID":"63425ea3-3e97-4981-ad33-dbe30ba8d001","Type":"ContainerStarted","Data":"a0a5f5e06fe80e69215029c966ad3cb19241fc429fc3c0bc7ecd0afa8e14715d"}
Jul 06 02:05:21.668008 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:21.667981    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr"
Jul 06 02:05:21.686302 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:21.686247    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr" podStartSLOduration=2.323708462 podStartE2EDuration="2.686229498s" totalImagesPullingTime="362.521036ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:05:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:05:21.685479002 +0000 UTC m=+2329.927246870" watchObservedRunningTime="2026-07-06 02:05:21.686229498 +0000 UTC m=+2329.927997364"
Jul 06 02:05:25.144355 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:25.144267    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:05:27.679394 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:27.679363    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr"
Jul 06 02:05:27.966942 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:27.966843    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh"]
Jul 06 02:05:27.971290 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:27.971262    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh"
Jul 06 02:05:27.975463 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:27.975438    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-3d280d-serving-cert\""
Jul 06 02:05:27.987025 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:27.986986    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh"]
Jul 06 02:05:28.002962 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:28.002920    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb394964-112e-4182-8935-279ddf64221b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh\" (UID: \"cb394964-112e-4182-8935-279ddf64221b\") " pod="opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh"
Jul 06 02:05:28.003189 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:28.002980    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57qs9\" (UniqueName: \"kubernetes.io/projected/cb394964-112e-4182-8935-279ddf64221b-kube-api-access-57qs9\") pod \"maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh\" (UID: \"cb394964-112e-4182-8935-279ddf64221b\") " pod="opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh"
Jul 06 02:05:28.003189 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:28.003109    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb394964-112e-4182-8935-279ddf64221b-maas-api-tls\") pod \"maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh\" (UID: \"cb394964-112e-4182-8935-279ddf64221b\") " pod="opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh"
Jul 06 02:05:28.104197 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:28.104152    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb394964-112e-4182-8935-279ddf64221b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh\" (UID: \"cb394964-112e-4182-8935-279ddf64221b\") " pod="opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh"
Jul 06 02:05:28.104197 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:28.104200    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57qs9\" (UniqueName: \"kubernetes.io/projected/cb394964-112e-4182-8935-279ddf64221b-kube-api-access-57qs9\") pod \"maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh\" (UID: \"cb394964-112e-4182-8935-279ddf64221b\") " pod="opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh"
Jul 06 02:05:28.104480 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:28.104256    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb394964-112e-4182-8935-279ddf64221b-maas-api-tls\") pod \"maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh\" (UID: \"cb394964-112e-4182-8935-279ddf64221b\") " pod="opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh"
Jul 06 02:05:28.104480 ip-10-0-128-8 kubenswrapper[2584]: E0706 02:05:28.104376    2584 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-3d280d-serving-cert: secret "maas-api-e2e-shared-b-3d280d-serving-cert" not found
Jul 06 02:05:28.104480 ip-10-0-128-8 kubenswrapper[2584]: E0706 02:05:28.104455    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb394964-112e-4182-8935-279ddf64221b-maas-api-tls podName:cb394964-112e-4182-8935-279ddf64221b nodeName:}" failed. No retries permitted until 2026-07-06 02:05:28.604433359 +0000 UTC m=+2336.846201204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cb394964-112e-4182-8935-279ddf64221b-maas-api-tls") pod "maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh" (UID: "cb394964-112e-4182-8935-279ddf64221b") : secret "maas-api-e2e-shared-b-3d280d-serving-cert" not found
Jul 06 02:05:28.104971 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:28.104947    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb394964-112e-4182-8935-279ddf64221b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh\" (UID: \"cb394964-112e-4182-8935-279ddf64221b\") " pod="opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh"
Jul 06 02:05:28.117981 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:28.117948    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57qs9\" (UniqueName: \"kubernetes.io/projected/cb394964-112e-4182-8935-279ddf64221b-kube-api-access-57qs9\") pod \"maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh\" (UID: \"cb394964-112e-4182-8935-279ddf64221b\") " pod="opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh"
Jul 06 02:05:28.608596 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:28.608549    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb394964-112e-4182-8935-279ddf64221b-maas-api-tls\") pod \"maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh\" (UID: \"cb394964-112e-4182-8935-279ddf64221b\") " pod="opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh"
Jul 06 02:05:28.611199 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:28.611156    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb394964-112e-4182-8935-279ddf64221b-maas-api-tls\") pod \"maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh\" (UID: \"cb394964-112e-4182-8935-279ddf64221b\") " pod="opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh"
Jul 06 02:05:28.884057 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:28.883958    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh"
Jul 06 02:05:29.033889 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:29.033857    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh"]
Jul 06 02:05:29.036405 ip-10-0-128-8 kubenswrapper[2584]: W0706 02:05:29.036375    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb394964_112e_4182_8935_279ddf64221b.slice/crio-1bde36514ee82f0e64b558d2148a0db587ef3de0f02f08feca142b8ec3a5d679 WatchSource:0}: Error finding container 1bde36514ee82f0e64b558d2148a0db587ef3de0f02f08feca142b8ec3a5d679: Status 404 returned error can't find the container with id 1bde36514ee82f0e64b558d2148a0db587ef3de0f02f08feca142b8ec3a5d679
Jul 06 02:05:29.714120 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:29.714026    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh" event={"ID":"cb394964-112e-4182-8935-279ddf64221b","Type":"ContainerStarted","Data":"2cfcc480f36d5ddb5830a90e2c79cce08a9b62ac90b7675a8d4d73ce1bc115c0"}
Jul 06 02:05:29.714120 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:29.714085    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh" event={"ID":"cb394964-112e-4182-8935-279ddf64221b","Type":"ContainerStarted","Data":"1bde36514ee82f0e64b558d2148a0db587ef3de0f02f08feca142b8ec3a5d679"}
Jul 06 02:05:29.714354 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:29.714164    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh"
Jul 06 02:05:29.743931 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:29.743872    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh" podStartSLOduration=2.366609552 podStartE2EDuration="2.743852857s" totalImagesPullingTime="377.243305ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:05:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:05:29.740970009 +0000 UTC m=+2337.982737875" watchObservedRunningTime="2026-07-06 02:05:29.743852857 +0000 UTC m=+2337.985620725"
Jul 06 02:05:33.855253 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:33.855220    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:05:35.725474 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:35.725443    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh"
Jul 06 02:05:46.342938 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:05:46.342902    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:06:27.931936 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:06:27.931895    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:06:32.646792 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:06:32.646752    2584 scope.go:117] "RemoveContainer" containerID="5783b4721fa1ac7957955b4e4c4c0bfcaf3e15534a1e9545e3231977e45bdbeb"
Jul 06 02:06:46.332921 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:06:46.332883    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:07:02.030907 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:07:02.030820    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:07:18.841321 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:07:18.841283    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:07:36.743430 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:07:36.743393    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:07:52.931833 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:07:52.931790    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:08:10.736774 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:10.736734    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:08:27.931212 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:27.931126    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:08:38.830691 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:38.830645    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"]
Jul 06 02:08:38.834619 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:38.834590    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:08:38.837327 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:38.837301    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-388824\"/\"kube-root-ca.crt\""
Jul 06 02:08:38.838498 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:38.838480    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-388824\"/\"default-dockercfg-d8pxv\""
Jul 06 02:08:38.838613 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:38.838521    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-388824\"/\"openshift-service-ca.crt\""
Jul 06 02:08:38.838613 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:38.838530    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-388824\"/\"sub-test-model-388824-kserve-self-signed-certs\""
Jul 06 02:08:38.845456 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:38.845432    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"]
Jul 06 02:08:38.970412 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:38.970358    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-model-cache\") pod \"sub-test-model-388824-kserve-56d6cf9cd9-vdp8c\" (UID: \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\") " pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:08:38.970621 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:38.970483    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-tmp-dir\") pod \"sub-test-model-388824-kserve-56d6cf9cd9-vdp8c\" (UID: \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\") " pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:08:38.970621 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:38.970511    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-home\") pod \"sub-test-model-388824-kserve-56d6cf9cd9-vdp8c\" (UID: \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\") " pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:08:38.970621 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:38.970601    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-dshm\") pod \"sub-test-model-388824-kserve-56d6cf9cd9-vdp8c\" (UID: \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\") " pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:08:38.970855 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:38.970671    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-tls-certs\") pod \"sub-test-model-388824-kserve-56d6cf9cd9-vdp8c\" (UID: \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\") " pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:08:38.970855 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:38.970750    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdfc9\" (UniqueName: \"kubernetes.io/projected/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-kube-api-access-vdfc9\") pod \"sub-test-model-388824-kserve-56d6cf9cd9-vdp8c\" (UID: \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\") " pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:08:39.072185 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:39.072146    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-dshm\") pod \"sub-test-model-388824-kserve-56d6cf9cd9-vdp8c\" (UID: \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\") " pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:08:39.072185 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:39.072185    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-tls-certs\") pod \"sub-test-model-388824-kserve-56d6cf9cd9-vdp8c\" (UID: \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\") " pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:08:39.072440 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:39.072314    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdfc9\" (UniqueName: \"kubernetes.io/projected/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-kube-api-access-vdfc9\") pod \"sub-test-model-388824-kserve-56d6cf9cd9-vdp8c\" (UID: \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\") " pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:08:39.072440 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:39.072351    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-model-cache\") pod \"sub-test-model-388824-kserve-56d6cf9cd9-vdp8c\" (UID: \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\") " pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:08:39.072536 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:39.072438    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-tmp-dir\") pod \"sub-test-model-388824-kserve-56d6cf9cd9-vdp8c\" (UID: \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\") " pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:08:39.072536 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:39.072466    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-home\") pod \"sub-test-model-388824-kserve-56d6cf9cd9-vdp8c\" (UID: \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\") " pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:08:39.072795 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:39.072773    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-model-cache\") pod \"sub-test-model-388824-kserve-56d6cf9cd9-vdp8c\" (UID: \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\") " pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:08:39.072868 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:39.072805    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-tmp-dir\") pod \"sub-test-model-388824-kserve-56d6cf9cd9-vdp8c\" (UID: \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\") " pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:08:39.072868 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:39.072837    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-home\") pod \"sub-test-model-388824-kserve-56d6cf9cd9-vdp8c\" (UID: \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\") " pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:08:39.074683 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:39.074654    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-dshm\") pod \"sub-test-model-388824-kserve-56d6cf9cd9-vdp8c\" (UID: \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\") " pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:08:39.074950 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:39.074933    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-tls-certs\") pod \"sub-test-model-388824-kserve-56d6cf9cd9-vdp8c\" (UID: \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\") " pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:08:39.080098 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:39.080060    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdfc9\" (UniqueName: \"kubernetes.io/projected/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-kube-api-access-vdfc9\") pod \"sub-test-model-388824-kserve-56d6cf9cd9-vdp8c\" (UID: \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\") " pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:08:39.146253 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:39.146209    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:08:39.290965 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:39.290898    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"]
Jul 06 02:08:39.294527 ip-10-0-128-8 kubenswrapper[2584]: W0706 02:08:39.294492    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfde8d2fc_fdfb_4e6f_9ea5_553b779cc6db.slice/crio-cf44c59eaebc673fd32fe3046b5f255c29dffdc4fcf1fe22221c9cc2f8e5234c WatchSource:0}: Error finding container cf44c59eaebc673fd32fe3046b5f255c29dffdc4fcf1fe22221c9cc2f8e5234c: Status 404 returned error can't find the container with id cf44c59eaebc673fd32fe3046b5f255c29dffdc4fcf1fe22221c9cc2f8e5234c
Jul 06 02:08:39.682185 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:39.682133    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c" event={"ID":"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db","Type":"ContainerStarted","Data":"f82c5dc2acc89ef3cba23842e93f12c17647a62b4adc9e4279ce413a89545113"}
Jul 06 02:08:39.682393 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:39.682195    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c" event={"ID":"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db","Type":"ContainerStarted","Data":"cf44c59eaebc673fd32fe3046b5f255c29dffdc4fcf1fe22221c9cc2f8e5234c"}
Jul 06 02:08:39.699836 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:39.699775    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c" podStartSLOduration=1.699754133 podStartE2EDuration="1.699754133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:08:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:08:39.697983911 +0000 UTC m=+2527.939751791" watchObservedRunningTime="2026-07-06 02:08:39.699754133 +0000 UTC m=+2527.941521994"
Jul 06 02:08:42.441076 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:42.441041    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:08:49.146544 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:49.146504    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:08:49.146999 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:49.146670    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:08:49.159750 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:49.159720    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:08:49.745768 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:08:49.745738    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:09:13.441358 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:13.441311    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:09:27.234323 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:27.234279    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:09:43.420226 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:43.420188    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"]
Jul 06 02:09:48.236562 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:48.236523    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:09:58.441364 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:58.441256    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c" podUID="fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db" containerName="main" containerID="cri-o://f82c5dc2acc89ef3cba23842e93f12c17647a62b4adc9e4279ce413a89545113" gracePeriod=45
Jul 06 02:09:58.702693 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:58.702611    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:09:58.793963 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:58.793913    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-tls-certs\") pod \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\" (UID: \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\") "
Jul 06 02:09:58.794153 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:58.794019    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdfc9\" (UniqueName: \"kubernetes.io/projected/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-kube-api-access-vdfc9\") pod \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\" (UID: \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\") "
Jul 06 02:09:58.794153 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:58.794064    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-home\") pod \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\" (UID: \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\") "
Jul 06 02:09:58.794153 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:58.794101    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-model-cache\") pod \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\" (UID: \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\") "
Jul 06 02:09:58.794153 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:58.794129    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-tmp-dir\") pod \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\" (UID: \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\") "
Jul 06 02:09:58.794354 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:58.794158    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-dshm\") pod \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\" (UID: \"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db\") "
Jul 06 02:09:58.794412 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:58.794324    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-home" (OuterVolumeSpecName: "home") pod "fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db" (UID: "fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:09:58.794468 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:58.794412    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-model-cache" (OuterVolumeSpecName: "model-cache") pod "fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db" (UID: "fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:09:58.794468 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:58.794437    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db" (UID: "fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:09:58.794468 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:58.794453    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-home\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:09:58.796570 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:58.796534    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-dshm" (OuterVolumeSpecName: "dshm") pod "fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db" (UID: "fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:09:58.796777 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:58.796704    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db" (UID: "fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:09:58.796928 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:58.796887    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-kube-api-access-vdfc9" (OuterVolumeSpecName: "kube-api-access-vdfc9") pod "fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db" (UID: "fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db"). InnerVolumeSpecName "kube-api-access-vdfc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:09:58.895738 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:58.895684    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdfc9\" (UniqueName: \"kubernetes.io/projected/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-kube-api-access-vdfc9\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:09:58.895738 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:58.895734    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-model-cache\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:09:58.895738 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:58.895745    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-tmp-dir\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:09:58.895738 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:58.895752    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-dshm\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:09:58.896017 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:58.895761    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db-tls-certs\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:09:59.086045 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:59.085944    2584 generic.go:356] "Generic (PLEG): container finished" podID="fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db" containerID="f82c5dc2acc89ef3cba23842e93f12c17647a62b4adc9e4279ce413a89545113" exitCode=0
Jul 06 02:09:59.086045 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:59.085990    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"
Jul 06 02:09:59.086045 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:59.086026    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c" event={"ID":"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db","Type":"ContainerDied","Data":"f82c5dc2acc89ef3cba23842e93f12c17647a62b4adc9e4279ce413a89545113"}
Jul 06 02:09:59.086318 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:59.086078    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c" event={"ID":"fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db","Type":"ContainerDied","Data":"cf44c59eaebc673fd32fe3046b5f255c29dffdc4fcf1fe22221c9cc2f8e5234c"}
Jul 06 02:09:59.086318 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:59.086101    2584 scope.go:117] "RemoveContainer" containerID="f82c5dc2acc89ef3cba23842e93f12c17647a62b4adc9e4279ce413a89545113"
Jul 06 02:09:59.095884 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:59.095861    2584 scope.go:117] "RemoveContainer" containerID="f82c5dc2acc89ef3cba23842e93f12c17647a62b4adc9e4279ce413a89545113"
Jul 06 02:09:59.096167 ip-10-0-128-8 kubenswrapper[2584]: E0706 02:09:59.096146    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f82c5dc2acc89ef3cba23842e93f12c17647a62b4adc9e4279ce413a89545113\": container with ID starting with f82c5dc2acc89ef3cba23842e93f12c17647a62b4adc9e4279ce413a89545113 not found: ID does not exist" containerID="f82c5dc2acc89ef3cba23842e93f12c17647a62b4adc9e4279ce413a89545113"
Jul 06 02:09:59.096232 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:59.096175    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f82c5dc2acc89ef3cba23842e93f12c17647a62b4adc9e4279ce413a89545113"} err="failed to get container status \"f82c5dc2acc89ef3cba23842e93f12c17647a62b4adc9e4279ce413a89545113\": rpc error: code = NotFound desc = could not find container \"f82c5dc2acc89ef3cba23842e93f12c17647a62b4adc9e4279ce413a89545113\": container with ID starting with f82c5dc2acc89ef3cba23842e93f12c17647a62b4adc9e4279ce413a89545113 not found: ID does not exist"
Jul 06 02:09:59.107845 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:59.107812    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"]
Jul 06 02:09:59.111101 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:09:59.111069    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-388824/sub-test-model-388824-kserve-56d6cf9cd9-vdp8c"]
Jul 06 02:10:00.615867 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:10:00.615832    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db" path="/var/lib/kubelet/pods/fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db/volumes"
Jul 06 02:10:05.239023 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:10:05.238991    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:10:20.736723 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:10:20.736679    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:10:40.241742 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:10:40.241701    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:10:55.132196 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:10:55.132153    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:11:05.143519 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:05.143476    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr"]
Jul 06 02:11:05.144002 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:05.143774    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr" podUID="63425ea3-3e97-4981-ad33-dbe30ba8d001" containerName="maas-api" containerID="cri-o://150126517d70226506c884b4f0e45da7a82e7683a82bff1a8ccf1e2db015316d" gracePeriod=30
Jul 06 02:11:05.407365 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:05.407286    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr"
Jul 06 02:11:05.435896 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:05.435864    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63425ea3-3e97-4981-ad33-dbe30ba8d001-maas-api-tls\") pod \"63425ea3-3e97-4981-ad33-dbe30ba8d001\" (UID: \"63425ea3-3e97-4981-ad33-dbe30ba8d001\") "
Jul 06 02:11:05.436068 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:05.435915    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpqls\" (UniqueName: \"kubernetes.io/projected/63425ea3-3e97-4981-ad33-dbe30ba8d001-kube-api-access-kpqls\") pod \"63425ea3-3e97-4981-ad33-dbe30ba8d001\" (UID: \"63425ea3-3e97-4981-ad33-dbe30ba8d001\") "
Jul 06 02:11:05.436068 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:05.436034    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63425ea3-3e97-4981-ad33-dbe30ba8d001-openshift-service-ca\") pod \"63425ea3-3e97-4981-ad33-dbe30ba8d001\" (UID: \"63425ea3-3e97-4981-ad33-dbe30ba8d001\") "
Jul 06 02:11:05.436390 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:05.436364    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63425ea3-3e97-4981-ad33-dbe30ba8d001-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "63425ea3-3e97-4981-ad33-dbe30ba8d001" (UID: "63425ea3-3e97-4981-ad33-dbe30ba8d001"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:11:05.438410 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:05.438370    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63425ea3-3e97-4981-ad33-dbe30ba8d001-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "63425ea3-3e97-4981-ad33-dbe30ba8d001" (UID: "63425ea3-3e97-4981-ad33-dbe30ba8d001"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:11:05.438410 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:05.438392    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63425ea3-3e97-4981-ad33-dbe30ba8d001-kube-api-access-kpqls" (OuterVolumeSpecName: "kube-api-access-kpqls") pod "63425ea3-3e97-4981-ad33-dbe30ba8d001" (UID: "63425ea3-3e97-4981-ad33-dbe30ba8d001"). InnerVolumeSpecName "kube-api-access-kpqls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:11:05.443556 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:05.443527    2584 generic.go:356] "Generic (PLEG): container finished" podID="63425ea3-3e97-4981-ad33-dbe30ba8d001" containerID="150126517d70226506c884b4f0e45da7a82e7683a82bff1a8ccf1e2db015316d" exitCode=0
Jul 06 02:11:05.443786 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:05.443577    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr"
Jul 06 02:11:05.443786 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:05.443606    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr" event={"ID":"63425ea3-3e97-4981-ad33-dbe30ba8d001","Type":"ContainerDied","Data":"150126517d70226506c884b4f0e45da7a82e7683a82bff1a8ccf1e2db015316d"}
Jul 06 02:11:05.443786 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:05.443697    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr" event={"ID":"63425ea3-3e97-4981-ad33-dbe30ba8d001","Type":"ContainerDied","Data":"a0a5f5e06fe80e69215029c966ad3cb19241fc429fc3c0bc7ecd0afa8e14715d"}
Jul 06 02:11:05.443786 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:05.443729    2584 scope.go:117] "RemoveContainer" containerID="150126517d70226506c884b4f0e45da7a82e7683a82bff1a8ccf1e2db015316d"
Jul 06 02:11:05.461360 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:05.461339    2584 scope.go:117] "RemoveContainer" containerID="150126517d70226506c884b4f0e45da7a82e7683a82bff1a8ccf1e2db015316d"
Jul 06 02:11:05.461719 ip-10-0-128-8 kubenswrapper[2584]: E0706 02:11:05.461697    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"150126517d70226506c884b4f0e45da7a82e7683a82bff1a8ccf1e2db015316d\": container with ID starting with 150126517d70226506c884b4f0e45da7a82e7683a82bff1a8ccf1e2db015316d not found: ID does not exist" containerID="150126517d70226506c884b4f0e45da7a82e7683a82bff1a8ccf1e2db015316d"
Jul 06 02:11:05.461811 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:05.461730    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"150126517d70226506c884b4f0e45da7a82e7683a82bff1a8ccf1e2db015316d"} err="failed to get container status \"150126517d70226506c884b4f0e45da7a82e7683a82bff1a8ccf1e2db015316d\": rpc error: code = NotFound desc = could not find container \"150126517d70226506c884b4f0e45da7a82e7683a82bff1a8ccf1e2db015316d\": container with ID starting with 150126517d70226506c884b4f0e45da7a82e7683a82bff1a8ccf1e2db015316d not found: ID does not exist"
Jul 06 02:11:05.471525 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:05.471493    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr"]
Jul 06 02:11:05.475008 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:05.474976    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-388824-6755788d4b-9lxvr"]
Jul 06 02:11:05.537561 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:05.537519    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63425ea3-3e97-4981-ad33-dbe30ba8d001-openshift-service-ca\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:11:05.537561 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:05.537552    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63425ea3-3e97-4981-ad33-dbe30ba8d001-maas-api-tls\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:11:05.537561 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:05.537563    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpqls\" (UniqueName: \"kubernetes.io/projected/63425ea3-3e97-4981-ad33-dbe30ba8d001-kube-api-access-kpqls\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:11:06.616553 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:06.616516    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63425ea3-3e97-4981-ad33-dbe30ba8d001" path="/var/lib/kubelet/pods/63425ea3-3e97-4981-ad33-dbe30ba8d001/volumes"
Jul 06 02:11:08.237348 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:08.237309    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:11:31.194818 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:31.194732    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh"]
Jul 06 02:11:31.195420 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:31.194975    2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh" podUID="cb394964-112e-4182-8935-279ddf64221b" containerName="maas-api" containerID="cri-o://2cfcc480f36d5ddb5830a90e2c79cce08a9b62ac90b7675a8d4d73ce1bc115c0" gracePeriod=30
Jul 06 02:11:31.444420 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:31.444388    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh"
Jul 06 02:11:31.576823 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:31.576725    2584 generic.go:356] "Generic (PLEG): container finished" podID="cb394964-112e-4182-8935-279ddf64221b" containerID="2cfcc480f36d5ddb5830a90e2c79cce08a9b62ac90b7675a8d4d73ce1bc115c0" exitCode=0
Jul 06 02:11:31.576823 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:31.576782    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh"
Jul 06 02:11:31.576823 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:31.576797    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh" event={"ID":"cb394964-112e-4182-8935-279ddf64221b","Type":"ContainerDied","Data":"2cfcc480f36d5ddb5830a90e2c79cce08a9b62ac90b7675a8d4d73ce1bc115c0"}
Jul 06 02:11:31.577099 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:31.576856    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh" event={"ID":"cb394964-112e-4182-8935-279ddf64221b","Type":"ContainerDied","Data":"1bde36514ee82f0e64b558d2148a0db587ef3de0f02f08feca142b8ec3a5d679"}
Jul 06 02:11:31.577099 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:31.576889    2584 scope.go:117] "RemoveContainer" containerID="2cfcc480f36d5ddb5830a90e2c79cce08a9b62ac90b7675a8d4d73ce1bc115c0"
Jul 06 02:11:31.585928 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:31.585900    2584 scope.go:117] "RemoveContainer" containerID="2cfcc480f36d5ddb5830a90e2c79cce08a9b62ac90b7675a8d4d73ce1bc115c0"
Jul 06 02:11:31.586273 ip-10-0-128-8 kubenswrapper[2584]: E0706 02:11:31.586248    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cfcc480f36d5ddb5830a90e2c79cce08a9b62ac90b7675a8d4d73ce1bc115c0\": container with ID starting with 2cfcc480f36d5ddb5830a90e2c79cce08a9b62ac90b7675a8d4d73ce1bc115c0 not found: ID does not exist" containerID="2cfcc480f36d5ddb5830a90e2c79cce08a9b62ac90b7675a8d4d73ce1bc115c0"
Jul 06 02:11:31.586326 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:31.586283    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cfcc480f36d5ddb5830a90e2c79cce08a9b62ac90b7675a8d4d73ce1bc115c0"} err="failed to get container status \"2cfcc480f36d5ddb5830a90e2c79cce08a9b62ac90b7675a8d4d73ce1bc115c0\": rpc error: code = NotFound desc = could not find container \"2cfcc480f36d5ddb5830a90e2c79cce08a9b62ac90b7675a8d4d73ce1bc115c0\": container with ID starting with 2cfcc480f36d5ddb5830a90e2c79cce08a9b62ac90b7675a8d4d73ce1bc115c0 not found: ID does not exist"
Jul 06 02:11:31.593141 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:31.593035    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb394964-112e-4182-8935-279ddf64221b-maas-api-tls\") pod \"cb394964-112e-4182-8935-279ddf64221b\" (UID: \"cb394964-112e-4182-8935-279ddf64221b\") "
Jul 06 02:11:31.593746 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:31.593394    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57qs9\" (UniqueName: \"kubernetes.io/projected/cb394964-112e-4182-8935-279ddf64221b-kube-api-access-57qs9\") pod \"cb394964-112e-4182-8935-279ddf64221b\" (UID: \"cb394964-112e-4182-8935-279ddf64221b\") "
Jul 06 02:11:31.593746 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:31.593432    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb394964-112e-4182-8935-279ddf64221b-openshift-service-ca\") pod \"cb394964-112e-4182-8935-279ddf64221b\" (UID: \"cb394964-112e-4182-8935-279ddf64221b\") "
Jul 06 02:11:31.593964 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:31.593941    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb394964-112e-4182-8935-279ddf64221b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cb394964-112e-4182-8935-279ddf64221b" (UID: "cb394964-112e-4182-8935-279ddf64221b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:11:31.596002 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:31.595958    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb394964-112e-4182-8935-279ddf64221b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cb394964-112e-4182-8935-279ddf64221b" (UID: "cb394964-112e-4182-8935-279ddf64221b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:11:31.596110 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:31.596057    2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb394964-112e-4182-8935-279ddf64221b-kube-api-access-57qs9" (OuterVolumeSpecName: "kube-api-access-57qs9") pod "cb394964-112e-4182-8935-279ddf64221b" (UID: "cb394964-112e-4182-8935-279ddf64221b"). InnerVolumeSpecName "kube-api-access-57qs9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:11:31.694599 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:31.694556    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb394964-112e-4182-8935-279ddf64221b-maas-api-tls\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:11:31.694599 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:31.694590    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57qs9\" (UniqueName: \"kubernetes.io/projected/cb394964-112e-4182-8935-279ddf64221b-kube-api-access-57qs9\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:11:31.694599 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:31.694600    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb394964-112e-4182-8935-279ddf64221b-openshift-service-ca\") on node \"ip-10-0-128-8.ec2.internal\" DevicePath \"\""
Jul 06 02:11:31.898927 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:31.898889    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh"]
Jul 06 02:11:31.902590 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:31.902559    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-3d280d-6f9c5694dc-96vsh"]
Jul 06 02:11:32.616352 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:32.616311    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb394964-112e-4182-8935-279ddf64221b" path="/var/lib/kubelet/pods/cb394964-112e-4182-8935-279ddf64221b/volumes"
Jul 06 02:11:33.332589 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:33.332552    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d49p8"]
Jul 06 02:11:42.412998 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:42.412966    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-knc5n_e170b11b-fc61-4699-b458-df23029d6cd9/manager/0.log"
Jul 06 02:11:42.804392 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:42.804311    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29721705-mq97d_e1ab9594-fd24-48d0-951d-5f9e89eb01f3/cleanup/0.log"
Jul 06 02:11:43.667488 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:43.667457    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-656987b587-swmw6_979b8c55-fa28-4af8-ab4b-6942d7fa727a/copy-manifests/0.log"
Jul 06 02:11:43.673255 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:43.673230    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-656987b587-swmw6_979b8c55-fa28-4af8-ab4b-6942d7fa727a/manager/0.log"
Jul 06 02:11:45.548801 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:45.548766    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qhqmm_60d535b5-353a-41c8-ab1f-e1cb511cb9c1/registry-server/0.log"
Jul 06 02:11:45.664354 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:45.664322    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-bf2mp_747af27d-a14d-4e59-b91c-f6959109f99f/manager/0.log"
Jul 06 02:11:45.778501 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:45.778470    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-d49p8_12f8ffe8-9ae5-42c1-a7d0-a8bf2535d1be/limitador/0.log"
Jul 06 02:11:45.892507 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:45.892475    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gn692_4afa8d3a-6b8f-4efe-ad95-c4ec785eccb9/manager/0.log"
Jul 06 02:11:46.968560 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:46.968485    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-t6tq5_d84c0f2c-d90d-484f-806e-1d6d3e542587/payload-processing/0.log"
Jul 06 02:11:47.562229 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:47.562197    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-vwmvp_bc8d8745-93d6-47ff-94c5-b89d7947b3f6/main/0.log"
Jul 06 02:11:51.960284 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:51.960244    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jdvmn/must-gather-58cwf"]
Jul 06 02:11:51.960832 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:51.960812    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63425ea3-3e97-4981-ad33-dbe30ba8d001" containerName="maas-api"
Jul 06 02:11:51.960914 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:51.960836    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="63425ea3-3e97-4981-ad33-dbe30ba8d001" containerName="maas-api"
Jul 06 02:11:51.960914 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:51.960856    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db" containerName="main"
Jul 06 02:11:51.960914 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:51.960865    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db" containerName="main"
Jul 06 02:11:51.960914 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:51.960877    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb394964-112e-4182-8935-279ddf64221b" containerName="maas-api"
Jul 06 02:11:51.960914 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:51.960886    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb394964-112e-4182-8935-279ddf64221b" containerName="maas-api"
Jul 06 02:11:51.961161 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:51.961002    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="63425ea3-3e97-4981-ad33-dbe30ba8d001" containerName="maas-api"
Jul 06 02:11:51.961161 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:51.961018    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="fde8d2fc-fdfb-4e6f-9ea5-553b779cc6db" containerName="main"
Jul 06 02:11:51.961161 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:51.961028    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb394964-112e-4182-8935-279ddf64221b" containerName="maas-api"
Jul 06 02:11:51.964343 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:51.964321    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jdvmn/must-gather-58cwf"
Jul 06 02:11:51.966990 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:51.966962    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jdvmn\"/\"default-dockercfg-tg2sc\""
Jul 06 02:11:51.967111 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:51.966962    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jdvmn\"/\"kube-root-ca.crt\""
Jul 06 02:11:51.967111 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:51.966973    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jdvmn\"/\"openshift-service-ca.crt\""
Jul 06 02:11:51.972045 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:51.971883    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jdvmn/must-gather-58cwf"]
Jul 06 02:11:51.974292 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:51.974261    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7fjr\" (UniqueName: \"kubernetes.io/projected/3b7e725c-a7e3-4614-85f0-cddfaf9f5bea-kube-api-access-g7fjr\") pod \"must-gather-58cwf\" (UID: \"3b7e725c-a7e3-4614-85f0-cddfaf9f5bea\") " pod="openshift-must-gather-jdvmn/must-gather-58cwf"
Jul 06 02:11:51.974400 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:51.974361    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3b7e725c-a7e3-4614-85f0-cddfaf9f5bea-must-gather-output\") pod \"must-gather-58cwf\" (UID: \"3b7e725c-a7e3-4614-85f0-cddfaf9f5bea\") " pod="openshift-must-gather-jdvmn/must-gather-58cwf"
Jul 06 02:11:52.074859 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:52.074812    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7fjr\" (UniqueName: \"kubernetes.io/projected/3b7e725c-a7e3-4614-85f0-cddfaf9f5bea-kube-api-access-g7fjr\") pod \"must-gather-58cwf\" (UID: \"3b7e725c-a7e3-4614-85f0-cddfaf9f5bea\") " pod="openshift-must-gather-jdvmn/must-gather-58cwf"
Jul 06 02:11:52.074859 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:52.074871    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3b7e725c-a7e3-4614-85f0-cddfaf9f5bea-must-gather-output\") pod \"must-gather-58cwf\" (UID: \"3b7e725c-a7e3-4614-85f0-cddfaf9f5bea\") " pod="openshift-must-gather-jdvmn/must-gather-58cwf"
Jul 06 02:11:52.075151 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:52.075137    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3b7e725c-a7e3-4614-85f0-cddfaf9f5bea-must-gather-output\") pod \"must-gather-58cwf\" (UID: \"3b7e725c-a7e3-4614-85f0-cddfaf9f5bea\") " pod="openshift-must-gather-jdvmn/must-gather-58cwf"
Jul 06 02:11:52.083611 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:52.083587    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7fjr\" (UniqueName: \"kubernetes.io/projected/3b7e725c-a7e3-4614-85f0-cddfaf9f5bea-kube-api-access-g7fjr\") pod \"must-gather-58cwf\" (UID: \"3b7e725c-a7e3-4614-85f0-cddfaf9f5bea\") " pod="openshift-must-gather-jdvmn/must-gather-58cwf"
Jul 06 02:11:52.274987 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:52.274896    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jdvmn/must-gather-58cwf"
Jul 06 02:11:52.420023 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:52.419999    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jdvmn/must-gather-58cwf"]
Jul 06 02:11:52.422091 ip-10-0-128-8 kubenswrapper[2584]: W0706 02:11:52.422061    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b7e725c_a7e3_4614_85f0_cddfaf9f5bea.slice/crio-9747cb7f59cee2dfcb0908b8411be0b7be576369a7f18302566d04f6c61eaf70 WatchSource:0}: Error finding container 9747cb7f59cee2dfcb0908b8411be0b7be576369a7f18302566d04f6c61eaf70: Status 404 returned error can't find the container with id 9747cb7f59cee2dfcb0908b8411be0b7be576369a7f18302566d04f6c61eaf70
Jul 06 02:11:52.424099 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:52.424083    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 02:11:52.683668 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:52.683596    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdvmn/must-gather-58cwf" event={"ID":"3b7e725c-a7e3-4614-85f0-cddfaf9f5bea","Type":"ContainerStarted","Data":"9747cb7f59cee2dfcb0908b8411be0b7be576369a7f18302566d04f6c61eaf70"}
Jul 06 02:11:53.692380 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:53.692345    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdvmn/must-gather-58cwf" event={"ID":"3b7e725c-a7e3-4614-85f0-cddfaf9f5bea","Type":"ContainerStarted","Data":"5c8a8393c5899d42bab3758a58c8d1eab197b6b88a5a65042e87a9b5f987a069"}
Jul 06 02:11:53.692877 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:53.692389    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdvmn/must-gather-58cwf" event={"ID":"3b7e725c-a7e3-4614-85f0-cddfaf9f5bea","Type":"ContainerStarted","Data":"25ef4423bd2daf3af2d7dc713cd570d3fac54abc1c42038ba091265340f2dd80"}
Jul 06 02:11:53.708219 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:53.708154    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jdvmn/must-gather-58cwf" podStartSLOduration=1.905100539 podStartE2EDuration="2.70813756s" totalImagesPullingTime="803.037021ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:11:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:11:53.706366629 +0000 UTC m=+2721.948134496" watchObservedRunningTime="2026-07-06 02:11:53.70813756 +0000 UTC m=+2721.949905468"
Jul 06 02:11:54.792072 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:54.792038    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tx6kv_1d0e1c2f-f2d9-4114-b29f-eae649ac05fc/global-pull-secret-syncer/0.log"
Jul 06 02:11:54.957345 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:54.957304    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wkxsp_3f407833-2077-45ce-85d9-dbb45b639be0/konnectivity-agent/0.log"
Jul 06 02:11:54.978537 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:11:54.978470    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-8.ec2.internal_a39d0d7260635ade2bf76fa6546e26a1/haproxy/0.log"
Jul 06 02:12:00.501652 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:00.501526    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qhqmm_60d535b5-353a-41c8-ab1f-e1cb511cb9c1/registry-server/0.log"
Jul 06 02:12:00.637224 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:00.637080    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-bf2mp_747af27d-a14d-4e59-b91c-f6959109f99f/manager/0.log"
Jul 06 02:12:00.659671 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:00.659610    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-d49p8_12f8ffe8-9ae5-42c1-a7d0-a8bf2535d1be/limitador/0.log"
Jul 06 02:12:00.746708 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:00.746680    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gn692_4afa8d3a-6b8f-4efe-ad95-c4ec785eccb9/manager/0.log"
Jul 06 02:12:02.633209 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:02.633171    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-98vmn_6e934bf1-908b-4a86-8147-c066b499862f/cluster-monitoring-operator/0.log"
Jul 06 02:12:02.727666 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:02.727564    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-667dc4fbfd-njv4v_e4b0b454-1a46-4e71-9b66-f375be6de58f/metrics-server/0.log"
Jul 06 02:12:02.761450 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:02.761396    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-zhlj8_64c1edb3-0fc3-4703-a2f1-a96d8485aefe/monitoring-plugin/0.log"
Jul 06 02:12:02.791728 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:02.791691    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hh9th_460b272d-f0f4-4589-b9e2-45ad3bc13f5d/node-exporter/0.log"
Jul 06 02:12:02.810667 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:02.810546    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hh9th_460b272d-f0f4-4589-b9e2-45ad3bc13f5d/kube-rbac-proxy/0.log"
Jul 06 02:12:02.830574 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:02.830549    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hh9th_460b272d-f0f4-4589-b9e2-45ad3bc13f5d/init-textfile/0.log"
Jul 06 02:12:03.100685 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:03.100657    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40294cf0-b627-4a90-80b6-0e37d1496b4c/prometheus/0.log"
Jul 06 02:12:03.119381 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:03.119348    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40294cf0-b627-4a90-80b6-0e37d1496b4c/config-reloader/0.log"
Jul 06 02:12:03.140009 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:03.139978    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40294cf0-b627-4a90-80b6-0e37d1496b4c/thanos-sidecar/0.log"
Jul 06 02:12:03.164122 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:03.164094    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40294cf0-b627-4a90-80b6-0e37d1496b4c/kube-rbac-proxy-web/0.log"
Jul 06 02:12:03.184582 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:03.184548    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40294cf0-b627-4a90-80b6-0e37d1496b4c/kube-rbac-proxy/0.log"
Jul 06 02:12:03.204271 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:03.204241    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40294cf0-b627-4a90-80b6-0e37d1496b4c/kube-rbac-proxy-thanos/0.log"
Jul 06 02:12:03.222906 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:03.222875    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40294cf0-b627-4a90-80b6-0e37d1496b4c/init-config-reloader/0.log"
Jul 06 02:12:03.249148 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:03.249118    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-fw866_1174c84d-15b7-4016-9d0f-9b76fc428049/prometheus-operator/0.log"
Jul 06 02:12:03.266223 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:03.266193    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-fw866_1174c84d-15b7-4016-9d0f-9b76fc428049/kube-rbac-proxy/0.log"
Jul 06 02:12:03.289965 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:03.289931    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-l7d4h_4474038e-cfb1-44e7-bb36-e1f9f1bd1ce0/prometheus-operator-admission-webhook/0.log"
Jul 06 02:12:04.748944 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:04.748902    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-pxfqq_066f3b60-6fb4-4d35-8fc8-9ed67cbd937d/networking-console-plugin/0.log"
Jul 06 02:12:05.618473 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:05.618413    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jdvmn/perf-node-gather-daemonset-t44sm"]
Jul 06 02:12:05.624563 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:05.624527    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jdvmn/perf-node-gather-daemonset-t44sm"
Jul 06 02:12:05.632110 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:05.632075    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jdvmn/perf-node-gather-daemonset-t44sm"]
Jul 06 02:12:05.736158 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:05.736118    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dacb9bb5-267c-4eb8-84d4-88029ad4f124-lib-modules\") pod \"perf-node-gather-daemonset-t44sm\" (UID: \"dacb9bb5-267c-4eb8-84d4-88029ad4f124\") " pod="openshift-must-gather-jdvmn/perf-node-gather-daemonset-t44sm"
Jul 06 02:12:05.736427 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:05.736406    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dacb9bb5-267c-4eb8-84d4-88029ad4f124-podres\") pod \"perf-node-gather-daemonset-t44sm\" (UID: \"dacb9bb5-267c-4eb8-84d4-88029ad4f124\") " pod="openshift-must-gather-jdvmn/perf-node-gather-daemonset-t44sm"
Jul 06 02:12:05.736570 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:05.736553    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cktrd\" (UniqueName: \"kubernetes.io/projected/dacb9bb5-267c-4eb8-84d4-88029ad4f124-kube-api-access-cktrd\") pod \"perf-node-gather-daemonset-t44sm\" (UID: \"dacb9bb5-267c-4eb8-84d4-88029ad4f124\") " pod="openshift-must-gather-jdvmn/perf-node-gather-daemonset-t44sm"
Jul 06 02:12:05.736710 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:05.736694    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dacb9bb5-267c-4eb8-84d4-88029ad4f124-proc\") pod \"perf-node-gather-daemonset-t44sm\" (UID: \"dacb9bb5-267c-4eb8-84d4-88029ad4f124\") " pod="openshift-must-gather-jdvmn/perf-node-gather-daemonset-t44sm"
Jul 06 02:12:05.736846 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:05.736834    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dacb9bb5-267c-4eb8-84d4-88029ad4f124-sys\") pod \"perf-node-gather-daemonset-t44sm\" (UID: \"dacb9bb5-267c-4eb8-84d4-88029ad4f124\") " pod="openshift-must-gather-jdvmn/perf-node-gather-daemonset-t44sm"
Jul 06 02:12:05.838290 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:05.838247    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dacb9bb5-267c-4eb8-84d4-88029ad4f124-lib-modules\") pod \"perf-node-gather-daemonset-t44sm\" (UID: \"dacb9bb5-267c-4eb8-84d4-88029ad4f124\") " pod="openshift-must-gather-jdvmn/perf-node-gather-daemonset-t44sm"
Jul 06 02:12:05.838808 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:05.838298    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dacb9bb5-267c-4eb8-84d4-88029ad4f124-podres\") pod \"perf-node-gather-daemonset-t44sm\" (UID: \"dacb9bb5-267c-4eb8-84d4-88029ad4f124\") " pod="openshift-must-gather-jdvmn/perf-node-gather-daemonset-t44sm"
Jul 06 02:12:05.838808 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:05.838342    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cktrd\" (UniqueName: \"kubernetes.io/projected/dacb9bb5-267c-4eb8-84d4-88029ad4f124-kube-api-access-cktrd\") pod \"perf-node-gather-daemonset-t44sm\" (UID: \"dacb9bb5-267c-4eb8-84d4-88029ad4f124\") " pod="openshift-must-gather-jdvmn/perf-node-gather-daemonset-t44sm"
Jul 06 02:12:05.838808 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:05.838373    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dacb9bb5-267c-4eb8-84d4-88029ad4f124-proc\") pod \"perf-node-gather-daemonset-t44sm\" (UID: \"dacb9bb5-267c-4eb8-84d4-88029ad4f124\") " pod="openshift-must-gather-jdvmn/perf-node-gather-daemonset-t44sm"
Jul 06 02:12:05.838808 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:05.838415    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dacb9bb5-267c-4eb8-84d4-88029ad4f124-sys\") pod \"perf-node-gather-daemonset-t44sm\" (UID: \"dacb9bb5-267c-4eb8-84d4-88029ad4f124\") " pod="openshift-must-gather-jdvmn/perf-node-gather-daemonset-t44sm"
Jul 06 02:12:05.838808 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:05.838530    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dacb9bb5-267c-4eb8-84d4-88029ad4f124-sys\") pod \"perf-node-gather-daemonset-t44sm\" (UID: \"dacb9bb5-267c-4eb8-84d4-88029ad4f124\") " pod="openshift-must-gather-jdvmn/perf-node-gather-daemonset-t44sm"
Jul 06 02:12:05.838808 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:05.838668    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dacb9bb5-267c-4eb8-84d4-88029ad4f124-lib-modules\") pod \"perf-node-gather-daemonset-t44sm\" (UID: \"dacb9bb5-267c-4eb8-84d4-88029ad4f124\") " pod="openshift-must-gather-jdvmn/perf-node-gather-daemonset-t44sm"
Jul 06 02:12:05.838808 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:05.838743    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dacb9bb5-267c-4eb8-84d4-88029ad4f124-podres\") pod \"perf-node-gather-daemonset-t44sm\" (UID: \"dacb9bb5-267c-4eb8-84d4-88029ad4f124\") " pod="openshift-must-gather-jdvmn/perf-node-gather-daemonset-t44sm"
Jul 06 02:12:05.839199 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:05.838874    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dacb9bb5-267c-4eb8-84d4-88029ad4f124-proc\") pod \"perf-node-gather-daemonset-t44sm\" (UID: \"dacb9bb5-267c-4eb8-84d4-88029ad4f124\") " pod="openshift-must-gather-jdvmn/perf-node-gather-daemonset-t44sm"
Jul 06 02:12:05.847384 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:05.847351    2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cktrd\" (UniqueName: \"kubernetes.io/projected/dacb9bb5-267c-4eb8-84d4-88029ad4f124-kube-api-access-cktrd\") pod \"perf-node-gather-daemonset-t44sm\" (UID: \"dacb9bb5-267c-4eb8-84d4-88029ad4f124\") " pod="openshift-must-gather-jdvmn/perf-node-gather-daemonset-t44sm"
Jul 06 02:12:05.944539 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:05.944431    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jdvmn/perf-node-gather-daemonset-t44sm"
Jul 06 02:12:06.136864 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:06.136709    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jdvmn/perf-node-gather-daemonset-t44sm"]
Jul 06 02:12:06.140847 ip-10-0-128-8 kubenswrapper[2584]: W0706 02:12:06.140806    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddacb9bb5_267c_4eb8_84d4_88029ad4f124.slice/crio-731f76713090cc5c8b5d207b6ed6103fb00db79ed35a61a72eea75cb50ab37ca WatchSource:0}: Error finding container 731f76713090cc5c8b5d207b6ed6103fb00db79ed35a61a72eea75cb50ab37ca: Status 404 returned error can't find the container with id 731f76713090cc5c8b5d207b6ed6103fb00db79ed35a61a72eea75cb50ab37ca
Jul 06 02:12:06.561567 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:06.561467    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-k54wm_a8c26804-a48d-467f-aece-eb93d957bcde/volume-data-source-validator/0.log"
Jul 06 02:12:06.812878 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:06.812780    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdvmn/perf-node-gather-daemonset-t44sm" event={"ID":"dacb9bb5-267c-4eb8-84d4-88029ad4f124","Type":"ContainerStarted","Data":"18969f9f067cde84355e4cebc677181b2c40541bc12c48db624b2f256eddcea0"}
Jul 06 02:12:06.812878 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:06.812852    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdvmn/perf-node-gather-daemonset-t44sm" event={"ID":"dacb9bb5-267c-4eb8-84d4-88029ad4f124","Type":"ContainerStarted","Data":"731f76713090cc5c8b5d207b6ed6103fb00db79ed35a61a72eea75cb50ab37ca"}
Jul 06 02:12:06.813207 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:06.813186    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jdvmn/perf-node-gather-daemonset-t44sm"
Jul 06 02:12:06.832135 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:06.832058    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jdvmn/perf-node-gather-daemonset-t44sm" podStartSLOduration=1.832033294 podStartE2EDuration="1.832033294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:12:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:12:06.828967972 +0000 UTC m=+2735.070735854" watchObservedRunningTime="2026-07-06 02:12:06.832033294 +0000 UTC m=+2735.073801162"
Jul 06 02:12:07.580495 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:07.580469    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8fc8h_a1f9d1bf-1910-4c4b-be53-9b51824e21c0/dns/0.log"
Jul 06 02:12:07.606132 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:07.606104    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8fc8h_a1f9d1bf-1910-4c4b-be53-9b51824e21c0/kube-rbac-proxy/0.log"
Jul 06 02:12:07.766397 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:07.766362    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zzmqr_a357dec8-e2fb-4fd2-bea2-5f16400a0aef/dns-node-resolver/0.log"
Jul 06 02:12:08.390839 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:08.390812    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bphvc_077f7485-8962-4195-b5a1-26f4e3b1c3e0/node-ca/0.log"
Jul 06 02:12:09.598207 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:09.598172    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-t6tq5_d84c0f2c-d90d-484f-806e-1d6d3e542587/payload-processing/0.log"
Jul 06 02:12:10.319454 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:10.319426    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n968n_f669e88b-69be-4f0d-91c4-afadc96a25b7/serve-healthcheck-canary/0.log"
Jul 06 02:12:10.961271 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:10.961225    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vt7b6_7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59/kube-rbac-proxy/0.log"
Jul 06 02:12:10.981167 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:10.981135    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vt7b6_7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59/exporter/0.log"
Jul 06 02:12:11.001165 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:11.001129    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vt7b6_7b8c86a2-9ffe-42b0-bcf3-0f062c0f6c59/extractor/0.log"
Jul 06 02:12:12.831827 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:12.831798    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jdvmn/perf-node-gather-daemonset-t44sm"
Jul 06 02:12:13.191663 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:13.191604    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-knc5n_e170b11b-fc61-4699-b458-df23029d6cd9/manager/0.log"
Jul 06 02:12:13.376257 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:13.376221    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29721705-mq97d_e1ab9594-fd24-48d0-951d-5f9e89eb01f3/cleanup/0.log"
Jul 06 02:12:13.833509 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:13.833462    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-656987b587-swmw6_979b8c55-fa28-4af8-ab4b-6942d7fa727a/manager/0.log"
Jul 06 02:12:13.851377 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:13.851339    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-656987b587-swmw6_979b8c55-fa28-4af8-ab4b-6942d7fa727a/copy-manifests/0.log"
Jul 06 02:12:15.364690 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:15.364620    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-577bbf7cf9-rgkbw_fa5bc261-545c-40c0-8e7c-ae4578ddeb44/manager/0.log"
Jul 06 02:12:15.425528 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:15.425427    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-hgbpr_5e7df46c-b62e-4dda-86d2-f78543840c65/openshift-lws-operator/0.log"
Jul 06 02:12:16.447493 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:16.447423    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-t6tq5_d84c0f2c-d90d-484f-806e-1d6d3e542587/payload-processing/0.log"
Jul 06 02:12:17.962022 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:17.961990    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-t6tq5_d84c0f2c-d90d-484f-806e-1d6d3e542587/payload-processing/0.log"
Jul 06 02:12:20.524669 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:20.524638    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-8xfzg_09d08232-f56e-4207-b158-eb2ee43beb03/migrator/0.log"
Jul 06 02:12:20.543091 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:20.543058    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-8xfzg_09d08232-f56e-4207-b158-eb2ee43beb03/graceful-termination/0.log"
Jul 06 02:12:20.935283 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:20.935247    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-nm48x_7a7e13be-4e2d-4ee6-838a-4507db79883a/kube-storage-version-migrator-operator/1.log"
Jul 06 02:12:20.936353 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:20.936325    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-nm48x_7a7e13be-4e2d-4ee6-838a-4507db79883a/kube-storage-version-migrator-operator/0.log"
Jul 06 02:12:21.903234 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:21.903204    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5gfv5_afe45663-750d-40c6-aae9-69a91e054d7f/kube-multus/0.log"
Jul 06 02:12:21.923368 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:21.923338    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qmzt_3f01121e-88d5-4f62-bae1-6957d6f8969a/kube-multus-additional-cni-plugins/0.log"
Jul 06 02:12:21.941373 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:21.941342    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qmzt_3f01121e-88d5-4f62-bae1-6957d6f8969a/egress-router-binary-copy/0.log"
Jul 06 02:12:21.961528 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:21.961496    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qmzt_3f01121e-88d5-4f62-bae1-6957d6f8969a/cni-plugins/0.log"
Jul 06 02:12:21.979229 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:21.979197    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qmzt_3f01121e-88d5-4f62-bae1-6957d6f8969a/bond-cni-plugin/0.log"
Jul 06 02:12:21.997987 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:21.997960    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qmzt_3f01121e-88d5-4f62-bae1-6957d6f8969a/routeoverride-cni/0.log"
Jul 06 02:12:22.016758 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:22.016718    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qmzt_3f01121e-88d5-4f62-bae1-6957d6f8969a/whereabouts-cni-bincopy/0.log"
Jul 06 02:12:22.035193 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:22.035168    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qmzt_3f01121e-88d5-4f62-bae1-6957d6f8969a/whereabouts-cni/0.log"
Jul 06 02:12:22.418543 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:22.418494    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7fkg2_d05d6ef9-2d73-4ab9-b875-7d121bd89c4d/network-metrics-daemon/0.log"
Jul 06 02:12:22.435767 ip-10-0-128-8 kubenswrapper[2584]: I0706 02:12:22.435736    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7fkg2_d05d6ef9-2d73-4ab9-b875-7d121bd89c4d/kube-rbac-proxy/0.log"