May 21 15:29:35.331285 ip-10-0-132-73 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 21 15:29:35.331298 ip-10-0-132-73 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 21 15:29:35.331305 ip-10-0-132-73 systemd[1]: kubelet.service: Failed with result 'resources'.
May 21 15:29:35.331556 ip-10-0-132-73 systemd[1]: Failed to start Kubernetes Kubelet.
May 21 15:29:45.409184 ip-10-0-132-73 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 21 15:29:45.409202 ip-10-0-132-73 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 4f3ab65b14ae4fd1a7368779f205e436 --
May 21 15:32:19.164563 ip-10-0-132-73 systemd[1]: Starting Kubernetes Kubelet...
May 21 15:32:19.593689 ip-10-0-132-73 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 15:32:19.593689 ip-10-0-132-73 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 21 15:32:19.593689 ip-10-0-132-73 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 15:32:19.593689 ip-10-0-132-73 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 21 15:32:19.593689 ip-10-0-132-73 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 15:32:19.596337 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.596224    2552 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 21 15:32:19.604063 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604036    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 15:32:19.604063 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604056    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 15:32:19.604063 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604060    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 15:32:19.604063 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604063    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 15:32:19.604063 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604066    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 15:32:19.604063 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604069    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 15:32:19.604063 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604072    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 15:32:19.604063 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604075    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 15:32:19.604359 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604078    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 15:32:19.604359 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604081    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 15:32:19.604359 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604084    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 15:32:19.604359 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604088    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 15:32:19.604359 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604092    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 15:32:19.604359 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604095    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 15:32:19.604359 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604097    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 15:32:19.604359 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604100    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 15:32:19.604359 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604103    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 15:32:19.604359 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604106    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 15:32:19.604359 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604108    2552 feature_gate.go:328] unrecognized feature gate: Example2
May 21 15:32:19.604359 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604111    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 15:32:19.604359 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604113    2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 15:32:19.604359 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604116    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 15:32:19.604359 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604118    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 15:32:19.604359 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604122    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 15:32:19.604359 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604126    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 15:32:19.604359 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604129    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 15:32:19.604359 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604132    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 15:32:19.604813 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604136    2552 feature_gate.go:328] unrecognized feature gate: Example
May 21 15:32:19.604813 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604139    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 15:32:19.604813 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604145    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 15:32:19.604813 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604148    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 15:32:19.604813 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604150    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 15:32:19.604813 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604153    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 15:32:19.604813 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604156    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 15:32:19.604813 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604158    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 15:32:19.604813 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604161    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 15:32:19.604813 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604163    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 15:32:19.604813 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604166    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 15:32:19.604813 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604168    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 15:32:19.604813 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604171    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 15:32:19.604813 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604179    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 15:32:19.604813 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604183    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 15:32:19.604813 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604187    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 15:32:19.604813 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604190    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 15:32:19.604813 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604192    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 15:32:19.604813 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604195    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 15:32:19.604813 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604197    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 15:32:19.605339 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604200    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 15:32:19.605339 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604202    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 15:32:19.605339 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604205    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 15:32:19.605339 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604208    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 15:32:19.605339 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604210    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 15:32:19.605339 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604212    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 15:32:19.605339 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604215    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 15:32:19.605339 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604217    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 15:32:19.605339 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604220    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 15:32:19.605339 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604223    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 15:32:19.605339 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604226    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 15:32:19.605339 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604228    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 15:32:19.605339 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604231    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 15:32:19.605339 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604234    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 15:32:19.605339 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604236    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 15:32:19.605339 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604239    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 15:32:19.605339 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604242    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 15:32:19.605339 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604244    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 15:32:19.605339 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604247    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 15:32:19.605339 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604250    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 15:32:19.605819 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604252    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 15:32:19.605819 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604255    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 15:32:19.605819 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604271    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 15:32:19.605819 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604274    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 15:32:19.605819 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604277    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 15:32:19.605819 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604279    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 15:32:19.605819 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604282    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 15:32:19.605819 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604285    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 15:32:19.605819 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604288    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 15:32:19.605819 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604290    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 15:32:19.605819 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604293    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 15:32:19.605819 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604297    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 15:32:19.605819 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604300    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 15:32:19.605819 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604302    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 15:32:19.605819 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604305    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 15:32:19.605819 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604307    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 15:32:19.605819 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604310    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 15:32:19.605819 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604313    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 15:32:19.605819 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604315    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 15:32:19.605819 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604714    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 15:32:19.606315 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604720    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 15:32:19.606315 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604723    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 15:32:19.606315 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604726    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 15:32:19.606315 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604730    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 15:32:19.606315 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604733    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 15:32:19.606315 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604736    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 15:32:19.606315 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604738    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 15:32:19.606315 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604741    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 15:32:19.606315 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604744    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 15:32:19.606315 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604747    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 15:32:19.606315 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604750    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 15:32:19.606315 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604752    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 15:32:19.606315 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604756    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 15:32:19.606315 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604759    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 15:32:19.606315 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604761    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 15:32:19.606315 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604764    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 15:32:19.606315 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604767    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 15:32:19.606315 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604769    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 15:32:19.606315 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604773    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 15:32:19.606775 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604775    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 15:32:19.606775 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604778    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 15:32:19.606775 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604781    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 15:32:19.606775 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604784    2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 15:32:19.606775 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604789    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 15:32:19.606775 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604811    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 15:32:19.606775 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604816    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 15:32:19.606775 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604819    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 15:32:19.606775 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604822    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 15:32:19.606775 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604825    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 15:32:19.606775 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604828    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 15:32:19.606775 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604831    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 15:32:19.606775 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604833    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 15:32:19.606775 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604837    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 15:32:19.606775 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604840    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 15:32:19.606775 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604842    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 15:32:19.606775 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604845    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 15:32:19.606775 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604848    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 15:32:19.606775 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604851    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 15:32:19.606775 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604853    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 15:32:19.607280 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604856    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 15:32:19.607280 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604859    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 15:32:19.607280 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604861    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 15:32:19.607280 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604864    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 15:32:19.607280 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604867    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 15:32:19.607280 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604870    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 15:32:19.607280 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604872    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 15:32:19.607280 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604875    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 15:32:19.607280 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604877    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 15:32:19.607280 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604880    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 15:32:19.607280 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604882    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 15:32:19.607280 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604885    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 15:32:19.607280 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604888    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 15:32:19.607280 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604890    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 15:32:19.607280 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604893    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 15:32:19.607280 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604895    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 15:32:19.607280 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604898    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 15:32:19.607280 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604901    2552 feature_gate.go:328] unrecognized feature gate: Example
May 21 15:32:19.607280 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604903    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 15:32:19.607280 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604906    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 15:32:19.607762 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604908    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 15:32:19.607762 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604911    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 15:32:19.607762 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604914    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 15:32:19.607762 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604916    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 15:32:19.607762 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604919    2552 feature_gate.go:328] unrecognized feature gate: Example2
May 21 15:32:19.607762 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604921    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 15:32:19.607762 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604924    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 15:32:19.607762 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604926    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 15:32:19.607762 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604929    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 15:32:19.607762 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604931    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 15:32:19.607762 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604934    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 15:32:19.607762 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604936    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 15:32:19.607762 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604938    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 15:32:19.607762 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604941    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 15:32:19.607762 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604944    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 15:32:19.607762 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604946    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 15:32:19.607762 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604950    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 15:32:19.607762 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604954    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 15:32:19.607762 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604956    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 15:32:19.607762 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604959    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 15:32:19.608341 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604961    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 15:32:19.608341 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604964    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 15:32:19.608341 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604967    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 15:32:19.608341 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604971    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 15:32:19.608341 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604974    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 15:32:19.608341 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.604977    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 15:32:19.608341 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606048    2552 flags.go:64] FLAG: --address="0.0.0.0"
May 21 15:32:19.608341 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606058    2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 21 15:32:19.608341 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606066    2552 flags.go:64] FLAG: --anonymous-auth="true"
May 21 15:32:19.608341 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606070    2552 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 21 15:32:19.608341 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606076    2552 flags.go:64] FLAG: --authentication-token-webhook="false"
May 21 15:32:19.608341 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606079    2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 21 15:32:19.608341 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606083    2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 21 15:32:19.608341 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606088    2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 21 15:32:19.608341 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606091    2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 21 15:32:19.608341 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606094    2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 21 15:32:19.608341 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606098    2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 21 15:32:19.608341 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606101    2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 21 15:32:19.608341 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606104    2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 21 15:32:19.608341 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606107    2552 flags.go:64] FLAG: --cgroup-root=""
May 21 15:32:19.608341 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606110    2552 flags.go:64] FLAG: --cgroups-per-qos="true"
May 21 15:32:19.608341 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606113    2552 flags.go:64] FLAG: --client-ca-file=""
May 21 15:32:19.608902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606116    2552 flags.go:64] FLAG: --cloud-config=""
May 21 15:32:19.608902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606119    2552 flags.go:64] FLAG: --cloud-provider="external"
May 21 15:32:19.608902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606122    2552 flags.go:64] FLAG: --cluster-dns="[]"
May 21 15:32:19.608902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606127    2552 flags.go:64] FLAG: --cluster-domain=""
May 21 15:32:19.608902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606129    2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 21 15:32:19.608902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606133    2552 flags.go:64] FLAG: --config-dir=""
May 21 15:32:19.608902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606136    2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 21 15:32:19.608902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606140    2552 flags.go:64] FLAG: --container-log-max-files="5"
May 21 15:32:19.608902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606144    2552 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 21 15:32:19.608902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606147    2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 21 15:32:19.608902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606151    2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 21 15:32:19.608902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606154    2552 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 21 15:32:19.608902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606157    2552 flags.go:64] FLAG: --contention-profiling="false"
May 21 15:32:19.608902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606160    2552 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 21 15:32:19.608902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606163    2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 21 15:32:19.608902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606166    2552 flags.go:64] FLAG: --cpu-manager-policy="none"
May 21 15:32:19.608902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606169    2552 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 21 15:32:19.608902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606174    2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 21 15:32:19.608902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606177    2552 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 21 15:32:19.608902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606180    2552 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 21 15:32:19.608902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606183    2552 flags.go:64] FLAG: --enable-load-reader="false"
May 21 15:32:19.608902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606186    2552 flags.go:64] FLAG: --enable-server="true"
May 21 15:32:19.608902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606190    2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 21 15:32:19.608902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606195    2552 flags.go:64] FLAG: --event-burst="100"
May 21 15:32:19.608902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606198    2552 flags.go:64] FLAG: --event-qps="50"
May 21 15:32:19.609524 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606201    2552 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 21 15:32:19.609524 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606204    2552 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 21 15:32:19.609524 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606208    2552 flags.go:64] FLAG: --eviction-hard=""
May 21 15:32:19.609524 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606211    2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 21 15:32:19.609524 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606214    2552 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 21 15:32:19.609524 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606217    2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 21 15:32:19.609524 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606220    2552 flags.go:64] FLAG: --eviction-soft=""
May 21 15:32:19.609524 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606223    2552 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 21 15:32:19.609524 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606226    2552 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 21 15:32:19.609524 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606229    2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 21 15:32:19.609524 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606232    2552 flags.go:64] FLAG: --experimental-mounter-path=""
May 21 15:32:19.609524 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606235    2552 flags.go:64] FLAG: --fail-cgroupv1="false"
May 21 15:32:19.609524 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606238    2552 flags.go:64] FLAG: --fail-swap-on="true"
May 21 15:32:19.609524 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606241    2552 flags.go:64] FLAG: --feature-gates=""
May 21 15:32:19.609524 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606246    2552 flags.go:64] FLAG: --file-check-frequency="20s"
May 21 15:32:19.609524 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606249    2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 21 15:32:19.609524 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606253    2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 21 15:32:19.609524 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606269    2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 21 15:32:19.609524 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606273    2552 flags.go:64] FLAG: --healthz-port="10248"
May 21 15:32:19.609524 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606276    2552 flags.go:64] FLAG: --help="false"
May 21 15:32:19.609524 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606279    2552 flags.go:64] FLAG: --hostname-override="ip-10-0-132-73.ec2.internal"
May 21 15:32:19.609524 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606283    2552 flags.go:64] FLAG: --housekeeping-interval="10s"
May 21 15:32:19.609524 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606285    2552 flags.go:64] FLAG: --http-check-frequency="20s"
May 21 15:32:19.609524 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606289    2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 21 15:32:19.610126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606292    2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 21 15:32:19.610126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606296    2552 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 21 15:32:19.610126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606299    2552 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 21 15:32:19.610126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606301    2552 flags.go:64] FLAG: --image-service-endpoint=""
May 21 15:32:19.610126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606304    2552 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 21 15:32:19.610126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606308    2552 flags.go:64] FLAG: --kube-api-burst="100"
May 21 15:32:19.610126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606311    2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 21 15:32:19.610126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606314    2552 flags.go:64] FLAG: --kube-api-qps="50"
May 21 15:32:19.610126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606317    2552 flags.go:64] FLAG: --kube-reserved=""
May 21 15:32:19.610126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606320    2552 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 21 15:32:19.610126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606323    2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 21 15:32:19.610126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606326    2552 flags.go:64] FLAG: --kubelet-cgroups=""
May 21 15:32:19.610126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606330    2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 21 15:32:19.610126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606332    2552 flags.go:64] FLAG: --lock-file=""
May 21 15:32:19.610126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606335    2552 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 21 15:32:19.610126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606338    2552 flags.go:64] FLAG: --log-flush-frequency="5s"
May 21 15:32:19.610126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606342    2552 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 21 15:32:19.610126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606347    2552 flags.go:64] FLAG: --log-json-split-stream="false"
May 21 15:32:19.610126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606350    2552 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 21 15:32:19.610126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606353    2552 flags.go:64] FLAG: --log-text-split-stream="false"
May 21 15:32:19.610126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606356    2552 flags.go:64] FLAG: --logging-format="text"
May 21 15:32:19.610126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606359    2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 21 15:32:19.610126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606363    2552 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 21 15:32:19.610126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606366    2552 flags.go:64] FLAG: --manifest-url=""
May 21 15:32:19.610716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606369    2552 flags.go:64] FLAG: --manifest-url-header=""
May 21 15:32:19.610716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606373    2552 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 21 15:32:19.610716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606377    2552 flags.go:64] FLAG: --max-open-files="1000000"
May 21 15:32:19.610716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606381    2552 flags.go:64] FLAG: --max-pods="110"
May 21 15:32:19.610716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606384    2552 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 21 15:32:19.610716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606387    2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 21 15:32:19.610716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606390    2552 flags.go:64] FLAG: --memory-manager-policy="None"
May 21 15:32:19.610716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606393    2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 21 15:32:19.610716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606396    2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 21 15:32:19.610716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606398    2552 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 21 15:32:19.610716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606401    2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 21 15:32:19.610716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606409    2552 flags.go:64] FLAG: --node-status-max-images="50"
May 21 15:32:19.610716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606412    2552 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 21 15:32:19.610716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606415    2552 flags.go:64] FLAG: --oom-score-adj="-999"
May 21 15:32:19.610716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606420    2552 flags.go:64] FLAG: --pod-cidr=""
May 21 15:32:19.610716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606423    2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 21 15:32:19.610716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606429    2552 flags.go:64] FLAG: --pod-manifest-path=""
May 21 15:32:19.610716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606432    2552 flags.go:64] FLAG: --pod-max-pids="-1"
May 21 15:32:19.610716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606435    2552 flags.go:64] FLAG: --pods-per-core="0"
May 21 15:32:19.610716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606438    2552 flags.go:64] FLAG: --port="10250"
May 21 15:32:19.610716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606442    2552 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 21 15:32:19.610716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606444    2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09f72af6d5bb12af5"
May 21 15:32:19.610716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606448    2552 flags.go:64] FLAG: --qos-reserved=""
May 21 15:32:19.610716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606451    2552 flags.go:64] FLAG: --read-only-port="10255"
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606455    2552 flags.go:64] FLAG: --register-node="true"
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606458    2552 flags.go:64] FLAG: --register-schedulable="true"
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606460    2552 flags.go:64] FLAG: --register-with-taints=""
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606464    2552 flags.go:64] FLAG: --registry-burst="10"
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606467    2552 flags.go:64] FLAG: --registry-qps="5"
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606470    2552 flags.go:64] FLAG: --reserved-cpus=""
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606473    2552 flags.go:64] FLAG: --reserved-memory=""
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606481    2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606484    2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606487    2552 flags.go:64] FLAG: --rotate-certificates="false"
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606490    2552 flags.go:64] FLAG: --rotate-server-certificates="false"
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606493    2552 flags.go:64] FLAG: --runonce="false"
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606496    2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606499    2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606502    2552 flags.go:64] FLAG: --seccomp-default="false"
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606505    2552 flags.go:64] FLAG: --serialize-image-pulls="true"
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606508    2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606511    2552 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606514    2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606517    2552 flags.go:64] FLAG: --storage-driver-password="root"
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606520    2552 flags.go:64] FLAG: --storage-driver-secure="false"
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606523    2552 flags.go:64] FLAG: --storage-driver-table="stats"
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606526    2552 flags.go:64] FLAG: --storage-driver-user="root"
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606533    2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606537    2552 flags.go:64] FLAG: --sync-frequency="1m0s"
May 21 15:32:19.611301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606540    2552 flags.go:64] FLAG: --system-cgroups=""
May 21 15:32:19.611966 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606543    2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 21 15:32:19.611966 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606548    2552 flags.go:64] FLAG: --system-reserved-cgroup=""
May 21 15:32:19.611966 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606551    2552 flags.go:64] FLAG: --tls-cert-file=""
May 21 15:32:19.611966 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606554    2552 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 21 15:32:19.611966 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606558    2552 flags.go:64] FLAG: --tls-min-version=""
May 21 15:32:19.611966 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606561    2552 flags.go:64] FLAG: --tls-private-key-file=""
May 21 15:32:19.611966 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606564    2552 flags.go:64] FLAG: --topology-manager-policy="none"
May 21 15:32:19.611966 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606567    2552 flags.go:64] FLAG: --topology-manager-policy-options=""
May 21 15:32:19.611966 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606570    2552 flags.go:64] FLAG: --topology-manager-scope="container"
May 21 15:32:19.611966 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606573    2552 flags.go:64] FLAG: --v="2"
May 21 15:32:19.611966 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606577    2552 flags.go:64] FLAG: --version="false"
May 21 15:32:19.611966 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606581    2552 flags.go:64] FLAG: --vmodule=""
May 21 15:32:19.611966 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606586    2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 21 15:32:19.611966 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.606590    2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 21 15:32:19.611966 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606704    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 15:32:19.611966 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606708    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 15:32:19.611966 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606711    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 15:32:19.611966 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606714    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 15:32:19.611966 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606717    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 15:32:19.611966 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606720    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 15:32:19.611966 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606723    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 15:32:19.611966 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606726    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 15:32:19.611966 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606729    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 15:32:19.612547 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606732    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 15:32:19.612547 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606735    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 15:32:19.612547 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606737    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 15:32:19.612547 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606740    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 15:32:19.612547 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606742    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 15:32:19.612547 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606745    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 15:32:19.612547 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606748    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 15:32:19.612547 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606751    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 15:32:19.612547 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606754    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 15:32:19.612547 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606758    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 15:32:19.612547 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606761    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 15:32:19.612547 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606764    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 15:32:19.612547 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606767    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 15:32:19.612547 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606770    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 15:32:19.612547 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606773    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 15:32:19.612547 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606776    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 15:32:19.612547 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606779    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 15:32:19.612547 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606782    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 15:32:19.612547 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606784    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 15:32:19.613078 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606787    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 15:32:19.613078 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606790    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 15:32:19.613078 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606793    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 15:32:19.613078 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606797    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 15:32:19.613078 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606800    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 15:32:19.613078 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606803    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 15:32:19.613078 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606806    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 15:32:19.613078 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606808    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 15:32:19.613078 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606811    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 15:32:19.613078 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606815    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 15:32:19.613078 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606818    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 15:32:19.613078 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606821    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 15:32:19.613078 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606824    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 15:32:19.613078 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606827    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 15:32:19.613078 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606829    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 15:32:19.613078 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606832    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 15:32:19.613078 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606835    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 15:32:19.613078 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606837    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 15:32:19.613078 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606840    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 15:32:19.613078 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606842    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 15:32:19.613592 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606846    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 15:32:19.613592 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606849    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 15:32:19.613592 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606851    2552 feature_gate.go:328] unrecognized feature gate: Example
May 21 15:32:19.613592 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606854    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 15:32:19.613592 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606856    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 15:32:19.613592 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606859    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 15:32:19.613592 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606861    2552 feature_gate.go:328] unrecognized feature gate: Example2
May 21 15:32:19.613592 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606864    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 15:32:19.613592 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606866    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 15:32:19.613592 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606869    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 15:32:19.613592 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606872    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 15:32:19.613592 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606874    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 15:32:19.613592 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606877    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 15:32:19.613592 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606879    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 15:32:19.613592 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606882    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 15:32:19.613592 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606885    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 15:32:19.613592 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606893    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 15:32:19.613592 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606895    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 15:32:19.613592 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606898    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 15:32:19.613592 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606901    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 15:32:19.614083 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606904    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 15:32:19.614083 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606906    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 15:32:19.614083 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606909    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 15:32:19.614083 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606912    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 15:32:19.614083 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606914    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 15:32:19.614083 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606917    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 15:32:19.614083 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606920    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 15:32:19.614083 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606922    2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 15:32:19.614083 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606924    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 15:32:19.614083 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606927    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 15:32:19.614083 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606930    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 15:32:19.614083 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606932    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 15:32:19.614083 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606935    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 15:32:19.614083 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606937    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 15:32:19.614083 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606940    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 15:32:19.614083 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606943    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 15:32:19.614083 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606946    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 15:32:19.614083 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.606948    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 15:32:19.614527 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.607533    2552 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 15:32:19.615209 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.615191    2552 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 21 15:32:19.615242 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.615211    2552 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 21 15:32:19.615324 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615274    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 15:32:19.615324 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615280    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 15:32:19.615324 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615283    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 15:32:19.615324 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615286    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 15:32:19.615324 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615289    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 15:32:19.615324 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615292    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 15:32:19.615324 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615295    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 15:32:19.615324 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615298    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 15:32:19.615324 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615301    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 15:32:19.615324 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615303    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 15:32:19.615324 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615306    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 15:32:19.615324 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615309    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 15:32:19.615324 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615311    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 15:32:19.615324 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615314    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 15:32:19.615324 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615317    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 15:32:19.615324 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615319    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 15:32:19.615324 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615322    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 15:32:19.615324 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615325    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 15:32:19.615324 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615329    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 15:32:19.615823 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615337    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 15:32:19.615823 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615340    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 15:32:19.615823 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615344    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 15:32:19.615823 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615347    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 15:32:19.615823 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615350    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 15:32:19.615823 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615353    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 15:32:19.615823 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615355    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 15:32:19.615823 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615358    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 15:32:19.615823 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615361    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 15:32:19.615823 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615363    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 15:32:19.615823 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615366    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 15:32:19.615823 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615368    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 15:32:19.615823 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615371    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 15:32:19.615823 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615374    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 15:32:19.615823 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615377    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 15:32:19.615823 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615379    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 15:32:19.615823 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615382    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 15:32:19.615823 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615384    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 15:32:19.615823 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615387    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 15:32:19.616306 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615389    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 15:32:19.616306 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615392    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 15:32:19.616306 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615395    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 15:32:19.616306 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615399    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 15:32:19.616306 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615402    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 15:32:19.616306 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615405    2552 feature_gate.go:328] unrecognized feature gate: Example2
May 21 15:32:19.616306 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615407    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 15:32:19.616306 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615410    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 15:32:19.616306 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615412    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 15:32:19.616306 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615415    2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 15:32:19.616306 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615417    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 15:32:19.616306 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615420    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 15:32:19.616306 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615423    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 15:32:19.616306 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615426    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 15:32:19.616306 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615429    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 15:32:19.616306 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615433    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 15:32:19.616306 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615435    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 15:32:19.616306 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615438    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 15:32:19.616306 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615441    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 15:32:19.616778 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615444    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 15:32:19.616778 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615446    2552 feature_gate.go:328] unrecognized feature gate: Example
May 21 15:32:19.616778 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615449    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 15:32:19.616778 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615452    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 15:32:19.616778 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615454    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 15:32:19.616778 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615457    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 15:32:19.616778 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615459    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 15:32:19.616778 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615462    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 15:32:19.616778 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615465    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 15:32:19.616778 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615468    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 15:32:19.616778 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615470    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 15:32:19.616778 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615473    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 15:32:19.616778 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615475    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 15:32:19.616778 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615478    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 15:32:19.616778 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615480    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 15:32:19.616778 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615483    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 15:32:19.616778 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615485    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 15:32:19.616778 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615488    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 15:32:19.616778 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615490    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 15:32:19.616778 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615493    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 15:32:19.617276 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615495    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 15:32:19.617276 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615498    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 15:32:19.617276 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615500    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 15:32:19.617276 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615503    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 15:32:19.617276 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615505    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 15:32:19.617276 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615508    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 15:32:19.617276 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615511    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 15:32:19.617276 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615514    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 15:32:19.617276 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615517    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 15:32:19.617276 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.615522    2552 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 15:32:19.617276 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615643    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 15:32:19.617276 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615649    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 15:32:19.617276 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615651    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 15:32:19.617276 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615654    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 15:32:19.617276 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615657    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 15:32:19.617276 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615659    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 15:32:19.617672 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615662    2552 feature_gate.go:328] unrecognized feature gate: Example2
May 21 15:32:19.617672 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615665    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 15:32:19.617672 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615668    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 15:32:19.617672 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615670    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 15:32:19.617672 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615673    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 15:32:19.617672 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615676    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 15:32:19.617672 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615679    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 15:32:19.617672 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615681    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 15:32:19.617672 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615684    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 15:32:19.617672 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615686    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 15:32:19.617672 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615689    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 15:32:19.617672 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615692    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 15:32:19.617672 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615694    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 15:32:19.617672 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615697    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 15:32:19.617672 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615699    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 15:32:19.617672 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615702    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 15:32:19.617672 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615705    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 15:32:19.617672 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615707    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 15:32:19.617672 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615710    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 15:32:19.617672 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615712    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 15:32:19.618165 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615715    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 15:32:19.618165 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615717    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 15:32:19.618165 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615720    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 15:32:19.618165 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615723    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 15:32:19.618165 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615726    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 15:32:19.618165 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615729    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 15:32:19.618165 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615732    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 15:32:19.618165 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615736    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 15:32:19.618165 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615740    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 15:32:19.618165 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615743    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 15:32:19.618165 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615747    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 15:32:19.618165 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615749    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 15:32:19.618165 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615752    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 15:32:19.618165 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615755    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 15:32:19.618165 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615757    2552 feature_gate.go:328] unrecognized feature gate: Example
May 21 15:32:19.618165 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615760    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 15:32:19.618165 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615762    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 15:32:19.618165 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615765    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 15:32:19.618165 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615768    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 15:32:19.618165 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615771    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 15:32:19.618662 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615773    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 15:32:19.618662 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615776    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 15:32:19.618662 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615778    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 15:32:19.618662 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615781    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 15:32:19.618662 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615783    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 15:32:19.618662 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615786    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 15:32:19.618662 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615788    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 15:32:19.618662 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615791    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 15:32:19.618662 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615794    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 15:32:19.618662 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615796    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 15:32:19.618662 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615799    2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 15:32:19.618662 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615801    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 15:32:19.618662 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615804    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 15:32:19.618662 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615806    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 15:32:19.618662 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615808    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 15:32:19.618662 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615812    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 15:32:19.618662 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615815    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 15:32:19.618662 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615817    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 15:32:19.618662 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615820    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 15:32:19.618662 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615823    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 15:32:19.619146 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615825    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 15:32:19.619146 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615828    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 15:32:19.619146 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615832    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 15:32:19.619146 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615835    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 15:32:19.619146 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615838    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 15:32:19.619146 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615840    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 15:32:19.619146 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615843    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 15:32:19.619146 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615846    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 15:32:19.619146 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615848    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 15:32:19.619146 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615851    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 15:32:19.619146 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615854    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 15:32:19.619146 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615857    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 15:32:19.619146 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615859    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 15:32:19.619146 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615862    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 15:32:19.619146 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615864    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 15:32:19.619146 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615867    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 15:32:19.619146 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615869    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 15:32:19.619146 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615872    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 15:32:19.619146 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615875    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 15:32:19.619726 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:19.615877    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 15:32:19.619726 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.615882    2552 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 15:32:19.619726 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.616566    2552 server.go:962] "Client rotation is on, will bootstrap in background"
May 21 15:32:19.619726 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.619244    2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 21 15:32:19.620269 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.620246    2552 server.go:1019] "Starting client certificate rotation"
May 21 15:32:19.620383 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.620366    2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 15:32:19.620441 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.620420    2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 15:32:19.644589 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.644566    2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 15:32:19.649974 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.649954    2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 15:32:19.663272 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.663238    2552 log.go:25] "Validated CRI v1 runtime API"
May 21 15:32:19.668053 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.668038    2552 log.go:25] "Validated CRI v1 image API"
May 21 15:32:19.669676 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.669657    2552 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 21 15:32:19.674376 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.674358    2552 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 15:32:19.675903 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.675878    2552 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8951b8c8-71c6-4622-80d8-9384e9595d87:/dev/nvme0n1p3 c1378a35-64e9-41a8-9b49-4ac3249779de:/dev/nvme0n1p4]
May 21 15:32:19.675955 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.675903    2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 21 15:32:19.680351 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.680221    2552 manager.go:217] Machine: {Timestamp:2026-05-21 15:32:19.679727823 +0000 UTC m=+0.399890352 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3107107 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bf94ece7409f83b1825904a3ce5a3 SystemUUID:ec2bf94e-ce74-09f8-3b18-25904a3ce5a3 BootID:4f3ab65b-14ae-4fd1-a736-8779f205e436 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:22:4f:03:32:95 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:22:4f:03:32:95 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:b5:02:1b:05:50 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 21 15:32:19.680351 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.680350    2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 21 15:32:19.680459 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.680444    2552 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 21 15:32:19.682042 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.682014    2552 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 21 15:32:19.682180 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.682043    2552 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-73.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 21 15:32:19.682221 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.682193    2552 topology_manager.go:138] "Creating topology manager with none policy"
May 21 15:32:19.682221 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.682202    2552 container_manager_linux.go:306] "Creating device plugin manager"
May 21 15:32:19.682221 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.682211    2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 15:32:19.682785 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.682774    2552 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 15:32:19.684274 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.684253    2552 state_mem.go:36] "Initialized new in-memory state store"
May 21 15:32:19.684381 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.684373    2552 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 21 15:32:19.686561 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.686550    2552 kubelet.go:491] "Attempting to sync node with API server"
May 21 15:32:19.686593 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.686567    2552 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 21 15:32:19.686593 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.686581    2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 21 15:32:19.686593 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.686592    2552 kubelet.go:397] "Adding apiserver pod source"
May 21 15:32:19.686684 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.686608    2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 21 15:32:19.687679 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.687665    2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 15:32:19.687732 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.687686    2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 15:32:19.690583 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.690567    2552 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 21 15:32:19.692271 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.692244    2552 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 21 15:32:19.693012 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.692999    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 21 15:32:19.693058 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.693017    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 21 15:32:19.693058 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.693024    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 21 15:32:19.693058 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.693029    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 21 15:32:19.693058 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.693038    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 21 15:32:19.693058 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.693055    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 21 15:32:19.693183 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.693061    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 21 15:32:19.693183 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.693067    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 21 15:32:19.693183 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.693075    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 21 15:32:19.693183 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.693081    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 21 15:32:19.693183 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.693094    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 21 15:32:19.693335 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.693288    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 21 15:32:19.694187 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.694177    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 21 15:32:19.694187 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.694186    2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 21 15:32:19.697468 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.697452    2552 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 21 15:32:19.697553 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.697490    2552 server.go:1295] "Started kubelet"
May 21 15:32:19.697619 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.697574    2552 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 21 15:32:19.697678 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.697638    2552 server_v1.go:47] "podresources" method="list" useActivePods=true
May 21 15:32:19.697739 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:19.697716    2552 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 21 15:32:19.697820 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:19.697790    2552 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 21 15:32:19.697918 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.697905    2552 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-73.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 21 15:32:19.698413 ip-10-0-132-73 systemd[1]: Started Kubernetes Kubelet.
May 21 15:32:19.699056 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.698591    2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 21 15:32:19.699056 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.698719    2552 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 21 15:32:19.701555 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.701535    2552 server.go:317] "Adding debug handlers to kubelet server"
May 21 15:32:19.704519 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.704493    2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 21 15:32:19.704893 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.704873    2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 21 15:32:19.707452 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.707290    2552 volume_manager.go:295] "The desired_state_of_world populator starts"
May 21 15:32:19.707452 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.707455    2552 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 21 15:32:19.707583 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:19.707539    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
May 21 15:32:19.707583 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.707570    2552 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 21 15:32:19.707676 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:19.704842    2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-73.ec2.internal.18b19e71def9d394  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-73.ec2.internal,UID:ip-10-0-132-73.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-73.ec2.internal,},FirstTimestamp:2026-05-21 15:32:19.697464212 +0000 UTC m=+0.417626741,LastTimestamp:2026-05-21 15:32:19.697464212 +0000 UTC m=+0.417626741,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-73.ec2.internal,}"
May 21 15:32:19.708159 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.708144    2552 reconstruct.go:97] "Volume reconstruction finished"
May 21 15:32:19.708159 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.708157    2552 reconciler.go:26] "Reconciler: start to sync state"
May 21 15:32:19.708602 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.708584    2552 factory.go:55] Registering systemd factory
May 21 15:32:19.708602 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.708604    2552 factory.go:223] Registration of the systemd container factory successfully
May 21 15:32:19.708736 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.708643    2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rb2vg"
May 21 15:32:19.709128 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.709112    2552 factory.go:153] Registering CRI-O factory
May 21 15:32:19.709128 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.709130    2552 factory.go:223] Registration of the crio container factory successfully
May 21 15:32:19.709230 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.709169    2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 21 15:32:19.709230 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.709182    2552 factory.go:103] Registering Raw factory
May 21 15:32:19.709230 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.709194    2552 manager.go:1196] Started watching for new ooms in manager
May 21 15:32:19.709953 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.709935    2552 manager.go:319] Starting recovery of all containers
May 21 15:32:19.710095 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:19.710071    2552 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 21 15:32:19.715207 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:19.715092    2552 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 21 15:32:19.715207 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:19.715107    2552 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 21 15:32:19.717446 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.717423    2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rb2vg"
May 21 15:32:19.720852 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.720689    2552 manager.go:324] Recovery completed
May 21 15:32:19.725780 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.725766    2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 15:32:19.727595 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.727578    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientMemory"
May 21 15:32:19.727663 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.727608    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasNoDiskPressure"
May 21 15:32:19.727663 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.727619    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientPID"
May 21 15:32:19.728032 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.728016    2552 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 21 15:32:19.728032 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.728031    2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 21 15:32:19.728135 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.728052    2552 state_mem.go:36] "Initialized new in-memory state store"
May 21 15:32:19.729874 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:19.729808    2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-73.ec2.internal.18b19e71e0c59657  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-73.ec2.internal,UID:ip-10-0-132-73.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-73.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-73.ec2.internal,},FirstTimestamp:2026-05-21 15:32:19.727595095 +0000 UTC m=+0.447757624,LastTimestamp:2026-05-21 15:32:19.727595095 +0000 UTC m=+0.447757624,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-73.ec2.internal,}"
May 21 15:32:19.730135 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.730124    2552 policy_none.go:49] "None policy: Start"
May 21 15:32:19.730186 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.730157    2552 memory_manager.go:186] "Starting memorymanager" policy="None"
May 21 15:32:19.730186 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.730182    2552 state_mem.go:35] "Initializing new in-memory state store"
May 21 15:32:19.766818 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.766800    2552 manager.go:341] "Starting Device Plugin manager"
May 21 15:32:19.779966 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:19.766836    2552 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 21 15:32:19.779966 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.766850    2552 server.go:85] "Starting device plugin registration server"
May 21 15:32:19.779966 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.767081    2552 eviction_manager.go:189] "Eviction manager: starting control loop"
May 21 15:32:19.779966 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.767092    2552 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 21 15:32:19.779966 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.767201    2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 21 15:32:19.779966 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.767295    2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 21 15:32:19.779966 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.767304    2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 21 15:32:19.779966 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:19.767811    2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 21 15:32:19.779966 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:19.767854    2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-73.ec2.internal\" not found"
May 21 15:32:19.839526 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.839490    2552 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 21 15:32:19.840760 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.840735    2552 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 21 15:32:19.840760 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.840756    2552 status_manager.go:230] "Starting to sync pod status with apiserver"
May 21 15:32:19.840889 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.840783    2552 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 21 15:32:19.840889 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.840790    2552 kubelet.go:2451] "Starting kubelet main sync loop"
May 21 15:32:19.840889 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:19.840830    2552 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 21 15:32:19.844075 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.844029    2552 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 15:32:19.867399 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.867379    2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 15:32:19.868279 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.868251    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientMemory"
May 21 15:32:19.868338 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.868293    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasNoDiskPressure"
May 21 15:32:19.868338 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.868303    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientPID"
May 21 15:32:19.868338 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.868327    2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-73.ec2.internal"
May 21 15:32:19.876465 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.876451    2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-73.ec2.internal"
May 21 15:32:19.876522 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:19.876472    2552 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-73.ec2.internal\": node \"ip-10-0-132-73.ec2.internal\" not found"
May 21 15:32:19.898462 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:19.898437    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
May 21 15:32:19.941902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.941837    2552 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-73.ec2.internal"]
May 21 15:32:19.942029 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.941951    2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 15:32:19.943770 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.943752    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientMemory"
May 21 15:32:19.943871 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.943786    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasNoDiskPressure"
May 21 15:32:19.943871 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.943800    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientPID"
May 21 15:32:19.945015 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.944999    2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 15:32:19.945227 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.945212    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal"
May 21 15:32:19.945295 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.945248    2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 15:32:19.945736 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.945721    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientMemory"
May 21 15:32:19.945790 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.945733    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientMemory"
May 21 15:32:19.945790 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.945750    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasNoDiskPressure"
May 21 15:32:19.945790 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.945756    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasNoDiskPressure"
May 21 15:32:19.945790 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.945761    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientPID"
May 21 15:32:19.945790 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.945766    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientPID"
May 21 15:32:19.948078 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.948059    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-73.ec2.internal"
May 21 15:32:19.948157 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.948087    2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 15:32:19.948816 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.948799    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientMemory"
May 21 15:32:19.948885 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.948827    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasNoDiskPressure"
May 21 15:32:19.948885 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:19.948841    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeHasSufficientPID"
May 21 15:32:19.966833 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:19.966815    2552 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-73.ec2.internal\" not found" node="ip-10-0-132-73.ec2.internal"
May 21 15:32:19.971255 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:19.971239    2552 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-73.ec2.internal\" not found" node="ip-10-0-132-73.ec2.internal"
May 21 15:32:19.998995 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:19.998973    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
May 21 15:32:20.009661 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:20.009642    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9e228c5909e6d1827c6ff957d470c8bf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal\" (UID: \"9e228c5909e6d1827c6ff957d470c8bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal"
May 21 15:32:20.009740 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:20.009667    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e228c5909e6d1827c6ff957d470c8bf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal\" (UID: \"9e228c5909e6d1827c6ff957d470c8bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal"
May 21 15:32:20.009740 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:20.009688    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8868faa81f1fa41a44d4049608427735-config\") pod \"kube-apiserver-proxy-ip-10-0-132-73.ec2.internal\" (UID: \"8868faa81f1fa41a44d4049608427735\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-73.ec2.internal"
May 21 15:32:20.100173 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:20.100091    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
May 21 15:32:20.110614 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:20.110587    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9e228c5909e6d1827c6ff957d470c8bf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal\" (UID: \"9e228c5909e6d1827c6ff957d470c8bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal"
May 21 15:32:20.110702 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:20.110625    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e228c5909e6d1827c6ff957d470c8bf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal\" (UID: \"9e228c5909e6d1827c6ff957d470c8bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal"
May 21 15:32:20.110702 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:20.110647    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8868faa81f1fa41a44d4049608427735-config\") pod \"kube-apiserver-proxy-ip-10-0-132-73.ec2.internal\" (UID: \"8868faa81f1fa41a44d4049608427735\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-73.ec2.internal"
May 21 15:32:20.110783 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:20.110700    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e228c5909e6d1827c6ff957d470c8bf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal\" (UID: \"9e228c5909e6d1827c6ff957d470c8bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal"
May 21 15:32:20.110783 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:20.110704    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9e228c5909e6d1827c6ff957d470c8bf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal\" (UID: \"9e228c5909e6d1827c6ff957d470c8bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal"
May 21 15:32:20.110783 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:20.110755    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8868faa81f1fa41a44d4049608427735-config\") pod \"kube-apiserver-proxy-ip-10-0-132-73.ec2.internal\" (UID: \"8868faa81f1fa41a44d4049608427735\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-73.ec2.internal"
May 21 15:32:20.201049 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:20.201007    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
May 21 15:32:20.269569 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:20.269530    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal"
May 21 15:32:20.273299 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:20.273274    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-73.ec2.internal"
May 21 15:32:20.301120 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:20.301091    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
May 21 15:32:20.401803 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:20.401712    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
May 21 15:32:20.502359 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:20.502325    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
May 21 15:32:20.602948 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:20.602916    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
May 21 15:32:20.620490 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:20.620460    2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 21 15:32:20.620609 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:20.620593    2552 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 15:32:20.703658 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:20.703624    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
May 21 15:32:20.704756 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:20.704741    2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 21 15:32:20.718791 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:20.718762    2552 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 15:32:20.718943 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:20.718919    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 15:27:19 +0000 UTC" deadline="2028-02-28 20:50:13.32843965 +0000 UTC"
May 21 15:32:20.719002 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:20.718946    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15557h17m52.609498608s"
May 21 15:32:20.741351 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:20.741322    2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-w67wb"
May 21 15:32:20.750752 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:20.750717    2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-w67wb"
May 21 15:32:20.761861 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:20.761834    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8868faa81f1fa41a44d4049608427735.slice/crio-ae63ee6e980d937e15d959a59c14118b261153a8f2ef16de728830fa0a497eb5 WatchSource:0}: Error finding container ae63ee6e980d937e15d959a59c14118b261153a8f2ef16de728830fa0a497eb5: Status 404 returned error can't find the container with id ae63ee6e980d937e15d959a59c14118b261153a8f2ef16de728830fa0a497eb5
May 21 15:32:20.765423 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:20.765403    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e228c5909e6d1827c6ff957d470c8bf.slice/crio-7dc467aa8a2c40785b2edb86e806ffd5171d06ffb1506eaab7ea370defe463e2 WatchSource:0}: Error finding container 7dc467aa8a2c40785b2edb86e806ffd5171d06ffb1506eaab7ea370defe463e2: Status 404 returned error can't find the container with id 7dc467aa8a2c40785b2edb86e806ffd5171d06ffb1506eaab7ea370defe463e2
May 21 15:32:20.765643 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:20.765631    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 15:32:20.785130 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:20.785109    2552 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 15:32:20.804216 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:20.804197    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
May 21 15:32:20.843680 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:20.843630    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal" event={"ID":"9e228c5909e6d1827c6ff957d470c8bf","Type":"ContainerStarted","Data":"7dc467aa8a2c40785b2edb86e806ffd5171d06ffb1506eaab7ea370defe463e2"}
May 21 15:32:20.844607 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:20.844586    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-73.ec2.internal" event={"ID":"8868faa81f1fa41a44d4049608427735","Type":"ContainerStarted","Data":"ae63ee6e980d937e15d959a59c14118b261153a8f2ef16de728830fa0a497eb5"}
May 21 15:32:20.904791 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:20.904752    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
May 21 15:32:21.005333 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:21.005238    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
May 21 15:32:21.105919 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:21.105888    2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-73.ec2.internal\" not found"
May 21 15:32:21.109698 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.109679    2552 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 15:32:21.115842 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.115823    2552 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 15:32:21.205499 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.205457    2552 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal"
May 21 15:32:21.245216 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.245178    2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 15:32:21.246069 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.246040    2552 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-73.ec2.internal"
May 21 15:32:21.258636 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.258556    2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 15:32:21.688724 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.688694    2552 apiserver.go:52] "Watching apiserver"
May 21 15:32:21.696064 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.696033    2552 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 21 15:32:21.696944 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.696921    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal","openshift-multus/network-metrics-daemon-x7ttm","openshift-network-diagnostics/network-check-target-qbcqg","openshift-ovn-kubernetes/ovnkube-node-479rw","kube-system/kube-apiserver-proxy-ip-10-0-132-73.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr","openshift-cluster-node-tuning-operator/tuned-llrkc","openshift-dns/node-resolver-l6g95","openshift-image-registry/node-ca-2475j","openshift-multus/multus-additional-cni-plugins-t6f6l","openshift-multus/multus-cglf2","openshift-network-operator/iptables-alerter-6dlwn","kube-system/konnectivity-agent-2pdz5"]
May 21 15:32:21.699584 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.699563    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l6g95"
May 21 15:32:21.700624 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.700598    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2pdz5"
May 21 15:32:21.701646 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.701628    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5mcjn\""
May 21 15:32:21.701753 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.701741    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 21 15:32:21.702066 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.702048    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 21 15:32:21.702657 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.702641    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 21 15:32:21.702765 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.702748    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 21 15:32:21.702833 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.702647    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xf4nx\""
May 21 15:32:21.703160 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.702959    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.706323 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.704570    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:21.706323 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:21.704646    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbcqg" podUID="611783df-c519-4e59-9acc-7a7ddb15657c"
May 21 15:32:21.706323 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.704806    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2475j"
May 21 15:32:21.706323 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.705312    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 21 15:32:21.706323 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.705990    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 21 15:32:21.706323 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.706125    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rnk6p\""
May 21 15:32:21.706632 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.706506    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 21 15:32:21.706632 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.706605    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 21 15:32:21.707563 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.706826    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 21 15:32:21.707563 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.707003    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 21 15:32:21.707563 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.707279    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 21 15:32:21.707563 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.707548    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 21 15:32:21.707963 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.707942    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2qxzh\""
May 21 15:32:21.708901 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.708883    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.709727 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.709045    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 21 15:32:21.710217 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.710202    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr"
May 21 15:32:21.711562 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.711530    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 21 15:32:21.711736 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.711709    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jmrrv\""
May 21 15:32:21.711839 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.711747    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 21 15:32:21.711985 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.711967    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:21.712618 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.712361    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 21 15:32:21.712618 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.712440    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tjt6s\""
May 21 15:32:21.712618 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.712560    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 21 15:32:21.712811 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.712620    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 21 15:32:21.713530 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.713511    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cglf2"
May 21 15:32:21.714698 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.714679    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 21 15:32:21.714698 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.714688    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 21 15:32:21.714868 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.714733    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 21 15:32:21.715011 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.714982    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 21 15:32:21.715094 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.715013    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-prks4\""
May 21 15:32:21.715094 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.715064    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 21 15:32:21.715715 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.715635    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 21 15:32:21.715946 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.715866    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kzvz4\""
May 21 15:32:21.716016 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.715946    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:21.716016 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:21.716002    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7ttm" podUID="a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0"
May 21 15:32:21.716152 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.716137    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6dlwn"
May 21 15:32:21.718393 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.718376    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 21 15:32:21.718669 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.718652    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 21 15:32:21.718770 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.718710    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5lwz9\""
May 21 15:32:21.718879 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.718865    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 21 15:32:21.719764 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.719746    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99wlg\" (UniqueName: \"kubernetes.io/projected/3ef54bf7-c851-42e8-ab07-955a73e57e37-kube-api-access-99wlg\") pod \"node-resolver-l6g95\" (UID: \"3ef54bf7-c851-42e8-ab07-955a73e57e37\") " pod="openshift-dns/node-resolver-l6g95"
May 21 15:32:21.719860 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.719776    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-node-log\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.719860 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.719801    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ef54bf7-c851-42e8-ab07-955a73e57e37-tmp-dir\") pod \"node-resolver-l6g95\" (UID: \"3ef54bf7-c851-42e8-ab07-955a73e57e37\") " pod="openshift-dns/node-resolver-l6g95"
May 21 15:32:21.719860 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.719824    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/51dfd7d4-035e-4e8a-9b2a-efd072576313-ovnkube-config\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.720008 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.719872    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-etc-modprobe-d\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.720008 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.719900    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-host-run-netns\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.720008 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.719945    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-etc-kubernetes\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.720008 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.719985    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-etc-sysctl-d\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.720008 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720004    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-lib-modules\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.720169 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720027    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-host\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.720169 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720069    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-systemd-units\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.720169 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720100    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-host-slash\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.720169 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720117    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-host-cni-netd\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.720169 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720149    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r6v8\" (UniqueName: \"kubernetes.io/projected/f35e19d1-88d3-4e8d-82de-1531dff0c058-kube-api-access-7r6v8\") pod \"node-ca-2475j\" (UID: \"f35e19d1-88d3-4e8d-82de-1531dff0c058\") " pod="openshift-image-registry/node-ca-2475j"
May 21 15:32:21.720169 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720169    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-etc-systemd\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.720427 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720183    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-var-lib-kubelet\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.720427 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720213    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-run-ovn\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.720427 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720234    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-log-socket\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.720427 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720274    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg6j7\" (UniqueName: \"kubernetes.io/projected/51dfd7d4-035e-4e8a-9b2a-efd072576313-kube-api-access-kg6j7\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.720427 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720319    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f35e19d1-88d3-4e8d-82de-1531dff0c058-serviceca\") pod \"node-ca-2475j\" (UID: \"f35e19d1-88d3-4e8d-82de-1531dff0c058\") " pod="openshift-image-registry/node-ca-2475j"
May 21 15:32:21.720427 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720351    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-etc-sysctl-conf\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.720427 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720377    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fa2fd89-b648-4985-a97e-cc9cd1b37867-tmp\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.720427 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720412    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jglnj\" (UniqueName: \"kubernetes.io/projected/2fa2fd89-b648-4985-a97e-cc9cd1b37867-kube-api-access-jglnj\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.720743 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720437    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3ef54bf7-c851-42e8-ab07-955a73e57e37-hosts-file\") pod \"node-resolver-l6g95\" (UID: \"3ef54bf7-c851-42e8-ab07-955a73e57e37\") " pod="openshift-dns/node-resolver-l6g95"
May 21 15:32:21.720743 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720460    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/db3f5fed-a552-4838-9ad1-4eb27878ca68-agent-certs\") pod \"konnectivity-agent-2pdz5\" (UID: \"db3f5fed-a552-4838-9ad1-4eb27878ca68\") " pod="kube-system/konnectivity-agent-2pdz5"
May 21 15:32:21.720743 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720485    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kpvz\" (UniqueName: \"kubernetes.io/projected/611783df-c519-4e59-9acc-7a7ddb15657c-kube-api-access-7kpvz\") pod \"network-check-target-qbcqg\" (UID: \"611783df-c519-4e59-9acc-7a7ddb15657c\") " pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:21.720743 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720510    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-run-systemd\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.720743 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720550    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-host-run-ovn-kubernetes\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.720743 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720602    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/51dfd7d4-035e-4e8a-9b2a-efd072576313-env-overrides\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.720743 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720629    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/51dfd7d4-035e-4e8a-9b2a-efd072576313-ovn-node-metrics-cert\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.720743 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720654    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f35e19d1-88d3-4e8d-82de-1531dff0c058-host\") pod \"node-ca-2475j\" (UID: \"f35e19d1-88d3-4e8d-82de-1531dff0c058\") " pod="openshift-image-registry/node-ca-2475j"
May 21 15:32:21.720743 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720703    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/db3f5fed-a552-4838-9ad1-4eb27878ca68-konnectivity-ca\") pod \"konnectivity-agent-2pdz5\" (UID: \"db3f5fed-a552-4838-9ad1-4eb27878ca68\") " pod="kube-system/konnectivity-agent-2pdz5"
May 21 15:32:21.720743 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720727    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-etc-openvswitch\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.721122 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720751    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-run-openvswitch\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.721122 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720774    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-etc-sysconfig\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.721122 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720801    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-sys\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.721122 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720824    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2fa2fd89-b648-4985-a97e-cc9cd1b37867-etc-tuned\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.721122 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720846    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-host-kubelet\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.721122 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720868    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-var-lib-openvswitch\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.721122 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720907    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-host-cni-bin\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.721122 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720930    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.721122 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720949    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/51dfd7d4-035e-4e8a-9b2a-efd072576313-ovnkube-script-lib\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.721122 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.720967    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-run\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.751379 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.751345    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 15:27:20 +0000 UTC" deadline="2028-02-12 22:37:24.182514414 +0000 UTC"
May 21 15:32:21.751478 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.751380    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15175h5m2.431139044s"
May 21 15:32:21.809274 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.809241    2552 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 21 15:32:21.821635 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.821609    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-multus-cni-dir\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.821635 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.821642    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-etc-modprobe-d\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.821855 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.821666    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5-device-dir\") pod \"aws-ebs-csi-driver-node-8b7rr\" (UID: \"9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr"
May 21 15:32:21.821855 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.821690    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/071a38d4-2377-4a03-b258-06c9d1751226-cni-binary-copy\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.821855 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.821713    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-etc-kubernetes\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.821855 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.821739    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njswr\" (UniqueName: \"kubernetes.io/projected/9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5-kube-api-access-njswr\") pod \"aws-ebs-csi-driver-node-8b7rr\" (UID: \"9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr"
May 21 15:32:21.821855 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.821765    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1cfc65e3-1d41-4a4a-96d4-3f3a53a45f08-iptables-alerter-script\") pod \"iptables-alerter-6dlwn\" (UID: \"1cfc65e3-1d41-4a4a-96d4-3f3a53a45f08\") " pod="openshift-network-operator/iptables-alerter-6dlwn"
May 21 15:32:21.821855 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.821808    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-host-slash\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.821855 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.821824    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-etc-modprobe-d\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.821855 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.821831    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7r6v8\" (UniqueName: \"kubernetes.io/projected/f35e19d1-88d3-4e8d-82de-1531dff0c058-kube-api-access-7r6v8\") pod \"node-ca-2475j\" (UID: \"f35e19d1-88d3-4e8d-82de-1531dff0c058\") " pod="openshift-image-registry/node-ca-2475j"
May 21 15:32:21.822209 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.821874    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fa2fd89-b648-4985-a97e-cc9cd1b37867-tmp\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.822209 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.821884    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-host-slash\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.822209 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.821898    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5-etc-selinux\") pod \"aws-ebs-csi-driver-node-8b7rr\" (UID: \"9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr"
May 21 15:32:21.822209 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.821940    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-log-socket\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.822209 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.821962    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kg6j7\" (UniqueName: \"kubernetes.io/projected/51dfd7d4-035e-4e8a-9b2a-efd072576313-kube-api-access-kg6j7\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.822209 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.821979    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-etc-sysctl-conf\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.822209 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.821996    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-sys\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.822209 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822009    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2fa2fd89-b648-4985-a97e-cc9cd1b37867-etc-tuned\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.822209 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822026    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1cfc65e3-1d41-4a4a-96d4-3f3a53a45f08-host-slash\") pod \"iptables-alerter-6dlwn\" (UID: \"1cfc65e3-1d41-4a4a-96d4-3f3a53a45f08\") " pod="openshift-network-operator/iptables-alerter-6dlwn"
May 21 15:32:21.822209 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822042    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs\") pod \"network-metrics-daemon-x7ttm\" (UID: \"a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0\") " pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:21.822209 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822057    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/071a38d4-2377-4a03-b258-06c9d1751226-multus-daemon-config\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.822209 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822071    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-host-run-multus-certs\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.822209 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822088    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/db3f5fed-a552-4838-9ad1-4eb27878ca68-konnectivity-ca\") pod \"konnectivity-agent-2pdz5\" (UID: \"db3f5fed-a552-4838-9ad1-4eb27878ca68\") " pod="kube-system/konnectivity-agent-2pdz5"
May 21 15:32:21.822209 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822103    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-etc-openvswitch\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.822209 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822117    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-sys\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.822209 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822119    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-run-openvswitch\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.822209 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822143    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-run-openvswitch\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.823013 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822156    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-etc-sysconfig\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.823013 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822176    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w4rv\" (UniqueName: \"kubernetes.io/projected/1cfc65e3-1d41-4a4a-96d4-3f3a53a45f08-kube-api-access-4w4rv\") pod \"iptables-alerter-6dlwn\" (UID: \"1cfc65e3-1d41-4a4a-96d4-3f3a53a45f08\") " pod="openshift-network-operator/iptables-alerter-6dlwn"
May 21 15:32:21.823013 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822198    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e482850-fd92-4d57-a98e-522e62d88ffa-system-cni-dir\") pod \"multus-additional-cni-plugins-t6f6l\" (UID: \"7e482850-fd92-4d57-a98e-522e62d88ffa\") " pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:21.823013 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822238    2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 21 15:32:21.823013 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822271    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7e482850-fd92-4d57-a98e-522e62d88ffa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t6f6l\" (UID: \"7e482850-fd92-4d57-a98e-522e62d88ffa\") " pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:21.823013 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822299    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-host-kubelet\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.823013 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822321    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-var-lib-openvswitch\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.823013 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822347    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.823013 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822361    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-etc-sysctl-conf\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.823013 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822376    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-444m5\" (UniqueName: \"kubernetes.io/projected/7e482850-fd92-4d57-a98e-522e62d88ffa-kube-api-access-444m5\") pod \"multus-additional-cni-plugins-t6f6l\" (UID: \"7e482850-fd92-4d57-a98e-522e62d88ffa\") " pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:21.823013 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822413    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-log-socket\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.823013 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822424    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-etc-sysconfig\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.823013 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822592    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-multus-socket-dir-parent\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.823013 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822606    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-host-kubelet\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.823013 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822631    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-multus-conf-dir\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.823013 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822635    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-var-lib-openvswitch\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.823013 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822650    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-etc-openvswitch\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.823784 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822702    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.823784 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822731    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5-sys-fs\") pod \"aws-ebs-csi-driver-node-8b7rr\" (UID: \"9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr"
May 21 15:32:21.823784 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822769    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-host-var-lib-cni-multus\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.823784 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822800    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-hostroot\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.823784 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822838    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ef54bf7-c851-42e8-ab07-955a73e57e37-tmp-dir\") pod \"node-resolver-l6g95\" (UID: \"3ef54bf7-c851-42e8-ab07-955a73e57e37\") " pod="openshift-dns/node-resolver-l6g95"
May 21 15:32:21.823784 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822873    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/51dfd7d4-035e-4e8a-9b2a-efd072576313-ovnkube-config\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.823784 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822896    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8b7rr\" (UID: \"9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr"
May 21 15:32:21.823784 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822919    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7e482850-fd92-4d57-a98e-522e62d88ffa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t6f6l\" (UID: \"7e482850-fd92-4d57-a98e-522e62d88ffa\") " pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:21.823784 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822940    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-host-run-k8s-cni-cncf-io\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.823784 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822962    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh9ll\" (UniqueName: \"kubernetes.io/projected/071a38d4-2377-4a03-b258-06c9d1751226-kube-api-access-wh9ll\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.823784 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.822984    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-host-run-netns\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.823784 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823003    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-etc-kubernetes\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.823784 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823025    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-etc-sysctl-d\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.823784 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823048    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-lib-modules\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.823784 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823070    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-host\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.823784 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823095    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5-socket-dir\") pod \"aws-ebs-csi-driver-node-8b7rr\" (UID: \"9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr"
May 21 15:32:21.823784 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823116    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ef54bf7-c851-42e8-ab07-955a73e57e37-tmp-dir\") pod \"node-resolver-l6g95\" (UID: \"3ef54bf7-c851-42e8-ab07-955a73e57e37\") " pod="openshift-dns/node-resolver-l6g95"
May 21 15:32:21.824543 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823126    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxm65\" (UniqueName: \"kubernetes.io/projected/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-kube-api-access-bxm65\") pod \"network-metrics-daemon-x7ttm\" (UID: \"a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0\") " pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:21.824543 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823162    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/db3f5fed-a552-4838-9ad1-4eb27878ca68-konnectivity-ca\") pod \"konnectivity-agent-2pdz5\" (UID: \"db3f5fed-a552-4838-9ad1-4eb27878ca68\") " pod="kube-system/konnectivity-agent-2pdz5"
May 21 15:32:21.824543 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823152    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-cnibin\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.824543 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823169    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-host-run-netns\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.824543 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823205    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-systemd-units\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.824543 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823275    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-host-cni-netd\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.824543 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823282    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-lib-modules\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.824543 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823294    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-etc-kubernetes\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.824543 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823298    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-etc-systemd\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.824543 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823327    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-systemd-units\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.824543 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823358    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-etc-systemd\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.824543 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823355    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-etc-sysctl-d\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.824543 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823370    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-host-cni-netd\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.824543 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823356    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-var-lib-kubelet\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.824543 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823401    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-host\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.824543 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823412    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jglnj\" (UniqueName: \"kubernetes.io/projected/2fa2fd89-b648-4985-a97e-cc9cd1b37867-kube-api-access-jglnj\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.824543 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823415    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-var-lib-kubelet\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.824543 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823449    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/51dfd7d4-035e-4e8a-9b2a-efd072576313-ovnkube-config\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.825406 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823529    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-os-release\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.825406 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823559    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-host-var-lib-kubelet\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.825406 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823588    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-run-ovn\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.825406 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823629    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-run-ovn\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.825406 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823630    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f35e19d1-88d3-4e8d-82de-1531dff0c058-serviceca\") pod \"node-ca-2475j\" (UID: \"f35e19d1-88d3-4e8d-82de-1531dff0c058\") " pod="openshift-image-registry/node-ca-2475j"
May 21 15:32:21.825406 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823698    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e482850-fd92-4d57-a98e-522e62d88ffa-os-release\") pod \"multus-additional-cni-plugins-t6f6l\" (UID: \"7e482850-fd92-4d57-a98e-522e62d88ffa\") " pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:21.825406 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823761    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-host-run-netns\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.825406 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823791    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-host-var-lib-cni-bin\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.825406 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823833    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3ef54bf7-c851-42e8-ab07-955a73e57e37-hosts-file\") pod \"node-resolver-l6g95\" (UID: \"3ef54bf7-c851-42e8-ab07-955a73e57e37\") " pod="openshift-dns/node-resolver-l6g95"
May 21 15:32:21.825406 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823896    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3ef54bf7-c851-42e8-ab07-955a73e57e37-hosts-file\") pod \"node-resolver-l6g95\" (UID: \"3ef54bf7-c851-42e8-ab07-955a73e57e37\") " pod="openshift-dns/node-resolver-l6g95"
May 21 15:32:21.825406 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823911    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/db3f5fed-a552-4838-9ad1-4eb27878ca68-agent-certs\") pod \"konnectivity-agent-2pdz5\" (UID: \"db3f5fed-a552-4838-9ad1-4eb27878ca68\") " pod="kube-system/konnectivity-agent-2pdz5"
May 21 15:32:21.825406 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.823944    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7kpvz\" (UniqueName: \"kubernetes.io/projected/611783df-c519-4e59-9acc-7a7ddb15657c-kube-api-access-7kpvz\") pod \"network-check-target-qbcqg\" (UID: \"611783df-c519-4e59-9acc-7a7ddb15657c\") " pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:21.825406 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.824029    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-run-systemd\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.825406 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.824058    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-host-run-ovn-kubernetes\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.825406 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.824109    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-run-systemd\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.825406 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.824110    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f35e19d1-88d3-4e8d-82de-1531dff0c058-serviceca\") pod \"node-ca-2475j\" (UID: \"f35e19d1-88d3-4e8d-82de-1531dff0c058\") " pod="openshift-image-registry/node-ca-2475j"
May 21 15:32:21.825406 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.824139    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/51dfd7d4-035e-4e8a-9b2a-efd072576313-env-overrides\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.826319 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.824165    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/51dfd7d4-035e-4e8a-9b2a-efd072576313-ovn-node-metrics-cert\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.826319 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.824206    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f35e19d1-88d3-4e8d-82de-1531dff0c058-host\") pod \"node-ca-2475j\" (UID: \"f35e19d1-88d3-4e8d-82de-1531dff0c058\") " pod="openshift-image-registry/node-ca-2475j"
May 21 15:32:21.826319 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.824231    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e482850-fd92-4d57-a98e-522e62d88ffa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t6f6l\" (UID: \"7e482850-fd92-4d57-a98e-522e62d88ffa\") " pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:21.826319 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.824249    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-host-cni-bin\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.826319 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.824291    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/51dfd7d4-035e-4e8a-9b2a-efd072576313-ovnkube-script-lib\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.826319 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.824347    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-host-run-ovn-kubernetes\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.826319 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.824365    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-run\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.826319 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.824406    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e482850-fd92-4d57-a98e-522e62d88ffa-cni-binary-copy\") pod \"multus-additional-cni-plugins-t6f6l\" (UID: \"7e482850-fd92-4d57-a98e-522e62d88ffa\") " pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:21.826319 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.824432    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-system-cni-dir\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.826319 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.824460    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-99wlg\" (UniqueName: \"kubernetes.io/projected/3ef54bf7-c851-42e8-ab07-955a73e57e37-kube-api-access-99wlg\") pod \"node-resolver-l6g95\" (UID: \"3ef54bf7-c851-42e8-ab07-955a73e57e37\") " pod="openshift-dns/node-resolver-l6g95"
May 21 15:32:21.826319 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.824513    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-node-log\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.826319 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.824541    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5-registration-dir\") pod \"aws-ebs-csi-driver-node-8b7rr\" (UID: \"9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr"
May 21 15:32:21.826319 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.824564    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e482850-fd92-4d57-a98e-522e62d88ffa-cnibin\") pod \"multus-additional-cni-plugins-t6f6l\" (UID: \"7e482850-fd92-4d57-a98e-522e62d88ffa\") " pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:21.826319 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.824727    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/51dfd7d4-035e-4e8a-9b2a-efd072576313-env-overrides\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.826319 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.824881    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-node-log\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.826319 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.824921    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51dfd7d4-035e-4e8a-9b2a-efd072576313-host-cni-bin\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.826319 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.824951    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f35e19d1-88d3-4e8d-82de-1531dff0c058-host\") pod \"node-ca-2475j\" (UID: \"f35e19d1-88d3-4e8d-82de-1531dff0c058\") " pod="openshift-image-registry/node-ca-2475j"
May 21 15:32:21.827158 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.824988    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2fa2fd89-b648-4985-a97e-cc9cd1b37867-run\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.827158 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.825201    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/51dfd7d4-035e-4e8a-9b2a-efd072576313-ovnkube-script-lib\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.827158 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.825755    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fa2fd89-b648-4985-a97e-cc9cd1b37867-tmp\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.827158 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.825788    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2fa2fd89-b648-4985-a97e-cc9cd1b37867-etc-tuned\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.827158 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.826650    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/51dfd7d4-035e-4e8a-9b2a-efd072576313-ovn-node-metrics-cert\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.827483 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.827459    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/db3f5fed-a552-4838-9ad1-4eb27878ca68-agent-certs\") pod \"konnectivity-agent-2pdz5\" (UID: \"db3f5fed-a552-4838-9ad1-4eb27878ca68\") " pod="kube-system/konnectivity-agent-2pdz5"
May 21 15:32:21.827828 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.827813    2552 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 15:32:21.832624 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:21.832307    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 15:32:21.832624 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:21.832333    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 15:32:21.832624 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:21.832349    2552 projected.go:194] Error preparing data for projected volume kube-api-access-7kpvz for pod openshift-network-diagnostics/network-check-target-qbcqg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:32:21.832624 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:21.832426    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/611783df-c519-4e59-9acc-7a7ddb15657c-kube-api-access-7kpvz podName:611783df-c519-4e59-9acc-7a7ddb15657c nodeName:}" failed. No retries permitted until 2026-05-21 15:32:22.332406014 +0000 UTC m=+3.052568552 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7kpvz" (UniqueName: "kubernetes.io/projected/611783df-c519-4e59-9acc-7a7ddb15657c-kube-api-access-7kpvz") pod "network-check-target-qbcqg" (UID: "611783df-c519-4e59-9acc-7a7ddb15657c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:32:21.832940 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.832920    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg6j7\" (UniqueName: \"kubernetes.io/projected/51dfd7d4-035e-4e8a-9b2a-efd072576313-kube-api-access-kg6j7\") pod \"ovnkube-node-479rw\" (UID: \"51dfd7d4-035e-4e8a-9b2a-efd072576313\") " pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:21.833092 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.833071    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r6v8\" (UniqueName: \"kubernetes.io/projected/f35e19d1-88d3-4e8d-82de-1531dff0c058-kube-api-access-7r6v8\") pod \"node-ca-2475j\" (UID: \"f35e19d1-88d3-4e8d-82de-1531dff0c058\") " pod="openshift-image-registry/node-ca-2475j"
May 21 15:32:21.834666 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.834644    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99wlg\" (UniqueName: \"kubernetes.io/projected/3ef54bf7-c851-42e8-ab07-955a73e57e37-kube-api-access-99wlg\") pod \"node-resolver-l6g95\" (UID: \"3ef54bf7-c851-42e8-ab07-955a73e57e37\") " pod="openshift-dns/node-resolver-l6g95"
May 21 15:32:21.834806 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.834791    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jglnj\" (UniqueName: \"kubernetes.io/projected/2fa2fd89-b648-4985-a97e-cc9cd1b37867-kube-api-access-jglnj\") pod \"tuned-llrkc\" (UID: \"2fa2fd89-b648-4985-a97e-cc9cd1b37867\") " pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:21.925794 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.925758    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7e482850-fd92-4d57-a98e-522e62d88ffa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t6f6l\" (UID: \"7e482850-fd92-4d57-a98e-522e62d88ffa\") " pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:21.925794 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.925802    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-host-run-k8s-cni-cncf-io\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.926044 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.925828    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wh9ll\" (UniqueName: \"kubernetes.io/projected/071a38d4-2377-4a03-b258-06c9d1751226-kube-api-access-wh9ll\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.926044 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.925854    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5-socket-dir\") pod \"aws-ebs-csi-driver-node-8b7rr\" (UID: \"9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr"
May 21 15:32:21.926044 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.925878    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bxm65\" (UniqueName: \"kubernetes.io/projected/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-kube-api-access-bxm65\") pod \"network-metrics-daemon-x7ttm\" (UID: \"a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0\") " pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:21.926044 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.925902    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-cnibin\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.926044 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.925912    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-host-run-k8s-cni-cncf-io\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.926044 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.925925    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-os-release\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.926044 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.925982    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-host-var-lib-kubelet\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.926044 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926000    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-os-release\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.926044 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926013    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e482850-fd92-4d57-a98e-522e62d88ffa-os-release\") pod \"multus-additional-cni-plugins-t6f6l\" (UID: \"7e482850-fd92-4d57-a98e-522e62d88ffa\") " pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:21.926044 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926041    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-host-run-netns\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.926527 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926067    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-host-var-lib-cni-bin\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.926527 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926112    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e482850-fd92-4d57-a98e-522e62d88ffa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t6f6l\" (UID: \"7e482850-fd92-4d57-a98e-522e62d88ffa\") " pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:21.926527 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926125    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5-socket-dir\") pod \"aws-ebs-csi-driver-node-8b7rr\" (UID: \"9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr"
May 21 15:32:21.926527 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926142    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e482850-fd92-4d57-a98e-522e62d88ffa-cni-binary-copy\") pod \"multus-additional-cni-plugins-t6f6l\" (UID: \"7e482850-fd92-4d57-a98e-522e62d88ffa\") " pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:21.926527 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926164    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-cnibin\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.926527 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926169    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-system-cni-dir\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.926527 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926198    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5-registration-dir\") pod \"aws-ebs-csi-driver-node-8b7rr\" (UID: \"9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr"
May 21 15:32:21.926527 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926213    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-host-var-lib-kubelet\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.926527 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926225    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e482850-fd92-4d57-a98e-522e62d88ffa-cnibin\") pod \"multus-additional-cni-plugins-t6f6l\" (UID: \"7e482850-fd92-4d57-a98e-522e62d88ffa\") " pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:21.926527 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926255    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e482850-fd92-4d57-a98e-522e62d88ffa-os-release\") pod \"multus-additional-cni-plugins-t6f6l\" (UID: \"7e482850-fd92-4d57-a98e-522e62d88ffa\") " pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:21.926527 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926253    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-multus-cni-dir\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.926527 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926302    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5-device-dir\") pod \"aws-ebs-csi-driver-node-8b7rr\" (UID: \"9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr"
May 21 15:32:21.926527 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926318    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/071a38d4-2377-4a03-b258-06c9d1751226-cni-binary-copy\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.926527 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926339    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-etc-kubernetes\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.926527 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926343    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-system-cni-dir\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.926527 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926367    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njswr\" (UniqueName: \"kubernetes.io/projected/9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5-kube-api-access-njswr\") pod \"aws-ebs-csi-driver-node-8b7rr\" (UID: \"9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr"
May 21 15:32:21.926527 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926389    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-host-var-lib-cni-bin\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.927242 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926393    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1cfc65e3-1d41-4a4a-96d4-3f3a53a45f08-iptables-alerter-script\") pod \"iptables-alerter-6dlwn\" (UID: \"1cfc65e3-1d41-4a4a-96d4-3f3a53a45f08\") " pod="openshift-network-operator/iptables-alerter-6dlwn"
May 21 15:32:21.927242 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926416    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-multus-cni-dir\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.927242 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926437    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5-etc-selinux\") pod \"aws-ebs-csi-driver-node-8b7rr\" (UID: \"9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr"
May 21 15:32:21.927242 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926460    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-host-run-netns\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.927242 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926458    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7e482850-fd92-4d57-a98e-522e62d88ffa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t6f6l\" (UID: \"7e482850-fd92-4d57-a98e-522e62d88ffa\") " pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:21.927242 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926473    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1cfc65e3-1d41-4a4a-96d4-3f3a53a45f08-host-slash\") pod \"iptables-alerter-6dlwn\" (UID: \"1cfc65e3-1d41-4a4a-96d4-3f3a53a45f08\") " pod="openshift-network-operator/iptables-alerter-6dlwn"
May 21 15:32:21.927242 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926501    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs\") pod \"network-metrics-daemon-x7ttm\" (UID: \"a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0\") " pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:21.927242 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926520    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5-device-dir\") pod \"aws-ebs-csi-driver-node-8b7rr\" (UID: \"9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr"
May 21 15:32:21.927242 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926523    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e482850-fd92-4d57-a98e-522e62d88ffa-cnibin\") pod \"multus-additional-cni-plugins-t6f6l\" (UID: \"7e482850-fd92-4d57-a98e-522e62d88ffa\") " pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:21.927242 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926530    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/071a38d4-2377-4a03-b258-06c9d1751226-multus-daemon-config\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.927242 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926639    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5-etc-selinux\") pod \"aws-ebs-csi-driver-node-8b7rr\" (UID: \"9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr"
May 21 15:32:21.927242 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926769    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e482850-fd92-4d57-a98e-522e62d88ffa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t6f6l\" (UID: \"7e482850-fd92-4d57-a98e-522e62d88ffa\") " pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:21.927242 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926823    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5-registration-dir\") pod \"aws-ebs-csi-driver-node-8b7rr\" (UID: \"9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr"
May 21 15:32:21.927242 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926862    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-host-run-multus-certs\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.927242 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926883    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1cfc65e3-1d41-4a4a-96d4-3f3a53a45f08-iptables-alerter-script\") pod \"iptables-alerter-6dlwn\" (UID: \"1cfc65e3-1d41-4a4a-96d4-3f3a53a45f08\") " pod="openshift-network-operator/iptables-alerter-6dlwn"
May 21 15:32:21.927242 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926899    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-host-run-multus-certs\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.927242 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.926922    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-etc-kubernetes\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.927242 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:21.926997    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:32:21.927941 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.927041    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e482850-fd92-4d57-a98e-522e62d88ffa-cni-binary-copy\") pod \"multus-additional-cni-plugins-t6f6l\" (UID: \"7e482850-fd92-4d57-a98e-522e62d88ffa\") " pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:21.927941 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.927065    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/071a38d4-2377-4a03-b258-06c9d1751226-multus-daemon-config\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.927941 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:21.927096    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs podName:a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:22.427049947 +0000 UTC m=+3.147212489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs") pod "network-metrics-daemon-x7ttm" (UID: "a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:32:21.927941 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.927114    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1cfc65e3-1d41-4a4a-96d4-3f3a53a45f08-host-slash\") pod \"iptables-alerter-6dlwn\" (UID: \"1cfc65e3-1d41-4a4a-96d4-3f3a53a45f08\") " pod="openshift-network-operator/iptables-alerter-6dlwn"
May 21 15:32:21.927941 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.927157    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4w4rv\" (UniqueName: \"kubernetes.io/projected/1cfc65e3-1d41-4a4a-96d4-3f3a53a45f08-kube-api-access-4w4rv\") pod \"iptables-alerter-6dlwn\" (UID: \"1cfc65e3-1d41-4a4a-96d4-3f3a53a45f08\") " pod="openshift-network-operator/iptables-alerter-6dlwn"
May 21 15:32:21.927941 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.927197    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e482850-fd92-4d57-a98e-522e62d88ffa-system-cni-dir\") pod \"multus-additional-cni-plugins-t6f6l\" (UID: \"7e482850-fd92-4d57-a98e-522e62d88ffa\") " pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:21.927941 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.927230    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/071a38d4-2377-4a03-b258-06c9d1751226-cni-binary-copy\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.927941 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.927308    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7e482850-fd92-4d57-a98e-522e62d88ffa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t6f6l\" (UID: \"7e482850-fd92-4d57-a98e-522e62d88ffa\") " pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:21.927941 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.927317    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e482850-fd92-4d57-a98e-522e62d88ffa-system-cni-dir\") pod \"multus-additional-cni-plugins-t6f6l\" (UID: \"7e482850-fd92-4d57-a98e-522e62d88ffa\") " pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:21.927941 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.927400    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-444m5\" (UniqueName: \"kubernetes.io/projected/7e482850-fd92-4d57-a98e-522e62d88ffa-kube-api-access-444m5\") pod \"multus-additional-cni-plugins-t6f6l\" (UID: \"7e482850-fd92-4d57-a98e-522e62d88ffa\") " pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:21.927941 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.927434    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-multus-socket-dir-parent\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.927941 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.927465    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-multus-conf-dir\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.927941 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.927492    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5-sys-fs\") pod \"aws-ebs-csi-driver-node-8b7rr\" (UID: \"9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr"
May 21 15:32:21.927941 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.927515    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-multus-socket-dir-parent\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.927941 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.927517    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-host-var-lib-cni-multus\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.927941 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.927550    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-host-var-lib-cni-multus\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.928590 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.927564    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-hostroot\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.928590 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.927567    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-multus-conf-dir\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.928590 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.927594    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8b7rr\" (UID: \"9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr"
May 21 15:32:21.928590 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.927605    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5-sys-fs\") pod \"aws-ebs-csi-driver-node-8b7rr\" (UID: \"9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr"
May 21 15:32:21.928590 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.927614    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/071a38d4-2377-4a03-b258-06c9d1751226-hostroot\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.928590 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.927662    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8b7rr\" (UID: \"9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr"
May 21 15:32:21.928590 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.927746    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7e482850-fd92-4d57-a98e-522e62d88ffa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t6f6l\" (UID: \"7e482850-fd92-4d57-a98e-522e62d88ffa\") " pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:21.938349 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.938318    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w4rv\" (UniqueName: \"kubernetes.io/projected/1cfc65e3-1d41-4a4a-96d4-3f3a53a45f08-kube-api-access-4w4rv\") pod \"iptables-alerter-6dlwn\" (UID: \"1cfc65e3-1d41-4a4a-96d4-3f3a53a45f08\") " pod="openshift-network-operator/iptables-alerter-6dlwn"
May 21 15:32:21.938520 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.938494    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-444m5\" (UniqueName: \"kubernetes.io/projected/7e482850-fd92-4d57-a98e-522e62d88ffa-kube-api-access-444m5\") pod \"multus-additional-cni-plugins-t6f6l\" (UID: \"7e482850-fd92-4d57-a98e-522e62d88ffa\") " pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:21.938520 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.938508    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxm65\" (UniqueName: \"kubernetes.io/projected/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-kube-api-access-bxm65\") pod \"network-metrics-daemon-x7ttm\" (UID: \"a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0\") " pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:21.938996 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.938955    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh9ll\" (UniqueName: \"kubernetes.io/projected/071a38d4-2377-4a03-b258-06c9d1751226-kube-api-access-wh9ll\") pod \"multus-cglf2\" (UID: \"071a38d4-2377-4a03-b258-06c9d1751226\") " pod="openshift-multus/multus-cglf2"
May 21 15:32:21.939074 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:21.939001    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njswr\" (UniqueName: \"kubernetes.io/projected/9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5-kube-api-access-njswr\") pod \"aws-ebs-csi-driver-node-8b7rr\" (UID: \"9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr"
May 21 15:32:22.012015 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.011979    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l6g95"
May 21 15:32:22.018945 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.018919    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2pdz5"
May 21 15:32:22.027545 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.027523    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:22.033116 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.033095    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2475j"
May 21 15:32:22.038750 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.038733    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-llrkc"
May 21 15:32:22.045299 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.045281    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr"
May 21 15:32:22.051799 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.051782    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t6f6l"
May 21 15:32:22.059401 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.059379    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cglf2"
May 21 15:32:22.066911 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.066891    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6dlwn"
May 21 15:32:22.431465 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.431435    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7kpvz\" (UniqueName: \"kubernetes.io/projected/611783df-c519-4e59-9acc-7a7ddb15657c-kube-api-access-7kpvz\") pod \"network-check-target-qbcqg\" (UID: \"611783df-c519-4e59-9acc-7a7ddb15657c\") " pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:22.431648 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.431489    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs\") pod \"network-metrics-daemon-x7ttm\" (UID: \"a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0\") " pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:22.431648 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:22.431590    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 15:32:22.431648 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:22.431614    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 15:32:22.431648 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:22.431625    2552 projected.go:194] Error preparing data for projected volume kube-api-access-7kpvz for pod openshift-network-diagnostics/network-check-target-qbcqg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:32:22.431819 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:22.431592    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:32:22.431819 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:22.431681    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/611783df-c519-4e59-9acc-7a7ddb15657c-kube-api-access-7kpvz podName:611783df-c519-4e59-9acc-7a7ddb15657c nodeName:}" failed. No retries permitted until 2026-05-21 15:32:23.431658557 +0000 UTC m=+4.151821073 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kpvz" (UniqueName: "kubernetes.io/projected/611783df-c519-4e59-9acc-7a7ddb15657c-kube-api-access-7kpvz") pod "network-check-target-qbcqg" (UID: "611783df-c519-4e59-9acc-7a7ddb15657c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:32:22.431819 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:22.431747    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs podName:a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:23.431730077 +0000 UTC m=+4.151892607 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs") pod "network-metrics-daemon-x7ttm" (UID: "a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:32:22.456557 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:22.456528    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf35e19d1_88d3_4e8d_82de_1531dff0c058.slice/crio-33f321be4f2a9427b713b4b5b63a7e7ca0595ea8f970cbba41436df99440b07c WatchSource:0}: Error finding container 33f321be4f2a9427b713b4b5b63a7e7ca0595ea8f970cbba41436df99440b07c: Status 404 returned error can't find the container with id 33f321be4f2a9427b713b4b5b63a7e7ca0595ea8f970cbba41436df99440b07c
May 21 15:32:22.459362 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:22.459315    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cfc65e3_1d41_4a4a_96d4_3f3a53a45f08.slice/crio-7f19671efaba411a6df5b9c923c6d5d64f5a7141577d5adb114c95718ca192d4 WatchSource:0}: Error finding container 7f19671efaba411a6df5b9c923c6d5d64f5a7141577d5adb114c95718ca192d4: Status 404 returned error can't find the container with id 7f19671efaba411a6df5b9c923c6d5d64f5a7141577d5adb114c95718ca192d4
May 21 15:32:22.461000 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:22.460977    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod071a38d4_2377_4a03_b258_06c9d1751226.slice/crio-a8b54c972598039dfac37afe456558c5848570ec7372a6c845fd6f9c434e1141 WatchSource:0}: Error finding container a8b54c972598039dfac37afe456558c5848570ec7372a6c845fd6f9c434e1141: Status 404 returned error can't find the container with id a8b54c972598039dfac37afe456558c5848570ec7372a6c845fd6f9c434e1141
May 21 15:32:22.462021 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:22.462001    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa2fd89_b648_4985_a97e_cc9cd1b37867.slice/crio-0216dba9d39e833243bd6f8643334a6433e1bbec863b8918188b84788606ed52 WatchSource:0}: Error finding container 0216dba9d39e833243bd6f8643334a6433e1bbec863b8918188b84788606ed52: Status 404 returned error can't find the container with id 0216dba9d39e833243bd6f8643334a6433e1bbec863b8918188b84788606ed52
May 21 15:32:22.462813 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:22.462767    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb3f5fed_a552_4838_9ad1_4eb27878ca68.slice/crio-758d014bab22f200dd1c6887dd4a11c011d71d384164fd355e2ac4a02b1fe6b2 WatchSource:0}: Error finding container 758d014bab22f200dd1c6887dd4a11c011d71d384164fd355e2ac4a02b1fe6b2: Status 404 returned error can't find the container with id 758d014bab22f200dd1c6887dd4a11c011d71d384164fd355e2ac4a02b1fe6b2
May 21 15:32:22.463646 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:22.463583    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a4f72f5_6372_4649_bb8a_7f2c24dfa0c5.slice/crio-8142f88d61a919f9ba1a7d53f72d3ae266f933f03d4a489b01fa4089a3e1cede WatchSource:0}: Error finding container 8142f88d61a919f9ba1a7d53f72d3ae266f933f03d4a489b01fa4089a3e1cede: Status 404 returned error can't find the container with id 8142f88d61a919f9ba1a7d53f72d3ae266f933f03d4a489b01fa4089a3e1cede
May 21 15:32:22.465188 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:22.465167    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ef54bf7_c851_42e8_ab07_955a73e57e37.slice/crio-cfdb1964df53709eef74ffa28f787c626b655115e7d6df7606fa5575a04f292c WatchSource:0}: Error finding container cfdb1964df53709eef74ffa28f787c626b655115e7d6df7606fa5575a04f292c: Status 404 returned error can't find the container with id cfdb1964df53709eef74ffa28f787c626b655115e7d6df7606fa5575a04f292c
May 21 15:32:22.466975 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:22.466155    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51dfd7d4_035e_4e8a_9b2a_efd072576313.slice/crio-f9e0bd1eff1c176a7f79b4763717d234d6a8dbc2dd1832f350d6aca41e11bcd4 WatchSource:0}: Error finding container f9e0bd1eff1c176a7f79b4763717d234d6a8dbc2dd1832f350d6aca41e11bcd4: Status 404 returned error can't find the container with id f9e0bd1eff1c176a7f79b4763717d234d6a8dbc2dd1832f350d6aca41e11bcd4
May 21 15:32:22.467381 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:32:22.467276    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e482850_fd92_4d57_a98e_522e62d88ffa.slice/crio-711fbdedeebe6e63929f1f2ee558602f247b79f3dd977578583c352d7138efd3 WatchSource:0}: Error finding container 711fbdedeebe6e63929f1f2ee558602f247b79f3dd977578583c352d7138efd3: Status 404 returned error can't find the container with id 711fbdedeebe6e63929f1f2ee558602f247b79f3dd977578583c352d7138efd3
May 21 15:32:22.752124 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.751940    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 15:27:20 +0000 UTC" deadline="2028-01-25 07:04:04.755820949 +0000 UTC"
May 21 15:32:22.752124 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.752121    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14727h31m42.003702859s"
May 21 15:32:22.841632 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.841602    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:22.841764 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:22.841734    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7ttm" podUID="a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0"
May 21 15:32:22.848554 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.848514    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-llrkc" event={"ID":"2fa2fd89-b648-4985-a97e-cc9cd1b37867","Type":"ContainerStarted","Data":"0216dba9d39e833243bd6f8643334a6433e1bbec863b8918188b84788606ed52"}
May 21 15:32:22.849476 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.849457    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6dlwn" event={"ID":"1cfc65e3-1d41-4a4a-96d4-3f3a53a45f08","Type":"ContainerStarted","Data":"7f19671efaba411a6df5b9c923c6d5d64f5a7141577d5adb114c95718ca192d4"}
May 21 15:32:22.850961 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.850938    2552 generic.go:358] "Generic (PLEG): container finished" podID="9e228c5909e6d1827c6ff957d470c8bf" containerID="973bd747023b8f4570c04a87339afdcf298f93c6025a9d86293abcfa637ed6ee" exitCode=0
May 21 15:32:22.851040 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.851001    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal" event={"ID":"9e228c5909e6d1827c6ff957d470c8bf","Type":"ContainerDied","Data":"973bd747023b8f4570c04a87339afdcf298f93c6025a9d86293abcfa637ed6ee"}
May 21 15:32:22.851939 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.851916    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l6g95" event={"ID":"3ef54bf7-c851-42e8-ab07-955a73e57e37","Type":"ContainerStarted","Data":"cfdb1964df53709eef74ffa28f787c626b655115e7d6df7606fa5575a04f292c"}
May 21 15:32:22.852804 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.852781    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr" event={"ID":"9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5","Type":"ContainerStarted","Data":"8142f88d61a919f9ba1a7d53f72d3ae266f933f03d4a489b01fa4089a3e1cede"}
May 21 15:32:22.853713 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.853695    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cglf2" event={"ID":"071a38d4-2377-4a03-b258-06c9d1751226","Type":"ContainerStarted","Data":"a8b54c972598039dfac37afe456558c5848570ec7372a6c845fd6f9c434e1141"}
May 21 15:32:22.854721 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.854701    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2475j" event={"ID":"f35e19d1-88d3-4e8d-82de-1531dff0c058","Type":"ContainerStarted","Data":"33f321be4f2a9427b713b4b5b63a7e7ca0595ea8f970cbba41436df99440b07c"}
May 21 15:32:22.855991 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.855965    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-73.ec2.internal" event={"ID":"8868faa81f1fa41a44d4049608427735","Type":"ContainerStarted","Data":"895a0b8be7cc26ea6af0ae76d4d7f20c93502f6d37f8d0997a7261b943577866"}
May 21 15:32:22.859148 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.859114    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6f6l" event={"ID":"7e482850-fd92-4d57-a98e-522e62d88ffa","Type":"ContainerStarted","Data":"711fbdedeebe6e63929f1f2ee558602f247b79f3dd977578583c352d7138efd3"}
May 21 15:32:22.860507 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.860484    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-479rw" event={"ID":"51dfd7d4-035e-4e8a-9b2a-efd072576313","Type":"ContainerStarted","Data":"f9e0bd1eff1c176a7f79b4763717d234d6a8dbc2dd1832f350d6aca41e11bcd4"}
May 21 15:32:22.861467 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.861446    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2pdz5" event={"ID":"db3f5fed-a552-4838-9ad1-4eb27878ca68","Type":"ContainerStarted","Data":"758d014bab22f200dd1c6887dd4a11c011d71d384164fd355e2ac4a02b1fe6b2"}
May 21 15:32:22.878453 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:22.878377    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-73.ec2.internal" podStartSLOduration=1.878358826 podStartE2EDuration="1.878358826s" podCreationTimestamp="2026-05-21 15:32:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:32:22.877937329 +0000 UTC m=+3.598099867" watchObservedRunningTime="2026-05-21 15:32:22.878358826 +0000 UTC m=+3.598521365"
May 21 15:32:23.440140 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:23.440098    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7kpvz\" (UniqueName: \"kubernetes.io/projected/611783df-c519-4e59-9acc-7a7ddb15657c-kube-api-access-7kpvz\") pod \"network-check-target-qbcqg\" (UID: \"611783df-c519-4e59-9acc-7a7ddb15657c\") " pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:23.440338 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:23.440175    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs\") pod \"network-metrics-daemon-x7ttm\" (UID: \"a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0\") " pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:23.440338 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:23.440314    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:32:23.440470 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:23.440377    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs podName:a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:25.440357385 +0000 UTC m=+6.160519907 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs") pod "network-metrics-daemon-x7ttm" (UID: "a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:32:23.440804 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:23.440783    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 15:32:23.440889 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:23.440808    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 15:32:23.440889 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:23.440822    2552 projected.go:194] Error preparing data for projected volume kube-api-access-7kpvz for pod openshift-network-diagnostics/network-check-target-qbcqg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:32:23.440889 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:23.440866    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/611783df-c519-4e59-9acc-7a7ddb15657c-kube-api-access-7kpvz podName:611783df-c519-4e59-9acc-7a7ddb15657c nodeName:}" failed. No retries permitted until 2026-05-21 15:32:25.440852341 +0000 UTC m=+6.161014860 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kpvz" (UniqueName: "kubernetes.io/projected/611783df-c519-4e59-9acc-7a7ddb15657c-kube-api-access-7kpvz") pod "network-check-target-qbcqg" (UID: "611783df-c519-4e59-9acc-7a7ddb15657c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:32:23.842360 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:23.841764    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:23.842360 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:23.841891    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbcqg" podUID="611783df-c519-4e59-9acc-7a7ddb15657c"
May 21 15:32:23.891383 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:23.891320    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal" event={"ID":"9e228c5909e6d1827c6ff957d470c8bf","Type":"ContainerStarted","Data":"a1b72681a16ce61f7b6964655d29dbb928f76935bef4c886eb0032a6f32b1276"}
May 21 15:32:23.908706 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:23.908115    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-73.ec2.internal" podStartSLOduration=2.908095318 podStartE2EDuration="2.908095318s" podCreationTimestamp="2026-05-21 15:32:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:32:23.907970816 +0000 UTC m=+4.628133355" watchObservedRunningTime="2026-05-21 15:32:23.908095318 +0000 UTC m=+4.628257912"
May 21 15:32:24.841528 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:24.841494    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:24.841766 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:24.841734    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7ttm" podUID="a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0"
May 21 15:32:25.459492 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:25.458515    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7kpvz\" (UniqueName: \"kubernetes.io/projected/611783df-c519-4e59-9acc-7a7ddb15657c-kube-api-access-7kpvz\") pod \"network-check-target-qbcqg\" (UID: \"611783df-c519-4e59-9acc-7a7ddb15657c\") " pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:25.459492 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:25.458585    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs\") pod \"network-metrics-daemon-x7ttm\" (UID: \"a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0\") " pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:25.459492 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:25.458840    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:32:25.459492 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:25.458907    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs podName:a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:29.458886905 +0000 UTC m=+10.179049444 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs") pod "network-metrics-daemon-x7ttm" (UID: "a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:32:25.459492 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:25.459379    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 15:32:25.459492 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:25.459397    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 15:32:25.459492 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:25.459411    2552 projected.go:194] Error preparing data for projected volume kube-api-access-7kpvz for pod openshift-network-diagnostics/network-check-target-qbcqg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:32:25.459492 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:25.459456    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/611783df-c519-4e59-9acc-7a7ddb15657c-kube-api-access-7kpvz podName:611783df-c519-4e59-9acc-7a7ddb15657c nodeName:}" failed. No retries permitted until 2026-05-21 15:32:29.459442094 +0000 UTC m=+10.179604614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kpvz" (UniqueName: "kubernetes.io/projected/611783df-c519-4e59-9acc-7a7ddb15657c-kube-api-access-7kpvz") pod "network-check-target-qbcqg" (UID: "611783df-c519-4e59-9acc-7a7ddb15657c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:32:25.843150 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:25.841809    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:25.843150 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:25.841971    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbcqg" podUID="611783df-c519-4e59-9acc-7a7ddb15657c"
May 21 15:32:26.841711 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:26.841674    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:26.842159 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:26.841809    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7ttm" podUID="a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0"
May 21 15:32:27.841386 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:27.841354    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:27.841555 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:27.841482    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbcqg" podUID="611783df-c519-4e59-9acc-7a7ddb15657c"
May 21 15:32:28.841242 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:28.841203    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:28.841782 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:28.841368    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7ttm" podUID="a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0"
May 21 15:32:29.491474 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:29.491431    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7kpvz\" (UniqueName: \"kubernetes.io/projected/611783df-c519-4e59-9acc-7a7ddb15657c-kube-api-access-7kpvz\") pod \"network-check-target-qbcqg\" (UID: \"611783df-c519-4e59-9acc-7a7ddb15657c\") " pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:29.491653 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:29.491508    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs\") pod \"network-metrics-daemon-x7ttm\" (UID: \"a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0\") " pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:29.491653 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:29.491647    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:32:29.491765 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:29.491718    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs podName:a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:37.491697232 +0000 UTC m=+18.211859757 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs") pod "network-metrics-daemon-x7ttm" (UID: "a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:32:29.491831 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:29.491805    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 15:32:29.491831 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:29.491820    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 15:32:29.491920 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:29.491833    2552 projected.go:194] Error preparing data for projected volume kube-api-access-7kpvz for pod openshift-network-diagnostics/network-check-target-qbcqg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:32:29.491920 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:29.491869    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/611783df-c519-4e59-9acc-7a7ddb15657c-kube-api-access-7kpvz podName:611783df-c519-4e59-9acc-7a7ddb15657c nodeName:}" failed. No retries permitted until 2026-05-21 15:32:37.491857625 +0000 UTC m=+18.212020145 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kpvz" (UniqueName: "kubernetes.io/projected/611783df-c519-4e59-9acc-7a7ddb15657c-kube-api-access-7kpvz") pod "network-check-target-qbcqg" (UID: "611783df-c519-4e59-9acc-7a7ddb15657c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:32:29.842850 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:29.842337    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:29.842850 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:29.842454    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbcqg" podUID="611783df-c519-4e59-9acc-7a7ddb15657c"
May 21 15:32:30.841774 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:30.841731    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:30.841955 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:30.841875    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7ttm" podUID="a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0"
May 21 15:32:31.841945 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:31.841913    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:31.842378 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:31.842032    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbcqg" podUID="611783df-c519-4e59-9acc-7a7ddb15657c"
May 21 15:32:32.841836 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:32.841800    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:32.842001 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:32.841932    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7ttm" podUID="a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0"
May 21 15:32:33.841150 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:33.841117    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:33.841345 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:33.841240    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbcqg" podUID="611783df-c519-4e59-9acc-7a7ddb15657c"
May 21 15:32:34.841912 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:34.841876    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:34.842406 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:34.841997    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7ttm" podUID="a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0"
May 21 15:32:35.841491 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:35.841453    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:35.841681 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:35.841589    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbcqg" podUID="611783df-c519-4e59-9acc-7a7ddb15657c"
May 21 15:32:36.842004 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:36.841968    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:36.842436 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:36.842097    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7ttm" podUID="a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0"
May 21 15:32:37.545187 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:37.545099    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs\") pod \"network-metrics-daemon-x7ttm\" (UID: \"a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0\") " pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:37.545187 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:37.545176    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7kpvz\" (UniqueName: \"kubernetes.io/projected/611783df-c519-4e59-9acc-7a7ddb15657c-kube-api-access-7kpvz\") pod \"network-check-target-qbcqg\" (UID: \"611783df-c519-4e59-9acc-7a7ddb15657c\") " pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:37.545403 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:37.545228    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:32:37.545403 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:37.545395    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs podName:a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:53.545373728 +0000 UTC m=+34.265536469 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs") pod "network-metrics-daemon-x7ttm" (UID: "a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:32:37.545537 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:37.545517    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 15:32:37.545593 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:37.545546    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 15:32:37.545593 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:37.545562    2552 projected.go:194] Error preparing data for projected volume kube-api-access-7kpvz for pod openshift-network-diagnostics/network-check-target-qbcqg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:32:37.545709 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:37.545690    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/611783df-c519-4e59-9acc-7a7ddb15657c-kube-api-access-7kpvz podName:611783df-c519-4e59-9acc-7a7ddb15657c nodeName:}" failed. No retries permitted until 2026-05-21 15:32:53.545605159 +0000 UTC m=+34.265767676 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kpvz" (UniqueName: "kubernetes.io/projected/611783df-c519-4e59-9acc-7a7ddb15657c-kube-api-access-7kpvz") pod "network-check-target-qbcqg" (UID: "611783df-c519-4e59-9acc-7a7ddb15657c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:32:37.842120 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:37.842031    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:37.842586 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:37.842182    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbcqg" podUID="611783df-c519-4e59-9acc-7a7ddb15657c"
May 21 15:32:38.840987 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:38.840952    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:38.841161 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:38.841089    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7ttm" podUID="a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0"
May 21 15:32:39.842270 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:39.842224    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:39.842734 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:39.842338    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbcqg" podUID="611783df-c519-4e59-9acc-7a7ddb15657c"
May 21 15:32:40.841280 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:40.840946    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:40.841389 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:40.841370    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7ttm" podUID="a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0"
May 21 15:32:40.926326 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:40.926286    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cglf2" event={"ID":"071a38d4-2377-4a03-b258-06c9d1751226","Type":"ContainerStarted","Data":"fc67637a5b23e8a997c405f59bcde1ccb9b0bada7fa0c96aa0ed820bfecebe52"}
May 21 15:32:40.927706 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:40.927669    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2475j" event={"ID":"f35e19d1-88d3-4e8d-82de-1531dff0c058","Type":"ContainerStarted","Data":"926e3643eb83fc1772bf524320b3fcf623308146fdc75364c9dc397919c0dcec"}
May 21 15:32:40.929165 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:40.929140    2552 generic.go:358] "Generic (PLEG): container finished" podID="7e482850-fd92-4d57-a98e-522e62d88ffa" containerID="9e595d8606e6c142d683e7f3dba845e49289aee0940b524319253f8cbe7b439c" exitCode=0
May 21 15:32:40.929306 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:40.929231    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6f6l" event={"ID":"7e482850-fd92-4d57-a98e-522e62d88ffa","Type":"ContainerDied","Data":"9e595d8606e6c142d683e7f3dba845e49289aee0940b524319253f8cbe7b439c"}
May 21 15:32:40.932156 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:40.932134    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-479rw" event={"ID":"51dfd7d4-035e-4e8a-9b2a-efd072576313","Type":"ContainerStarted","Data":"e823783fac71c8f7baf2f4a044e5c510df7c2b5c4323790d2af1dfef6af03c31"}
May 21 15:32:40.932220 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:40.932162    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-479rw" event={"ID":"51dfd7d4-035e-4e8a-9b2a-efd072576313","Type":"ContainerStarted","Data":"fdadf274244b6fda460fcfe874dfcbf332dececea02e61e93c7a03a46509894e"}
May 21 15:32:40.932220 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:40.932173    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-479rw" event={"ID":"51dfd7d4-035e-4e8a-9b2a-efd072576313","Type":"ContainerStarted","Data":"7bc1510ab21a98cd374c15da045ee33ccd92f99dbcb0e57339b56753cfe4a65a"}
May 21 15:32:40.932220 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:40.932181    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-479rw" event={"ID":"51dfd7d4-035e-4e8a-9b2a-efd072576313","Type":"ContainerStarted","Data":"9c67b78068f02006d26c4eac7ebc040e02c4fc10cfd65c2dd515dbbc7722cf6a"}
May 21 15:32:40.932220 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:40.932189    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-479rw" event={"ID":"51dfd7d4-035e-4e8a-9b2a-efd072576313","Type":"ContainerStarted","Data":"e54256fafdd9ff78b65b7da5340573c65292ace9ee11c6376a7c62b4da6f25b2"}
May 21 15:32:40.932220 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:40.932197    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-479rw" event={"ID":"51dfd7d4-035e-4e8a-9b2a-efd072576313","Type":"ContainerStarted","Data":"c293beef60e68de138122136b61a255aef1beca4c3fc27a46a12965218eb7e41"}
May 21 15:32:40.933535 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:40.933504    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2pdz5" event={"ID":"db3f5fed-a552-4838-9ad1-4eb27878ca68","Type":"ContainerStarted","Data":"e0b937ebabd7fc826fe84e86ffa0074001be4cf0bbad93d29dbd34668b3fe2e1"}
May 21 15:32:40.934803 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:40.934772    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-llrkc" event={"ID":"2fa2fd89-b648-4985-a97e-cc9cd1b37867","Type":"ContainerStarted","Data":"a1d1a2bd54620d9642ed51dea2425555487f75f9d71476811d0f0ce6fb6b23d1"}
May 21 15:32:40.936068 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:40.936040    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l6g95" event={"ID":"3ef54bf7-c851-42e8-ab07-955a73e57e37","Type":"ContainerStarted","Data":"3adb09544dfefa5e781583a11ce6c172c7dca11b5e845aac00f8f1784fd37aac"}
May 21 15:32:40.937601 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:40.937581    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr" event={"ID":"9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5","Type":"ContainerStarted","Data":"8f67da49fa7eb2b021b98766d712593d16ffb20377a8c68faed055eb37acba1a"}
May 21 15:32:40.945614 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:40.945574    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-cglf2" podStartSLOduration=2.995052246 podStartE2EDuration="20.945563884s" podCreationTimestamp="2026-05-21 15:32:20 +0000 UTC" firstStartedPulling="2026-05-21 15:32:22.463066309 +0000 UTC m=+3.183228831" lastFinishedPulling="2026-05-21 15:32:40.413577941 +0000 UTC m=+21.133740469" observedRunningTime="2026-05-21 15:32:40.945225209 +0000 UTC m=+21.665387762" watchObservedRunningTime="2026-05-21 15:32:40.945563884 +0000 UTC m=+21.665726422"
May 21 15:32:40.959564 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:40.959522    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-l6g95" podStartSLOduration=8.761279581 podStartE2EDuration="21.959510425s" podCreationTimestamp="2026-05-21 15:32:19 +0000 UTC" firstStartedPulling="2026-05-21 15:32:22.467630165 +0000 UTC m=+3.187792682" lastFinishedPulling="2026-05-21 15:32:35.66586101 +0000 UTC m=+16.386023526" observedRunningTime="2026-05-21 15:32:40.959106726 +0000 UTC m=+21.679269267" watchObservedRunningTime="2026-05-21 15:32:40.959510425 +0000 UTC m=+21.679672964"
May 21 15:32:40.973557 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:40.973472    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2pdz5" podStartSLOduration=8.772157353 podStartE2EDuration="21.973458747s" podCreationTimestamp="2026-05-21 15:32:19 +0000 UTC" firstStartedPulling="2026-05-21 15:32:22.464600448 +0000 UTC m=+3.184762966" lastFinishedPulling="2026-05-21 15:32:35.665901844 +0000 UTC m=+16.386064360" observedRunningTime="2026-05-21 15:32:40.973026769 +0000 UTC m=+21.693189306" watchObservedRunningTime="2026-05-21 15:32:40.973458747 +0000 UTC m=+21.693621284"
May 21 15:32:41.008037 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:41.007991    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2475j" podStartSLOduration=8.800618765 podStartE2EDuration="22.007976969s" podCreationTimestamp="2026-05-21 15:32:19 +0000 UTC" firstStartedPulling="2026-05-21 15:32:22.458582127 +0000 UTC m=+3.178744657" lastFinishedPulling="2026-05-21 15:32:35.665940345 +0000 UTC m=+16.386102861" observedRunningTime="2026-05-21 15:32:40.986575221 +0000 UTC m=+21.706737760" watchObservedRunningTime="2026-05-21 15:32:41.007976969 +0000 UTC m=+21.728139507"
May 21 15:32:41.025184 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:41.025138    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-llrkc" podStartSLOduration=3.100567685 podStartE2EDuration="21.025125913s" podCreationTimestamp="2026-05-21 15:32:20 +0000 UTC" firstStartedPulling="2026-05-21 15:32:22.464786556 +0000 UTC m=+3.184949074" lastFinishedPulling="2026-05-21 15:32:40.389344786 +0000 UTC m=+21.109507302" observedRunningTime="2026-05-21 15:32:41.025075195 +0000 UTC m=+21.745237735" watchObservedRunningTime="2026-05-21 15:32:41.025125913 +0000 UTC m=+21.745288450"
May 21 15:32:41.703489 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:41.703458    2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 21 15:32:41.779727 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:41.779595    2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T15:32:41.70347893Z","UUID":"83c504af-9be4-4fd9-8375-12dfee879d37","Handler":null,"Name":"","Endpoint":""}
May 21 15:32:41.782546 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:41.782526    2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 21 15:32:41.782546 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:41.782549    2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 21 15:32:41.841539 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:41.841513    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:41.841721 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:41.841624    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbcqg" podUID="611783df-c519-4e59-9acc-7a7ddb15657c"
May 21 15:32:41.940815 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:41.940724    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr" event={"ID":"9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5","Type":"ContainerStarted","Data":"3a55b83294597db4dc4e6b56c7f5105d0dd01870f5d4069d3bf4c38d2cb93545"}
May 21 15:32:41.941985 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:41.941895    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6dlwn" event={"ID":"1cfc65e3-1d41-4a4a-96d4-3f3a53a45f08","Type":"ContainerStarted","Data":"288d7f6006f428ebb0e2f793d4de0520423275b831c2a10f5c30d2c6b1cc4883"}
May 21 15:32:42.222651 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:42.222569    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2pdz5"
May 21 15:32:42.223227 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:42.223200    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2pdz5"
May 21 15:32:42.240894 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:42.240847    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6dlwn" podStartSLOduration=4.493888522 podStartE2EDuration="22.240829313s" podCreationTimestamp="2026-05-21 15:32:20 +0000 UTC" firstStartedPulling="2026-05-21 15:32:22.460947086 +0000 UTC m=+3.181109613" lastFinishedPulling="2026-05-21 15:32:40.207887875 +0000 UTC m=+20.928050404" observedRunningTime="2026-05-21 15:32:41.958382935 +0000 UTC m=+22.678545474" watchObservedRunningTime="2026-05-21 15:32:42.240829313 +0000 UTC m=+22.960991852"
May 21 15:32:42.841740 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:42.841655    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:42.841905 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:42.841788    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7ttm" podUID="a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0"
May 21 15:32:42.946045 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:42.946016    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr" event={"ID":"9a4f72f5-6372-4649-bb8a-7f2c24dfa0c5","Type":"ContainerStarted","Data":"283a878e3ff5c6331c4b7e6a6a0b3398f2e9c57182076cd0dd0d6eedec9aff64"}
May 21 15:32:42.946498 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:42.946248    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2pdz5"
May 21 15:32:42.946746 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:42.946726    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2pdz5"
May 21 15:32:42.963323 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:42.963283    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8b7rr" podStartSLOduration=2.892050114 podStartE2EDuration="22.963248548s" podCreationTimestamp="2026-05-21 15:32:20 +0000 UTC" firstStartedPulling="2026-05-21 15:32:22.465487215 +0000 UTC m=+3.185649746" lastFinishedPulling="2026-05-21 15:32:42.536685664 +0000 UTC m=+23.256848180" observedRunningTime="2026-05-21 15:32:42.962934606 +0000 UTC m=+23.683097157" watchObservedRunningTime="2026-05-21 15:32:42.963248548 +0000 UTC m=+23.683411086"
May 21 15:32:43.841585 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:43.841552    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:43.841761 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:43.841652    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbcqg" podUID="611783df-c519-4e59-9acc-7a7ddb15657c"
May 21 15:32:43.950728 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:43.950688    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-479rw" event={"ID":"51dfd7d4-035e-4e8a-9b2a-efd072576313","Type":"ContainerStarted","Data":"2f14c7fe343da72b995a1e4778e2d26a85a74b8848ae66d91e3b12966c7f4644"}
May 21 15:32:44.841991 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:44.841952    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:44.842201 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:44.842093    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7ttm" podUID="a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0"
May 21 15:32:45.841733 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:45.841551    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:45.842475 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:45.841815    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbcqg" podUID="611783df-c519-4e59-9acc-7a7ddb15657c"
May 21 15:32:45.957313 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:45.957275    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-479rw" event={"ID":"51dfd7d4-035e-4e8a-9b2a-efd072576313","Type":"ContainerStarted","Data":"277cb3d430eab3d1d9af7aa1fcd5a06eef6f37c61d3e90c83e1cd8487d20da42"}
May 21 15:32:45.957611 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:45.957588    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:45.957699 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:45.957623    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:45.973498 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:45.973472    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:45.984895 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:45.984840    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-479rw" podStartSLOduration=8.960118914 podStartE2EDuration="26.984823263s" podCreationTimestamp="2026-05-21 15:32:19 +0000 UTC" firstStartedPulling="2026-05-21 15:32:22.469050103 +0000 UTC m=+3.189212622" lastFinishedPulling="2026-05-21 15:32:40.49375445 +0000 UTC m=+21.213916971" observedRunningTime="2026-05-21 15:32:45.984116038 +0000 UTC m=+26.704278585" watchObservedRunningTime="2026-05-21 15:32:45.984823263 +0000 UTC m=+26.704985802"
May 21 15:32:46.841887 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:46.841694    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:46.842420 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:46.842000    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7ttm" podUID="a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0"
May 21 15:32:46.959690 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:46.959636    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:46.973975 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:46.973944    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qbcqg"]
May 21 15:32:46.974122 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:46.974059    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:46.974196 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:46.974161    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbcqg" podUID="611783df-c519-4e59-9acc-7a7ddb15657c"
May 21 15:32:46.979037 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:46.979015    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:32:46.985191 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:46.985168    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x7ttm"]
May 21 15:32:46.985319 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:46.985245    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:46.985377 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:46.985346    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7ttm" podUID="a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0"
May 21 15:32:48.841397 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:48.841355    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:48.841831 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:48.841365    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:48.841831 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:48.841498    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbcqg" podUID="611783df-c519-4e59-9acc-7a7ddb15657c"
May 21 15:32:48.841831 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:48.841657    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7ttm" podUID="a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0"
May 21 15:32:49.965465 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:49.965432    2552 generic.go:358] "Generic (PLEG): container finished" podID="7e482850-fd92-4d57-a98e-522e62d88ffa" containerID="7e2ea52335176871b3000d06868413f5a32942bb9c926357e2053c838dfdeb15" exitCode=0
May 21 15:32:49.965870 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:49.965487    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6f6l" event={"ID":"7e482850-fd92-4d57-a98e-522e62d88ffa","Type":"ContainerDied","Data":"7e2ea52335176871b3000d06868413f5a32942bb9c926357e2053c838dfdeb15"}
May 21 15:32:50.841277 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:50.841241    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:50.841434 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:50.841241    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:50.841434 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:50.841386    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7ttm" podUID="a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0"
May 21 15:32:50.841501 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:50.841465    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbcqg" podUID="611783df-c519-4e59-9acc-7a7ddb15657c"
May 21 15:32:51.970522 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:51.970491    2552 generic.go:358] "Generic (PLEG): container finished" podID="7e482850-fd92-4d57-a98e-522e62d88ffa" containerID="3f3072f354d5170aea979ad5447d62fb99c450c74262a7103296b736f674abb5" exitCode=0
May 21 15:32:51.970899 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:51.970553    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6f6l" event={"ID":"7e482850-fd92-4d57-a98e-522e62d88ffa","Type":"ContainerDied","Data":"3f3072f354d5170aea979ad5447d62fb99c450c74262a7103296b736f674abb5"}
May 21 15:32:52.841733 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:52.841550    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:52.841920 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:52.841609    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:52.841920 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:52.841815    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbcqg" podUID="611783df-c519-4e59-9acc-7a7ddb15657c"
May 21 15:32:52.841920 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:52.841881    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x7ttm" podUID="a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0"
May 21 15:32:53.139329 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.139303    2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-73.ec2.internal" event="NodeReady"
May 21 15:32:53.139747 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.139462    2552 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 21 15:32:53.182935 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.182907    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-frrjc"]
May 21 15:32:53.215687 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.215661    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-79k9q"]
May 21 15:32:53.215846 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.215824    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-frrjc"
May 21 15:32:53.218452 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.218424    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 21 15:32:53.218452 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.218447    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 21 15:32:53.218713 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.218498    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5bcp9\""
May 21 15:32:53.235793 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.235770    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-frrjc"]
May 21 15:32:53.235793 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.235794    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-79k9q"]
May 21 15:32:53.235947 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.235909    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-79k9q"
May 21 15:32:53.238475 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.238452    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2wggx\""
May 21 15:32:53.238578 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.238478    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 21 15:32:53.238578 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.238492    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 21 15:32:53.238578 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.238529    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 21 15:32:53.358769 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.358732    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/048c373f-4ec1-416d-9720-992cc8c4a7d7-tmp-dir\") pod \"dns-default-frrjc\" (UID: \"048c373f-4ec1-416d-9720-992cc8c4a7d7\") " pod="openshift-dns/dns-default-frrjc"
May 21 15:32:53.358932 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.358785    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert\") pod \"ingress-canary-79k9q\" (UID: \"c5ac7608-600f-40c3-96e3-7d09db3d0aeb\") " pod="openshift-ingress-canary/ingress-canary-79k9q"
May 21 15:32:53.358932 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.358850    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls\") pod \"dns-default-frrjc\" (UID: \"048c373f-4ec1-416d-9720-992cc8c4a7d7\") " pod="openshift-dns/dns-default-frrjc"
May 21 15:32:53.358932 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.358892    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtjs7\" (UniqueName: \"kubernetes.io/projected/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-kube-api-access-jtjs7\") pod \"ingress-canary-79k9q\" (UID: \"c5ac7608-600f-40c3-96e3-7d09db3d0aeb\") " pod="openshift-ingress-canary/ingress-canary-79k9q"
May 21 15:32:53.358932 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.358914    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/048c373f-4ec1-416d-9720-992cc8c4a7d7-config-volume\") pod \"dns-default-frrjc\" (UID: \"048c373f-4ec1-416d-9720-992cc8c4a7d7\") " pod="openshift-dns/dns-default-frrjc"
May 21 15:32:53.359060 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.358959    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klrmj\" (UniqueName: \"kubernetes.io/projected/048c373f-4ec1-416d-9720-992cc8c4a7d7-kube-api-access-klrmj\") pod \"dns-default-frrjc\" (UID: \"048c373f-4ec1-416d-9720-992cc8c4a7d7\") " pod="openshift-dns/dns-default-frrjc"
May 21 15:32:53.459737 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.459710    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/048c373f-4ec1-416d-9720-992cc8c4a7d7-tmp-dir\") pod \"dns-default-frrjc\" (UID: \"048c373f-4ec1-416d-9720-992cc8c4a7d7\") " pod="openshift-dns/dns-default-frrjc"
May 21 15:32:53.459832 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.459761    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert\") pod \"ingress-canary-79k9q\" (UID: \"c5ac7608-600f-40c3-96e3-7d09db3d0aeb\") " pod="openshift-ingress-canary/ingress-canary-79k9q"
May 21 15:32:53.459832 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.459793    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls\") pod \"dns-default-frrjc\" (UID: \"048c373f-4ec1-416d-9720-992cc8c4a7d7\") " pod="openshift-dns/dns-default-frrjc"
May 21 15:32:53.459832 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.459813    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jtjs7\" (UniqueName: \"kubernetes.io/projected/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-kube-api-access-jtjs7\") pod \"ingress-canary-79k9q\" (UID: \"c5ac7608-600f-40c3-96e3-7d09db3d0aeb\") " pod="openshift-ingress-canary/ingress-canary-79k9q"
May 21 15:32:53.459943 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.459831    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/048c373f-4ec1-416d-9720-992cc8c4a7d7-config-volume\") pod \"dns-default-frrjc\" (UID: \"048c373f-4ec1-416d-9720-992cc8c4a7d7\") " pod="openshift-dns/dns-default-frrjc"
May 21 15:32:53.459943 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.459927    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-klrmj\" (UniqueName: \"kubernetes.io/projected/048c373f-4ec1-416d-9720-992cc8c4a7d7-kube-api-access-klrmj\") pod \"dns-default-frrjc\" (UID: \"048c373f-4ec1-416d-9720-992cc8c4a7d7\") " pod="openshift-dns/dns-default-frrjc"
May 21 15:32:53.460039 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:53.459941    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 15:32:53.460039 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:53.459975    2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 15:32:53.460039 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:53.459995    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls podName:048c373f-4ec1-416d-9720-992cc8c4a7d7 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:53.959980239 +0000 UTC m=+34.680142760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls") pod "dns-default-frrjc" (UID: "048c373f-4ec1-416d-9720-992cc8c4a7d7") : secret "dns-default-metrics-tls" not found
May 21 15:32:53.460156 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:53.460037    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert podName:c5ac7608-600f-40c3-96e3-7d09db3d0aeb nodeName:}" failed. No retries permitted until 2026-05-21 15:32:53.960017892 +0000 UTC m=+34.680180415 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert") pod "ingress-canary-79k9q" (UID: "c5ac7608-600f-40c3-96e3-7d09db3d0aeb") : secret "canary-serving-cert" not found
May 21 15:32:53.460156 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.460042    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/048c373f-4ec1-416d-9720-992cc8c4a7d7-tmp-dir\") pod \"dns-default-frrjc\" (UID: \"048c373f-4ec1-416d-9720-992cc8c4a7d7\") " pod="openshift-dns/dns-default-frrjc"
May 21 15:32:53.460527 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.460511    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/048c373f-4ec1-416d-9720-992cc8c4a7d7-config-volume\") pod \"dns-default-frrjc\" (UID: \"048c373f-4ec1-416d-9720-992cc8c4a7d7\") " pod="openshift-dns/dns-default-frrjc"
May 21 15:32:53.470191 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.470166    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klrmj\" (UniqueName: \"kubernetes.io/projected/048c373f-4ec1-416d-9720-992cc8c4a7d7-kube-api-access-klrmj\") pod \"dns-default-frrjc\" (UID: \"048c373f-4ec1-416d-9720-992cc8c4a7d7\") " pod="openshift-dns/dns-default-frrjc"
May 21 15:32:53.470427 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.470409    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtjs7\" (UniqueName: \"kubernetes.io/projected/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-kube-api-access-jtjs7\") pod \"ingress-canary-79k9q\" (UID: \"c5ac7608-600f-40c3-96e3-7d09db3d0aeb\") " pod="openshift-ingress-canary/ingress-canary-79k9q"
May 21 15:32:53.560614 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.560572    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs\") pod \"network-metrics-daemon-x7ttm\" (UID: \"a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0\") " pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:53.560807 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.560644    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7kpvz\" (UniqueName: \"kubernetes.io/projected/611783df-c519-4e59-9acc-7a7ddb15657c-kube-api-access-7kpvz\") pod \"network-check-target-qbcqg\" (UID: \"611783df-c519-4e59-9acc-7a7ddb15657c\") " pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:53.560807 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:53.560731    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:32:53.560807 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:53.560763    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 15:32:53.560807 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:53.560787    2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 15:32:53.560807 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:53.560799    2552 projected.go:194] Error preparing data for projected volume kube-api-access-7kpvz for pod openshift-network-diagnostics/network-check-target-qbcqg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:32:53.561003 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:53.560799    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs podName:a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0 nodeName:}" failed. No retries permitted until 2026-05-21 15:33:25.5607838 +0000 UTC m=+66.280946316 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs") pod "network-metrics-daemon-x7ttm" (UID: "a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:32:53.561003 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:53.560858    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/611783df-c519-4e59-9acc-7a7ddb15657c-kube-api-access-7kpvz podName:611783df-c519-4e59-9acc-7a7ddb15657c nodeName:}" failed. No retries permitted until 2026-05-21 15:33:25.560841776 +0000 UTC m=+66.281004305 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kpvz" (UniqueName: "kubernetes.io/projected/611783df-c519-4e59-9acc-7a7ddb15657c-kube-api-access-7kpvz") pod "network-check-target-qbcqg" (UID: "611783df-c519-4e59-9acc-7a7ddb15657c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:32:53.963499 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.963468    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls\") pod \"dns-default-frrjc\" (UID: \"048c373f-4ec1-416d-9720-992cc8c4a7d7\") " pod="openshift-dns/dns-default-frrjc"
May 21 15:32:53.963651 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.963548    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert\") pod \"ingress-canary-79k9q\" (UID: \"c5ac7608-600f-40c3-96e3-7d09db3d0aeb\") " pod="openshift-ingress-canary/ingress-canary-79k9q"
May 21 15:32:53.963651 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:53.963622    2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 15:32:53.963725 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:53.963669    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert podName:c5ac7608-600f-40c3-96e3-7d09db3d0aeb nodeName:}" failed. No retries permitted until 2026-05-21 15:32:54.963656303 +0000 UTC m=+35.683818819 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert") pod "ingress-canary-79k9q" (UID: "c5ac7608-600f-40c3-96e3-7d09db3d0aeb") : secret "canary-serving-cert" not found
May 21 15:32:53.963725 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:53.963622    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 15:32:53.963725 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:53.963698    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls podName:048c373f-4ec1-416d-9720-992cc8c4a7d7 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:54.963692102 +0000 UTC m=+35.683854617 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls") pod "dns-default-frrjc" (UID: "048c373f-4ec1-416d-9720-992cc8c4a7d7") : secret "dns-default-metrics-tls" not found
May 21 15:32:53.976153 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.976118    2552 generic.go:358] "Generic (PLEG): container finished" podID="7e482850-fd92-4d57-a98e-522e62d88ffa" containerID="471a1619bad6983b6d2a54356708bdc9ee3f251ff0c339501b8ffe30631f713f" exitCode=0
May 21 15:32:53.976320 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:53.976183    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6f6l" event={"ID":"7e482850-fd92-4d57-a98e-522e62d88ffa","Type":"ContainerDied","Data":"471a1619bad6983b6d2a54356708bdc9ee3f251ff0c339501b8ffe30631f713f"}
May 21 15:32:54.841295 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:54.841235    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:32:54.841295 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:54.841301    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:32:54.844051 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:54.844029    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 15:32:54.844901 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:54.844870    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qfdh8\""
May 21 15:32:54.844901 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:54.844884    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 15:32:54.844901 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:54.844894    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 15:32:54.845125 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:54.844932    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nkbpk\""
May 21 15:32:54.969496 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:54.969463    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert\") pod \"ingress-canary-79k9q\" (UID: \"c5ac7608-600f-40c3-96e3-7d09db3d0aeb\") " pod="openshift-ingress-canary/ingress-canary-79k9q"
May 21 15:32:54.969661 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:54.969512    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls\") pod \"dns-default-frrjc\" (UID: \"048c373f-4ec1-416d-9720-992cc8c4a7d7\") " pod="openshift-dns/dns-default-frrjc"
May 21 15:32:54.969661 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:54.969632    2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 15:32:54.969734 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:54.969704    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert podName:c5ac7608-600f-40c3-96e3-7d09db3d0aeb nodeName:}" failed. No retries permitted until 2026-05-21 15:32:56.969689889 +0000 UTC m=+37.689852405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert") pod "ingress-canary-79k9q" (UID: "c5ac7608-600f-40c3-96e3-7d09db3d0aeb") : secret "canary-serving-cert" not found
May 21 15:32:54.969734 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:54.969632    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 15:32:54.969803 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:54.969769    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls podName:048c373f-4ec1-416d-9720-992cc8c4a7d7 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:56.969757601 +0000 UTC m=+37.689920133 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls") pod "dns-default-frrjc" (UID: "048c373f-4ec1-416d-9720-992cc8c4a7d7") : secret "dns-default-metrics-tls" not found
May 21 15:32:56.986317 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:56.986275    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert\") pod \"ingress-canary-79k9q\" (UID: \"c5ac7608-600f-40c3-96e3-7d09db3d0aeb\") " pod="openshift-ingress-canary/ingress-canary-79k9q"
May 21 15:32:56.986916 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:32:56.986342    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls\") pod \"dns-default-frrjc\" (UID: \"048c373f-4ec1-416d-9720-992cc8c4a7d7\") " pod="openshift-dns/dns-default-frrjc"
May 21 15:32:56.986916 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:56.986405    2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 15:32:56.986916 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:56.986478    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert podName:c5ac7608-600f-40c3-96e3-7d09db3d0aeb nodeName:}" failed. No retries permitted until 2026-05-21 15:33:00.986456622 +0000 UTC m=+41.706619144 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert") pod "ingress-canary-79k9q" (UID: "c5ac7608-600f-40c3-96e3-7d09db3d0aeb") : secret "canary-serving-cert" not found
May 21 15:32:56.986916 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:56.986495    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 15:32:56.986916 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:32:56.986548    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls podName:048c373f-4ec1-416d-9720-992cc8c4a7d7 nodeName:}" failed. No retries permitted until 2026-05-21 15:33:00.986532235 +0000 UTC m=+41.706694767 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls") pod "dns-default-frrjc" (UID: "048c373f-4ec1-416d-9720-992cc8c4a7d7") : secret "dns-default-metrics-tls" not found
May 21 15:33:01.017620 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:01.017582    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert\") pod \"ingress-canary-79k9q\" (UID: \"c5ac7608-600f-40c3-96e3-7d09db3d0aeb\") " pod="openshift-ingress-canary/ingress-canary-79k9q"
May 21 15:33:01.017620 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:01.017621    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls\") pod \"dns-default-frrjc\" (UID: \"048c373f-4ec1-416d-9720-992cc8c4a7d7\") " pod="openshift-dns/dns-default-frrjc"
May 21 15:33:01.018037 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:01.017725    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 15:33:01.018037 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:01.017744    2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 15:33:01.018037 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:01.017777    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls podName:048c373f-4ec1-416d-9720-992cc8c4a7d7 nodeName:}" failed. No retries permitted until 2026-05-21 15:33:09.017763575 +0000 UTC m=+49.737926091 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls") pod "dns-default-frrjc" (UID: "048c373f-4ec1-416d-9720-992cc8c4a7d7") : secret "dns-default-metrics-tls" not found
May 21 15:33:01.018037 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:01.017807    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert podName:c5ac7608-600f-40c3-96e3-7d09db3d0aeb nodeName:}" failed. No retries permitted until 2026-05-21 15:33:09.01779374 +0000 UTC m=+49.737956257 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert") pod "ingress-canary-79k9q" (UID: "c5ac7608-600f-40c3-96e3-7d09db3d0aeb") : secret "canary-serving-cert" not found
May 21 15:33:01.993938 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:01.993894    2552 generic.go:358] "Generic (PLEG): container finished" podID="7e482850-fd92-4d57-a98e-522e62d88ffa" containerID="a192c8c9bb7d1b460832b0cd6b582cfb22a28885d433294f9d6ebea405935ef1" exitCode=0
May 21 15:33:01.994118 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:01.993959    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6f6l" event={"ID":"7e482850-fd92-4d57-a98e-522e62d88ffa","Type":"ContainerDied","Data":"a192c8c9bb7d1b460832b0cd6b582cfb22a28885d433294f9d6ebea405935ef1"}
May 21 15:33:02.998898 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:02.998857    2552 generic.go:358] "Generic (PLEG): container finished" podID="7e482850-fd92-4d57-a98e-522e62d88ffa" containerID="69baae34162b75c8c2da37ab10da5265622c6d1cb3e1bf23374107ab9ac61734" exitCode=0
May 21 15:33:02.999386 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:02.998925    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6f6l" event={"ID":"7e482850-fd92-4d57-a98e-522e62d88ffa","Type":"ContainerDied","Data":"69baae34162b75c8c2da37ab10da5265622c6d1cb3e1bf23374107ab9ac61734"}
May 21 15:33:04.003853 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:04.003816    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6f6l" event={"ID":"7e482850-fd92-4d57-a98e-522e62d88ffa","Type":"ContainerStarted","Data":"ff61d8d056b524ef9be156686f7254527d3a2a0787919198cdb62b297a456095"}
May 21 15:33:04.026573 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:04.026271    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-t6f6l" podStartSLOduration=5.453317338 podStartE2EDuration="44.026241175s" podCreationTimestamp="2026-05-21 15:32:20 +0000 UTC" firstStartedPulling="2026-05-21 15:32:22.468893653 +0000 UTC m=+3.189056169" lastFinishedPulling="2026-05-21 15:33:01.04181749 +0000 UTC m=+41.761980006" observedRunningTime="2026-05-21 15:33:04.024771682 +0000 UTC m=+44.744934218" watchObservedRunningTime="2026-05-21 15:33:04.026241175 +0000 UTC m=+44.746403714"
May 21 15:33:09.075438 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:09.075397    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert\") pod \"ingress-canary-79k9q\" (UID: \"c5ac7608-600f-40c3-96e3-7d09db3d0aeb\") " pod="openshift-ingress-canary/ingress-canary-79k9q"
May 21 15:33:09.075438 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:09.075437    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls\") pod \"dns-default-frrjc\" (UID: \"048c373f-4ec1-416d-9720-992cc8c4a7d7\") " pod="openshift-dns/dns-default-frrjc"
May 21 15:33:09.075840 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:09.075540    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 15:33:09.075840 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:09.075542    2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 15:33:09.075840 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:09.075594    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls podName:048c373f-4ec1-416d-9720-992cc8c4a7d7 nodeName:}" failed. No retries permitted until 2026-05-21 15:33:25.075581102 +0000 UTC m=+65.795743618 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls") pod "dns-default-frrjc" (UID: "048c373f-4ec1-416d-9720-992cc8c4a7d7") : secret "dns-default-metrics-tls" not found
May 21 15:33:09.075840 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:09.075608    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert podName:c5ac7608-600f-40c3-96e3-7d09db3d0aeb nodeName:}" failed. No retries permitted until 2026-05-21 15:33:25.075602029 +0000 UTC m=+65.795764545 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert") pod "ingress-canary-79k9q" (UID: "c5ac7608-600f-40c3-96e3-7d09db3d0aeb") : secret "canary-serving-cert" not found
May 21 15:33:18.975159 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:18.975129    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-479rw"
May 21 15:33:25.089560 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:25.089502    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert\") pod \"ingress-canary-79k9q\" (UID: \"c5ac7608-600f-40c3-96e3-7d09db3d0aeb\") " pod="openshift-ingress-canary/ingress-canary-79k9q"
May 21 15:33:25.089560 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:25.089558    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls\") pod \"dns-default-frrjc\" (UID: \"048c373f-4ec1-416d-9720-992cc8c4a7d7\") " pod="openshift-dns/dns-default-frrjc"
May 21 15:33:25.090049 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:25.089658    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 15:33:25.090049 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:25.089665    2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 15:33:25.090049 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:25.089718    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls podName:048c373f-4ec1-416d-9720-992cc8c4a7d7 nodeName:}" failed. No retries permitted until 2026-05-21 15:33:57.089704304 +0000 UTC m=+97.809866820 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls") pod "dns-default-frrjc" (UID: "048c373f-4ec1-416d-9720-992cc8c4a7d7") : secret "dns-default-metrics-tls" not found
May 21 15:33:25.090049 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:25.089764    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert podName:c5ac7608-600f-40c3-96e3-7d09db3d0aeb nodeName:}" failed. No retries permitted until 2026-05-21 15:33:57.089745198 +0000 UTC m=+97.809907732 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert") pod "ingress-canary-79k9q" (UID: "c5ac7608-600f-40c3-96e3-7d09db3d0aeb") : secret "canary-serving-cert" not found
May 21 15:33:25.593130 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:25.593079    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7kpvz\" (UniqueName: \"kubernetes.io/projected/611783df-c519-4e59-9acc-7a7ddb15657c-kube-api-access-7kpvz\") pod \"network-check-target-qbcqg\" (UID: \"611783df-c519-4e59-9acc-7a7ddb15657c\") " pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:33:25.593344 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:25.593155    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs\") pod \"network-metrics-daemon-x7ttm\" (UID: \"a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0\") " pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:33:25.595635 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:25.595617    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 15:33:25.595813 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:25.595791    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 15:33:25.603643 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:25.603625    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 15:33:25.603696 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:25.603685    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs podName:a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0 nodeName:}" failed. No retries permitted until 2026-05-21 15:34:29.603669668 +0000 UTC m=+130.323832188 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs") pod "network-metrics-daemon-x7ttm" (UID: "a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0") : secret "metrics-daemon-secret" not found
May 21 15:33:25.605696 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:25.605679    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 15:33:25.616989 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:25.616957    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kpvz\" (UniqueName: \"kubernetes.io/projected/611783df-c519-4e59-9acc-7a7ddb15657c-kube-api-access-7kpvz\") pod \"network-check-target-qbcqg\" (UID: \"611783df-c519-4e59-9acc-7a7ddb15657c\") " pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:33:25.760964 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:25.760937    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nkbpk\""
May 21 15:33:25.768899 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:25.768875    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:33:25.897657 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:25.897627    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qbcqg"]
May 21 15:33:25.900692 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:33:25.900666    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod611783df_c519_4e59_9acc_7a7ddb15657c.slice/crio-200a61d9aef7aa0c01ae644c862890a27f8c3ab612feb09b708a9141709331c5 WatchSource:0}: Error finding container 200a61d9aef7aa0c01ae644c862890a27f8c3ab612feb09b708a9141709331c5: Status 404 returned error can't find the container with id 200a61d9aef7aa0c01ae644c862890a27f8c3ab612feb09b708a9141709331c5
May 21 15:33:26.045856 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:26.045823    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qbcqg" event={"ID":"611783df-c519-4e59-9acc-7a7ddb15657c","Type":"ContainerStarted","Data":"200a61d9aef7aa0c01ae644c862890a27f8c3ab612feb09b708a9141709331c5"}
May 21 15:33:29.052815 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:29.052775    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qbcqg" event={"ID":"611783df-c519-4e59-9acc-7a7ddb15657c","Type":"ContainerStarted","Data":"9dfc3050a143ec5a0c498c35a2b0627b3150299350d904934d18defb9ac8e7a1"}
May 21 15:33:29.053180 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:29.053011    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:33:29.068907 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:29.068821    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qbcqg" podStartSLOduration=67.162206636 podStartE2EDuration="1m10.068809113s" podCreationTimestamp="2026-05-21 15:32:19 +0000 UTC" firstStartedPulling="2026-05-21 15:33:25.902380495 +0000 UTC m=+66.622543015" lastFinishedPulling="2026-05-21 15:33:28.80898296 +0000 UTC m=+69.529145492" observedRunningTime="2026-05-21 15:33:29.068408831 +0000 UTC m=+69.788571369" watchObservedRunningTime="2026-05-21 15:33:29.068809113 +0000 UTC m=+69.788971652"
May 21 15:33:55.035026 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.034910    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-2mxqr"]
May 21 15:33:55.037541 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.037524    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2mxqr"
May 21 15:33:55.041419 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.041396    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 21 15:33:55.042681 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.042591    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 21 15:33:55.042681 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.042595    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 21 15:33:55.042823 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.042683    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 21 15:33:55.042823 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.042718    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ltbd5\""
May 21 15:33:55.051285 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.051247    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-2mxqr"]
May 21 15:33:55.094913 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.094875    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a9db6ef-d398-4685-b493-d4413f18216b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-2mxqr\" (UID: \"3a9db6ef-d398-4685-b493-d4413f18216b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2mxqr"
May 21 15:33:55.095074 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.094984    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3a9db6ef-d398-4685-b493-d4413f18216b-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-2mxqr\" (UID: \"3a9db6ef-d398-4685-b493-d4413f18216b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2mxqr"
May 21 15:33:55.095074 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.095018    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx4hs\" (UniqueName: \"kubernetes.io/projected/3a9db6ef-d398-4685-b493-d4413f18216b-kube-api-access-rx4hs\") pod \"cluster-monitoring-operator-6c75959455-2mxqr\" (UID: \"3a9db6ef-d398-4685-b493-d4413f18216b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2mxqr"
May 21 15:33:55.150705 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.150674    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-xzpgh"]
May 21 15:33:55.152416 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.152398    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-xzpgh"
May 21 15:33:55.155269 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.155222    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 21 15:33:55.155388 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.155341    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 21 15:33:55.155388 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.155367    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-qhwhm\""
May 21 15:33:55.155476 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.155368    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-6r828"]
May 21 15:33:55.156914 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.156898    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-6r828"
May 21 15:33:55.159282 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.159246    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 21 15:33:55.159436 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.159416    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 21 15:33:55.159666 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.159633    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 21 15:33:55.160094 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.160080    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 21 15:33:55.160555 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.160539    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-krqb5\""
May 21 15:33:55.163669 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.163652    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-xzpgh"]
May 21 15:33:55.165034 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.165015    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 21 15:33:55.170032 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.170009    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-6r828"]
May 21 15:33:55.195633 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.195600    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3a9db6ef-d398-4685-b493-d4413f18216b-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-2mxqr\" (UID: \"3a9db6ef-d398-4685-b493-d4413f18216b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2mxqr"
May 21 15:33:55.195633 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.195645    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rx4hs\" (UniqueName: \"kubernetes.io/projected/3a9db6ef-d398-4685-b493-d4413f18216b-kube-api-access-rx4hs\") pod \"cluster-monitoring-operator-6c75959455-2mxqr\" (UID: \"3a9db6ef-d398-4685-b493-d4413f18216b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2mxqr"
May 21 15:33:55.195828 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.195701    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzs6m\" (UniqueName: \"kubernetes.io/projected/7ea046a2-e402-4da5-8256-363d4c7f6e51-kube-api-access-zzs6m\") pod \"volume-data-source-validator-5cf8c89d64-xzpgh\" (UID: \"7ea046a2-e402-4da5-8256-363d4c7f6e51\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-xzpgh"
May 21 15:33:55.195828 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.195728    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3525871-7436-4b57-b837-22389075c03f-tmp\") pod \"insights-operator-78bdfb888c-6r828\" (UID: \"f3525871-7436-4b57-b837-22389075c03f\") " pod="openshift-insights/insights-operator-78bdfb888c-6r828"
May 21 15:33:55.195828 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.195793    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a9db6ef-d398-4685-b493-d4413f18216b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-2mxqr\" (UID: \"3a9db6ef-d398-4685-b493-d4413f18216b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2mxqr"
May 21 15:33:55.195924 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:55.195867    2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 15:33:55.195924 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.195913    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f3525871-7436-4b57-b837-22389075c03f-serving-cert\") pod \"insights-operator-78bdfb888c-6r828\" (UID: \"f3525871-7436-4b57-b837-22389075c03f\") " pod="openshift-insights/insights-operator-78bdfb888c-6r828"
May 21 15:33:55.195924 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:55.195917    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a9db6ef-d398-4685-b493-d4413f18216b-cluster-monitoring-operator-tls podName:3a9db6ef-d398-4685-b493-d4413f18216b nodeName:}" failed. No retries permitted until 2026-05-21 15:33:55.695902957 +0000 UTC m=+96.416065473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3a9db6ef-d398-4685-b493-d4413f18216b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-2mxqr" (UID: "3a9db6ef-d398-4685-b493-d4413f18216b") : secret "cluster-monitoring-operator-tls" not found
May 21 15:33:55.196039 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.195941    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp9k6\" (UniqueName: \"kubernetes.io/projected/f3525871-7436-4b57-b837-22389075c03f-kube-api-access-tp9k6\") pod \"insights-operator-78bdfb888c-6r828\" (UID: \"f3525871-7436-4b57-b837-22389075c03f\") " pod="openshift-insights/insights-operator-78bdfb888c-6r828"
May 21 15:33:55.196039 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.195968    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3525871-7436-4b57-b837-22389075c03f-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-6r828\" (UID: \"f3525871-7436-4b57-b837-22389075c03f\") " pod="openshift-insights/insights-operator-78bdfb888c-6r828"
May 21 15:33:55.196116 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.196043    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3525871-7436-4b57-b837-22389075c03f-service-ca-bundle\") pod \"insights-operator-78bdfb888c-6r828\" (UID: \"f3525871-7436-4b57-b837-22389075c03f\") " pod="openshift-insights/insights-operator-78bdfb888c-6r828"
May 21 15:33:55.196116 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.196105    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f3525871-7436-4b57-b837-22389075c03f-snapshots\") pod \"insights-operator-78bdfb888c-6r828\" (UID: \"f3525871-7436-4b57-b837-22389075c03f\") " pod="openshift-insights/insights-operator-78bdfb888c-6r828"
May 21 15:33:55.196489 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.196473    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3a9db6ef-d398-4685-b493-d4413f18216b-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-2mxqr\" (UID: \"3a9db6ef-d398-4685-b493-d4413f18216b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2mxqr"
May 21 15:33:55.206095 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.206068    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx4hs\" (UniqueName: \"kubernetes.io/projected/3a9db6ef-d398-4685-b493-d4413f18216b-kube-api-access-rx4hs\") pod \"cluster-monitoring-operator-6c75959455-2mxqr\" (UID: \"3a9db6ef-d398-4685-b493-d4413f18216b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2mxqr"
May 21 15:33:55.236664 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.236625    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-ddn7l"]
May 21 15:33:55.238672 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.238651    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-ddn7l"
May 21 15:33:55.239850 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.239825    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nsf22"]
May 21 15:33:55.241123 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.241100    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-6g8vx\""
May 21 15:33:55.241206 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.241188    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nsf22"
May 21 15:33:55.243467 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.243450    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 21 15:33:55.243467 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.243459    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 21 15:33:55.243618 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.243461    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 21 15:33:55.243732 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.243717    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 21 15:33:55.243935 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.243919    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-v9db9\""
May 21 15:33:55.250376 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.250357    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7cf999c598-b2ntz"]
May 21 15:33:55.252119 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.252100    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-ddn7l"]
May 21 15:33:55.252219 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.252207    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:55.254407 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.254386    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nsf22"]
May 21 15:33:55.254728 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.254706    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 21 15:33:55.254825 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.254733    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 21 15:33:55.254889 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.254852    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dpq6k\""
May 21 15:33:55.254981 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.254963    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 21 15:33:55.259997 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.259978    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 21 15:33:55.265370 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.265349    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cf999c598-b2ntz"]
May 21 15:33:55.296955 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.296880    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f3525871-7436-4b57-b837-22389075c03f-serving-cert\") pod \"insights-operator-78bdfb888c-6r828\" (UID: \"f3525871-7436-4b57-b837-22389075c03f\") " pod="openshift-insights/insights-operator-78bdfb888c-6r828"
May 21 15:33:55.296955 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.296913    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tp9k6\" (UniqueName: \"kubernetes.io/projected/f3525871-7436-4b57-b837-22389075c03f-kube-api-access-tp9k6\") pod \"insights-operator-78bdfb888c-6r828\" (UID: \"f3525871-7436-4b57-b837-22389075c03f\") " pod="openshift-insights/insights-operator-78bdfb888c-6r828"
May 21 15:33:55.296955 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.296941    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-bound-sa-token\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:55.297200 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.296989    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3525871-7436-4b57-b837-22389075c03f-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-6r828\" (UID: \"f3525871-7436-4b57-b837-22389075c03f\") " pod="openshift-insights/insights-operator-78bdfb888c-6r828"
May 21 15:33:55.297200 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.297019    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a9b516d-7367-4b03-80f2-79812b492374-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-nsf22\" (UID: \"3a9b516d-7367-4b03-80f2-79812b492374\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nsf22"
May 21 15:33:55.297200 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.297042    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a9b516d-7367-4b03-80f2-79812b492374-config\") pod \"kube-storage-version-migrator-operator-565644f49-nsf22\" (UID: \"3a9b516d-7367-4b03-80f2-79812b492374\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nsf22"
May 21 15:33:55.297200 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.297068    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1f12457f-eade-449c-81d5-09c1fcc72abb-ca-trust-extracted\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:55.297200 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.297172    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3525871-7436-4b57-b837-22389075c03f-service-ca-bundle\") pod \"insights-operator-78bdfb888c-6r828\" (UID: \"f3525871-7436-4b57-b837-22389075c03f\") " pod="openshift-insights/insights-operator-78bdfb888c-6r828"
May 21 15:33:55.297480 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.297212    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1f12457f-eade-449c-81d5-09c1fcc72abb-installation-pull-secrets\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:55.297480 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.297302    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f3525871-7436-4b57-b837-22389075c03f-snapshots\") pod \"insights-operator-78bdfb888c-6r828\" (UID: \"f3525871-7436-4b57-b837-22389075c03f\") " pod="openshift-insights/insights-operator-78bdfb888c-6r828"
May 21 15:33:55.297480 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.297351    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-certificates\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:55.297480 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.297390    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnfbt\" (UniqueName: \"kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-kube-api-access-bnfbt\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:55.297480 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.297474    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zzs6m\" (UniqueName: \"kubernetes.io/projected/7ea046a2-e402-4da5-8256-363d4c7f6e51-kube-api-access-zzs6m\") pod \"volume-data-source-validator-5cf8c89d64-xzpgh\" (UID: \"7ea046a2-e402-4da5-8256-363d4c7f6e51\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-xzpgh"
May 21 15:33:55.297703 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.297504    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3525871-7436-4b57-b837-22389075c03f-tmp\") pod \"insights-operator-78bdfb888c-6r828\" (UID: \"f3525871-7436-4b57-b837-22389075c03f\") " pod="openshift-insights/insights-operator-78bdfb888c-6r828"
May 21 15:33:55.297703 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.297543    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd57m\" (UniqueName: \"kubernetes.io/projected/1f22cf49-c73b-4c5d-bd78-ed63cf4382bd-kube-api-access-zd57m\") pod \"network-check-source-7f44b6dd87-ddn7l\" (UID: \"1f22cf49-c73b-4c5d-bd78-ed63cf4382bd\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-ddn7l"
May 21 15:33:55.297703 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.297614    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8792k\" (UniqueName: \"kubernetes.io/projected/3a9b516d-7367-4b03-80f2-79812b492374-kube-api-access-8792k\") pod \"kube-storage-version-migrator-operator-565644f49-nsf22\" (UID: \"3a9b516d-7367-4b03-80f2-79812b492374\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nsf22"
May 21 15:33:55.297703 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.297654    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-tls\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:55.297703 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.297676    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3525871-7436-4b57-b837-22389075c03f-service-ca-bundle\") pod \"insights-operator-78bdfb888c-6r828\" (UID: \"f3525871-7436-4b57-b837-22389075c03f\") " pod="openshift-insights/insights-operator-78bdfb888c-6r828"
May 21 15:33:55.297703 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.297684    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1f12457f-eade-449c-81d5-09c1fcc72abb-trusted-ca\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:55.297976 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.297731    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1f12457f-eade-449c-81d5-09c1fcc72abb-image-registry-private-configuration\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:55.297976 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.297848    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3525871-7436-4b57-b837-22389075c03f-tmp\") pod \"insights-operator-78bdfb888c-6r828\" (UID: \"f3525871-7436-4b57-b837-22389075c03f\") " pod="openshift-insights/insights-operator-78bdfb888c-6r828"
May 21 15:33:55.297976 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.297899    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3525871-7436-4b57-b837-22389075c03f-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-6r828\" (UID: \"f3525871-7436-4b57-b837-22389075c03f\") " pod="openshift-insights/insights-operator-78bdfb888c-6r828"
May 21 15:33:55.297976 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.297919    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f3525871-7436-4b57-b837-22389075c03f-snapshots\") pod \"insights-operator-78bdfb888c-6r828\" (UID: \"f3525871-7436-4b57-b837-22389075c03f\") " pod="openshift-insights/insights-operator-78bdfb888c-6r828"
May 21 15:33:55.299348 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.299329    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f3525871-7436-4b57-b837-22389075c03f-serving-cert\") pod \"insights-operator-78bdfb888c-6r828\" (UID: \"f3525871-7436-4b57-b837-22389075c03f\") " pod="openshift-insights/insights-operator-78bdfb888c-6r828"
May 21 15:33:55.304960 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.304935    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzs6m\" (UniqueName: \"kubernetes.io/projected/7ea046a2-e402-4da5-8256-363d4c7f6e51-kube-api-access-zzs6m\") pod \"volume-data-source-validator-5cf8c89d64-xzpgh\" (UID: \"7ea046a2-e402-4da5-8256-363d4c7f6e51\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-xzpgh"
May 21 15:33:55.305064 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.305040    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp9k6\" (UniqueName: \"kubernetes.io/projected/f3525871-7436-4b57-b837-22389075c03f-kube-api-access-tp9k6\") pod \"insights-operator-78bdfb888c-6r828\" (UID: \"f3525871-7436-4b57-b837-22389075c03f\") " pod="openshift-insights/insights-operator-78bdfb888c-6r828"
May 21 15:33:55.399078 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.399038    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-certificates\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:55.399078 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.399074    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bnfbt\" (UniqueName: \"kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-kube-api-access-bnfbt\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:55.399405 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.399108    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zd57m\" (UniqueName: \"kubernetes.io/projected/1f22cf49-c73b-4c5d-bd78-ed63cf4382bd-kube-api-access-zd57m\") pod \"network-check-source-7f44b6dd87-ddn7l\" (UID: \"1f22cf49-c73b-4c5d-bd78-ed63cf4382bd\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-ddn7l"
May 21 15:33:55.399405 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.399129    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8792k\" (UniqueName: \"kubernetes.io/projected/3a9b516d-7367-4b03-80f2-79812b492374-kube-api-access-8792k\") pod \"kube-storage-version-migrator-operator-565644f49-nsf22\" (UID: \"3a9b516d-7367-4b03-80f2-79812b492374\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nsf22"
May 21 15:33:55.399405 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.399148    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-tls\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:55.399405 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:55.399217    2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 15:33:55.399405 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:55.399228    2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cf999c598-b2ntz: secret "image-registry-tls" not found
May 21 15:33:55.399405 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:55.399321    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-tls podName:1f12457f-eade-449c-81d5-09c1fcc72abb nodeName:}" failed. No retries permitted until 2026-05-21 15:33:55.899303729 +0000 UTC m=+96.619466264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-tls") pod "image-registry-7cf999c598-b2ntz" (UID: "1f12457f-eade-449c-81d5-09c1fcc72abb") : secret "image-registry-tls" not found
May 21 15:33:55.399704 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.399402    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1f12457f-eade-449c-81d5-09c1fcc72abb-trusted-ca\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:55.399704 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.399449    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1f12457f-eade-449c-81d5-09c1fcc72abb-image-registry-private-configuration\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:55.399704 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.399502    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-bound-sa-token\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:55.399704 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.399547    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a9b516d-7367-4b03-80f2-79812b492374-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-nsf22\" (UID: \"3a9b516d-7367-4b03-80f2-79812b492374\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nsf22"
May 21 15:33:55.399907 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.399710    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a9b516d-7367-4b03-80f2-79812b492374-config\") pod \"kube-storage-version-migrator-operator-565644f49-nsf22\" (UID: \"3a9b516d-7367-4b03-80f2-79812b492374\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nsf22"
May 21 15:33:55.399907 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.399731    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-certificates\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:55.399907 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.399750    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1f12457f-eade-449c-81d5-09c1fcc72abb-ca-trust-extracted\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:55.399907 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.399816    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1f12457f-eade-449c-81d5-09c1fcc72abb-installation-pull-secrets\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:55.400103 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.400069    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1f12457f-eade-449c-81d5-09c1fcc72abb-ca-trust-extracted\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:55.400310 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.400282    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1f12457f-eade-449c-81d5-09c1fcc72abb-trusted-ca\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:55.400424 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.400287    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a9b516d-7367-4b03-80f2-79812b492374-config\") pod \"kube-storage-version-migrator-operator-565644f49-nsf22\" (UID: \"3a9b516d-7367-4b03-80f2-79812b492374\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nsf22"
May 21 15:33:55.402021 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.401989    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1f12457f-eade-449c-81d5-09c1fcc72abb-installation-pull-secrets\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:55.402221 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.402199    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a9b516d-7367-4b03-80f2-79812b492374-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-nsf22\" (UID: \"3a9b516d-7367-4b03-80f2-79812b492374\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nsf22"
May 21 15:33:55.402378 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.402359    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1f12457f-eade-449c-81d5-09c1fcc72abb-image-registry-private-configuration\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:55.408408 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.408376    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd57m\" (UniqueName: \"kubernetes.io/projected/1f22cf49-c73b-4c5d-bd78-ed63cf4382bd-kube-api-access-zd57m\") pod \"network-check-source-7f44b6dd87-ddn7l\" (UID: \"1f22cf49-c73b-4c5d-bd78-ed63cf4382bd\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-ddn7l"
May 21 15:33:55.409228 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.409209    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-bound-sa-token\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:55.409333 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.409322    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8792k\" (UniqueName: \"kubernetes.io/projected/3a9b516d-7367-4b03-80f2-79812b492374-kube-api-access-8792k\") pod \"kube-storage-version-migrator-operator-565644f49-nsf22\" (UID: \"3a9b516d-7367-4b03-80f2-79812b492374\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nsf22"
May 21 15:33:55.409396 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.409333    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnfbt\" (UniqueName: \"kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-kube-api-access-bnfbt\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:55.463407 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.463357    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-xzpgh"
May 21 15:33:55.468161 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.468136    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-6r828"
May 21 15:33:55.552166 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.550331    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-ddn7l"
May 21 15:33:55.554500 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.554474    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nsf22"
May 21 15:33:55.623962 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.623721    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-xzpgh"]
May 21 15:33:55.630609 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:33:55.630573    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ea046a2_e402_4da5_8256_363d4c7f6e51.slice/crio-57299a29c6f37413da98abc2c5613aecf5f89291285e766a2fc8573635e125b3 WatchSource:0}: Error finding container 57299a29c6f37413da98abc2c5613aecf5f89291285e766a2fc8573635e125b3: Status 404 returned error can't find the container with id 57299a29c6f37413da98abc2c5613aecf5f89291285e766a2fc8573635e125b3
May 21 15:33:55.645340 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.645300    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-6r828"]
May 21 15:33:55.648283 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:33:55.648245    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3525871_7436_4b57_b837_22389075c03f.slice/crio-2d1dcf4da72b397053da01ef4bd6a9efa3e0b41fa32d6aa84ad3a4855b45129b WatchSource:0}: Error finding container 2d1dcf4da72b397053da01ef4bd6a9efa3e0b41fa32d6aa84ad3a4855b45129b: Status 404 returned error can't find the container with id 2d1dcf4da72b397053da01ef4bd6a9efa3e0b41fa32d6aa84ad3a4855b45129b
May 21 15:33:55.689538 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.689506    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nsf22"]
May 21 15:33:55.692303 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:33:55.692272    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a9b516d_7367_4b03_80f2_79812b492374.slice/crio-8ea1384cf6e88331263ea0fd55dea0530d49b3b3a986527d968f87134a333c2d WatchSource:0}: Error finding container 8ea1384cf6e88331263ea0fd55dea0530d49b3b3a986527d968f87134a333c2d: Status 404 returned error can't find the container with id 8ea1384cf6e88331263ea0fd55dea0530d49b3b3a986527d968f87134a333c2d
May 21 15:33:55.702552 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.702532    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a9db6ef-d398-4685-b493-d4413f18216b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-2mxqr\" (UID: \"3a9db6ef-d398-4685-b493-d4413f18216b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2mxqr"
May 21 15:33:55.702632 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:55.702624    2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 15:33:55.702674 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:55.702670    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a9db6ef-d398-4685-b493-d4413f18216b-cluster-monitoring-operator-tls podName:3a9db6ef-d398-4685-b493-d4413f18216b nodeName:}" failed. No retries permitted until 2026-05-21 15:33:56.702655939 +0000 UTC m=+97.422818455 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3a9db6ef-d398-4685-b493-d4413f18216b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-2mxqr" (UID: "3a9db6ef-d398-4685-b493-d4413f18216b") : secret "cluster-monitoring-operator-tls" not found
May 21 15:33:55.704413 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.704390    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-ddn7l"]
May 21 15:33:55.709439 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:33:55.709411    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f22cf49_c73b_4c5d_bd78_ed63cf4382bd.slice/crio-9b5cd8a9ef300117a75de5fb6fe76d97f0e71c91961bd14635d17090352bfb69 WatchSource:0}: Error finding container 9b5cd8a9ef300117a75de5fb6fe76d97f0e71c91961bd14635d17090352bfb69: Status 404 returned error can't find the container with id 9b5cd8a9ef300117a75de5fb6fe76d97f0e71c91961bd14635d17090352bfb69
May 21 15:33:55.904482 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:55.904438    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-tls\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:55.904637 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:55.904580    2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 15:33:55.904637 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:55.904595    2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cf999c598-b2ntz: secret "image-registry-tls" not found
May 21 15:33:55.904711 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:55.904657    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-tls podName:1f12457f-eade-449c-81d5-09c1fcc72abb nodeName:}" failed. No retries permitted until 2026-05-21 15:33:56.904639031 +0000 UTC m=+97.624801550 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-tls") pod "image-registry-7cf999c598-b2ntz" (UID: "1f12457f-eade-449c-81d5-09c1fcc72abb") : secret "image-registry-tls" not found
May 21 15:33:56.101997 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:56.101955    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-6r828" event={"ID":"f3525871-7436-4b57-b837-22389075c03f","Type":"ContainerStarted","Data":"2d1dcf4da72b397053da01ef4bd6a9efa3e0b41fa32d6aa84ad3a4855b45129b"}
May 21 15:33:56.103316 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:56.103281    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-ddn7l" event={"ID":"1f22cf49-c73b-4c5d-bd78-ed63cf4382bd","Type":"ContainerStarted","Data":"2851893b7b3c0e249966fa2efc2b8a8f54966402e270342c9d94fd272b5a8b23"}
May 21 15:33:56.103465 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:56.103321    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-ddn7l" event={"ID":"1f22cf49-c73b-4c5d-bd78-ed63cf4382bd","Type":"ContainerStarted","Data":"9b5cd8a9ef300117a75de5fb6fe76d97f0e71c91961bd14635d17090352bfb69"}
May 21 15:33:56.104372 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:56.104340    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-xzpgh" event={"ID":"7ea046a2-e402-4da5-8256-363d4c7f6e51","Type":"ContainerStarted","Data":"57299a29c6f37413da98abc2c5613aecf5f89291285e766a2fc8573635e125b3"}
May 21 15:33:56.105255 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:56.105236    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nsf22" event={"ID":"3a9b516d-7367-4b03-80f2-79812b492374","Type":"ContainerStarted","Data":"8ea1384cf6e88331263ea0fd55dea0530d49b3b3a986527d968f87134a333c2d"}
May 21 15:33:56.119097 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:56.119031    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-ddn7l" podStartSLOduration=1.119018088 podStartE2EDuration="1.119018088s" podCreationTimestamp="2026-05-21 15:33:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:33:56.118581645 +0000 UTC m=+96.838744183" watchObservedRunningTime="2026-05-21 15:33:56.119018088 +0000 UTC m=+96.839180627"
May 21 15:33:56.710601 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:56.710556    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a9db6ef-d398-4685-b493-d4413f18216b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-2mxqr\" (UID: \"3a9db6ef-d398-4685-b493-d4413f18216b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2mxqr"
May 21 15:33:56.710784 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:56.710761    2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 15:33:56.710853 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:56.710840    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a9db6ef-d398-4685-b493-d4413f18216b-cluster-monitoring-operator-tls podName:3a9db6ef-d398-4685-b493-d4413f18216b nodeName:}" failed. No retries permitted until 2026-05-21 15:33:58.710818358 +0000 UTC m=+99.430980880 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3a9db6ef-d398-4685-b493-d4413f18216b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-2mxqr" (UID: "3a9db6ef-d398-4685-b493-d4413f18216b") : secret "cluster-monitoring-operator-tls" not found
May 21 15:33:56.913101 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:56.912821    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-tls\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:56.913101 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:56.912989    2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 15:33:56.913101 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:56.913008    2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cf999c598-b2ntz: secret "image-registry-tls" not found
May 21 15:33:56.913101 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:56.913073    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-tls podName:1f12457f-eade-449c-81d5-09c1fcc72abb nodeName:}" failed. No retries permitted until 2026-05-21 15:33:58.913053294 +0000 UTC m=+99.633215825 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-tls") pod "image-registry-7cf999c598-b2ntz" (UID: "1f12457f-eade-449c-81d5-09c1fcc72abb") : secret "image-registry-tls" not found
May 21 15:33:57.114189 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:57.114155    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert\") pod \"ingress-canary-79k9q\" (UID: \"c5ac7608-600f-40c3-96e3-7d09db3d0aeb\") " pod="openshift-ingress-canary/ingress-canary-79k9q"
May 21 15:33:57.114651 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:57.114201    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls\") pod \"dns-default-frrjc\" (UID: \"048c373f-4ec1-416d-9720-992cc8c4a7d7\") " pod="openshift-dns/dns-default-frrjc"
May 21 15:33:57.114651 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:57.114325    2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 15:33:57.114651 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:57.114381    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert podName:c5ac7608-600f-40c3-96e3-7d09db3d0aeb nodeName:}" failed. No retries permitted until 2026-05-21 15:35:01.114365492 +0000 UTC m=+161.834528013 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert") pod "ingress-canary-79k9q" (UID: "c5ac7608-600f-40c3-96e3-7d09db3d0aeb") : secret "canary-serving-cert" not found
May 21 15:33:57.114651 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:57.114425    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 15:33:57.114651 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:57.114475    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls podName:048c373f-4ec1-416d-9720-992cc8c4a7d7 nodeName:}" failed. No retries permitted until 2026-05-21 15:35:01.114459514 +0000 UTC m=+161.834622034 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls") pod "dns-default-frrjc" (UID: "048c373f-4ec1-416d-9720-992cc8c4a7d7") : secret "dns-default-metrics-tls" not found
May 21 15:33:58.111360 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:58.111255    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-6r828" event={"ID":"f3525871-7436-4b57-b837-22389075c03f","Type":"ContainerStarted","Data":"8f9bc5fe92e80b5ab39d3f72c82caa20c523c530120b761855de1fba75f9b968"}
May 21 15:33:58.112688 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:58.112656    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-xzpgh" event={"ID":"7ea046a2-e402-4da5-8256-363d4c7f6e51","Type":"ContainerStarted","Data":"906c9cf02f6f2e2905a88fdaa749ca7b60da306ad11546f030d20d198d1c9a1a"}
May 21 15:33:58.128374 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:58.128316    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-6r828" podStartSLOduration=1.024692345 podStartE2EDuration="3.128297011s" podCreationTimestamp="2026-05-21 15:33:55 +0000 UTC" firstStartedPulling="2026-05-21 15:33:55.650779148 +0000 UTC m=+96.370941667" lastFinishedPulling="2026-05-21 15:33:57.754383813 +0000 UTC m=+98.474546333" observedRunningTime="2026-05-21 15:33:58.127886543 +0000 UTC m=+98.848049081" watchObservedRunningTime="2026-05-21 15:33:58.128297011 +0000 UTC m=+98.848459550"
May 21 15:33:58.142356 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:58.142298    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-xzpgh" podStartSLOduration=1.599546796 podStartE2EDuration="3.142278857s" podCreationTimestamp="2026-05-21 15:33:55 +0000 UTC" firstStartedPulling="2026-05-21 15:33:55.632430618 +0000 UTC m=+96.352593135" lastFinishedPulling="2026-05-21 15:33:57.175162667 +0000 UTC m=+97.895325196" observedRunningTime="2026-05-21 15:33:58.141019403 +0000 UTC m=+98.861181942" watchObservedRunningTime="2026-05-21 15:33:58.142278857 +0000 UTC m=+98.862441389"
May 21 15:33:58.728132 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:58.728091    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a9db6ef-d398-4685-b493-d4413f18216b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-2mxqr\" (UID: \"3a9db6ef-d398-4685-b493-d4413f18216b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2mxqr"
May 21 15:33:58.728336 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:58.728272    2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 15:33:58.728400 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:58.728359    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a9db6ef-d398-4685-b493-d4413f18216b-cluster-monitoring-operator-tls podName:3a9db6ef-d398-4685-b493-d4413f18216b nodeName:}" failed. No retries permitted until 2026-05-21 15:34:02.728336308 +0000 UTC m=+103.448498827 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3a9db6ef-d398-4685-b493-d4413f18216b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-2mxqr" (UID: "3a9db6ef-d398-4685-b493-d4413f18216b") : secret "cluster-monitoring-operator-tls" not found
May 21 15:33:58.930317 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:58.930276    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-tls\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:33:58.930499 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:58.930380    2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 15:33:58.930499 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:58.930405    2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cf999c598-b2ntz: secret "image-registry-tls" not found
May 21 15:33:58.930499 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:33:58.930473    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-tls podName:1f12457f-eade-449c-81d5-09c1fcc72abb nodeName:}" failed. No retries permitted until 2026-05-21 15:34:02.930454022 +0000 UTC m=+103.650616552 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-tls") pod "image-registry-7cf999c598-b2ntz" (UID: "1f12457f-eade-449c-81d5-09c1fcc72abb") : secret "image-registry-tls" not found
May 21 15:33:59.115729 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:59.115634    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nsf22" event={"ID":"3a9b516d-7367-4b03-80f2-79812b492374","Type":"ContainerStarted","Data":"b3ed77a2bb3232a76582d25778c02b670430b797fcff663bdc7b03ce97a95fac"}
May 21 15:33:59.130944 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:33:59.130891    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nsf22" podStartSLOduration=1.526943416 podStartE2EDuration="4.130877584s" podCreationTimestamp="2026-05-21 15:33:55 +0000 UTC" firstStartedPulling="2026-05-21 15:33:55.694161293 +0000 UTC m=+96.414323822" lastFinishedPulling="2026-05-21 15:33:58.298095473 +0000 UTC m=+99.018257990" observedRunningTime="2026-05-21 15:33:59.129971834 +0000 UTC m=+99.850134369" watchObservedRunningTime="2026-05-21 15:33:59.130877584 +0000 UTC m=+99.851040121"
May 21 15:34:00.057592 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:00.057564    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qbcqg"
May 21 15:34:00.560511 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:00.560471    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-vlbrx"]
May 21 15:34:00.590270 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:00.590226    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-vlbrx"]
May 21 15:34:00.590412 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:00.590377    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-vlbrx"
May 21 15:34:00.592934 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:00.592910    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 21 15:34:00.593103 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:00.592986    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 21 15:34:00.594024 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:00.594006    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-l26lj\""
May 21 15:34:00.644564 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:00.644527    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfpls\" (UniqueName: \"kubernetes.io/projected/99413cb0-9815-45fa-a822-c2a9e98a1666-kube-api-access-bfpls\") pod \"migrator-b985f5d89-vlbrx\" (UID: \"99413cb0-9815-45fa-a822-c2a9e98a1666\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-vlbrx"
May 21 15:34:00.745208 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:00.745170    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bfpls\" (UniqueName: \"kubernetes.io/projected/99413cb0-9815-45fa-a822-c2a9e98a1666-kube-api-access-bfpls\") pod \"migrator-b985f5d89-vlbrx\" (UID: \"99413cb0-9815-45fa-a822-c2a9e98a1666\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-vlbrx"
May 21 15:34:00.753189 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:00.753153    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfpls\" (UniqueName: \"kubernetes.io/projected/99413cb0-9815-45fa-a822-c2a9e98a1666-kube-api-access-bfpls\") pod \"migrator-b985f5d89-vlbrx\" (UID: \"99413cb0-9815-45fa-a822-c2a9e98a1666\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-vlbrx"
May 21 15:34:00.898851 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:00.898764    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-vlbrx"
May 21 15:34:00.973392 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:00.973371    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l6g95_3ef54bf7-c851-42e8-ab07-955a73e57e37/dns-node-resolver/0.log"
May 21 15:34:01.018999 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:01.018965    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-vlbrx"]
May 21 15:34:01.022053 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:34:01.022024    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99413cb0_9815_45fa_a822_c2a9e98a1666.slice/crio-eca731b689bde62d2fb1c7e31ebd8e8ee87f7cb52317af2d43f50ec07acd6800 WatchSource:0}: Error finding container eca731b689bde62d2fb1c7e31ebd8e8ee87f7cb52317af2d43f50ec07acd6800: Status 404 returned error can't find the container with id eca731b689bde62d2fb1c7e31ebd8e8ee87f7cb52317af2d43f50ec07acd6800
May 21 15:34:01.120630 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:01.120591    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-vlbrx" event={"ID":"99413cb0-9815-45fa-a822-c2a9e98a1666","Type":"ContainerStarted","Data":"eca731b689bde62d2fb1c7e31ebd8e8ee87f7cb52317af2d43f50ec07acd6800"}
May 21 15:34:01.574543 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:01.574518    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2475j_f35e19d1-88d3-4e8d-82de-1531dff0c058/node-ca/0.log"
May 21 15:34:02.703275 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:02.703234    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-2vtf8"]
May 21 15:34:02.706040 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:02.706021    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-2vtf8"
May 21 15:34:02.708433 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:02.708396    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 21 15:34:02.708532 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:02.708482    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 21 15:34:02.708707 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:02.708694    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 21 15:34:02.709399 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:02.709384    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-2bgzd\""
May 21 15:34:02.709479 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:02.709413    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 21 15:34:02.715239 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:02.715216    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-2vtf8"]
May 21 15:34:02.761707 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:02.761658    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgrnb\" (UniqueName: \"kubernetes.io/projected/ce86958e-df72-4d63-bf83-a50f1a1ecca9-kube-api-access-rgrnb\") pod \"service-ca-67d667c7d-2vtf8\" (UID: \"ce86958e-df72-4d63-bf83-a50f1a1ecca9\") " pod="openshift-service-ca/service-ca-67d667c7d-2vtf8"
May 21 15:34:02.761865 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:02.761748    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a9db6ef-d398-4685-b493-d4413f18216b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-2mxqr\" (UID: \"3a9db6ef-d398-4685-b493-d4413f18216b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2mxqr"
May 21 15:34:02.761865 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:02.761792    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce86958e-df72-4d63-bf83-a50f1a1ecca9-signing-key\") pod \"service-ca-67d667c7d-2vtf8\" (UID: \"ce86958e-df72-4d63-bf83-a50f1a1ecca9\") " pod="openshift-service-ca/service-ca-67d667c7d-2vtf8"
May 21 15:34:02.761865 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:02.761843    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce86958e-df72-4d63-bf83-a50f1a1ecca9-signing-cabundle\") pod \"service-ca-67d667c7d-2vtf8\" (UID: \"ce86958e-df72-4d63-bf83-a50f1a1ecca9\") " pod="openshift-service-ca/service-ca-67d667c7d-2vtf8"
May 21 15:34:02.762013 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:34:02.761914    2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 15:34:02.762013 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:34:02.761990    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a9db6ef-d398-4685-b493-d4413f18216b-cluster-monitoring-operator-tls podName:3a9db6ef-d398-4685-b493-d4413f18216b nodeName:}" failed. No retries permitted until 2026-05-21 15:34:10.761969733 +0000 UTC m=+111.482132263 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3a9db6ef-d398-4685-b493-d4413f18216b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-2mxqr" (UID: "3a9db6ef-d398-4685-b493-d4413f18216b") : secret "cluster-monitoring-operator-tls" not found
May 21 15:34:02.863218 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:02.863123    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce86958e-df72-4d63-bf83-a50f1a1ecca9-signing-key\") pod \"service-ca-67d667c7d-2vtf8\" (UID: \"ce86958e-df72-4d63-bf83-a50f1a1ecca9\") " pod="openshift-service-ca/service-ca-67d667c7d-2vtf8"
May 21 15:34:02.863218 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:02.863205    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce86958e-df72-4d63-bf83-a50f1a1ecca9-signing-cabundle\") pod \"service-ca-67d667c7d-2vtf8\" (UID: \"ce86958e-df72-4d63-bf83-a50f1a1ecca9\") " pod="openshift-service-ca/service-ca-67d667c7d-2vtf8"
May 21 15:34:02.863473 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:02.863252    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rgrnb\" (UniqueName: \"kubernetes.io/projected/ce86958e-df72-4d63-bf83-a50f1a1ecca9-kube-api-access-rgrnb\") pod \"service-ca-67d667c7d-2vtf8\" (UID: \"ce86958e-df72-4d63-bf83-a50f1a1ecca9\") " pod="openshift-service-ca/service-ca-67d667c7d-2vtf8"
May 21 15:34:02.863888 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:02.863868    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce86958e-df72-4d63-bf83-a50f1a1ecca9-signing-cabundle\") pod \"service-ca-67d667c7d-2vtf8\" (UID: \"ce86958e-df72-4d63-bf83-a50f1a1ecca9\") " pod="openshift-service-ca/service-ca-67d667c7d-2vtf8"
May 21 15:34:02.865634 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:02.865611    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce86958e-df72-4d63-bf83-a50f1a1ecca9-signing-key\") pod \"service-ca-67d667c7d-2vtf8\" (UID: \"ce86958e-df72-4d63-bf83-a50f1a1ecca9\") " pod="openshift-service-ca/service-ca-67d667c7d-2vtf8"
May 21 15:34:02.871378 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:02.871357    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgrnb\" (UniqueName: \"kubernetes.io/projected/ce86958e-df72-4d63-bf83-a50f1a1ecca9-kube-api-access-rgrnb\") pod \"service-ca-67d667c7d-2vtf8\" (UID: \"ce86958e-df72-4d63-bf83-a50f1a1ecca9\") " pod="openshift-service-ca/service-ca-67d667c7d-2vtf8"
May 21 15:34:02.963676 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:02.963637    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-tls\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:34:02.963810 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:34:02.963782    2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 15:34:02.963870 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:34:02.963812    2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cf999c598-b2ntz: secret "image-registry-tls" not found
May 21 15:34:02.963913 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:34:02.963879    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-tls podName:1f12457f-eade-449c-81d5-09c1fcc72abb nodeName:}" failed. No retries permitted until 2026-05-21 15:34:10.963863151 +0000 UTC m=+111.684025666 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-tls") pod "image-registry-7cf999c598-b2ntz" (UID: "1f12457f-eade-449c-81d5-09c1fcc72abb") : secret "image-registry-tls" not found
May 21 15:34:03.015333 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:03.015297    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-2vtf8"
May 21 15:34:03.126851 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:03.126769    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-vlbrx" event={"ID":"99413cb0-9815-45fa-a822-c2a9e98a1666","Type":"ContainerStarted","Data":"2a8987c24f4f5943dea212caaf55497edf59d91a3758c218f640cd9cabe79925"}
May 21 15:34:03.126851 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:03.126807    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-vlbrx" event={"ID":"99413cb0-9815-45fa-a822-c2a9e98a1666","Type":"ContainerStarted","Data":"35ecec005e8aa87de5459d137f1dd02f85bed71eb4b00f6a4db1b44a47504598"}
May 21 15:34:03.135683 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:03.134325    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-2vtf8"]
May 21 15:34:03.139033 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:34:03.139011    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce86958e_df72_4d63_bf83_a50f1a1ecca9.slice/crio-8cb1f05aa59b278727a5d568244d2e662d20c024e0959868d29bd617e9013a9a WatchSource:0}: Error finding container 8cb1f05aa59b278727a5d568244d2e662d20c024e0959868d29bd617e9013a9a: Status 404 returned error can't find the container with id 8cb1f05aa59b278727a5d568244d2e662d20c024e0959868d29bd617e9013a9a
May 21 15:34:03.143617 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:03.143577    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-vlbrx" podStartSLOduration=1.652877827 podStartE2EDuration="3.143565351s" podCreationTimestamp="2026-05-21 15:34:00 +0000 UTC" firstStartedPulling="2026-05-21 15:34:01.023943184 +0000 UTC m=+101.744105700" lastFinishedPulling="2026-05-21 15:34:02.514630694 +0000 UTC m=+103.234793224" observedRunningTime="2026-05-21 15:34:03.143105743 +0000 UTC m=+103.863268284" watchObservedRunningTime="2026-05-21 15:34:03.143565351 +0000 UTC m=+103.863727888"
May 21 15:34:04.130639 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:04.130601    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-2vtf8" event={"ID":"ce86958e-df72-4d63-bf83-a50f1a1ecca9","Type":"ContainerStarted","Data":"8cb1f05aa59b278727a5d568244d2e662d20c024e0959868d29bd617e9013a9a"}
May 21 15:34:05.134227 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:05.134188    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-2vtf8" event={"ID":"ce86958e-df72-4d63-bf83-a50f1a1ecca9","Type":"ContainerStarted","Data":"2d3126a1834d0be4f66678e7c8c2f99a109ee5dad1dc78d324ba60abe41d2996"}
May 21 15:34:05.151249 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:05.151195    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-2vtf8" podStartSLOduration=1.305615861 podStartE2EDuration="3.1511777s" podCreationTimestamp="2026-05-21 15:34:02 +0000 UTC" firstStartedPulling="2026-05-21 15:34:03.140710152 +0000 UTC m=+103.860872668" lastFinishedPulling="2026-05-21 15:34:04.986271992 +0000 UTC m=+105.706434507" observedRunningTime="2026-05-21 15:34:05.150881218 +0000 UTC m=+105.871043756" watchObservedRunningTime="2026-05-21 15:34:05.1511777 +0000 UTC m=+105.871340237"
May 21 15:34:10.833465 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:10.833412    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a9db6ef-d398-4685-b493-d4413f18216b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-2mxqr\" (UID: \"3a9db6ef-d398-4685-b493-d4413f18216b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2mxqr"
May 21 15:34:10.833929 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:34:10.833557    2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 15:34:10.833929 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:34:10.833624    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a9db6ef-d398-4685-b493-d4413f18216b-cluster-monitoring-operator-tls podName:3a9db6ef-d398-4685-b493-d4413f18216b nodeName:}" failed. No retries permitted until 2026-05-21 15:34:26.833608728 +0000 UTC m=+127.553771244 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3a9db6ef-d398-4685-b493-d4413f18216b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-2mxqr" (UID: "3a9db6ef-d398-4685-b493-d4413f18216b") : secret "cluster-monitoring-operator-tls" not found
May 21 15:34:11.035458 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:11.035417    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-tls\") pod \"image-registry-7cf999c598-b2ntz\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") " pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:34:11.035626 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:34:11.035572    2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 15:34:11.035626 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:34:11.035593    2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cf999c598-b2ntz: secret "image-registry-tls" not found
May 21 15:34:11.035716 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:34:11.035676    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-tls podName:1f12457f-eade-449c-81d5-09c1fcc72abb nodeName:}" failed. No retries permitted until 2026-05-21 15:34:27.035659721 +0000 UTC m=+127.755822237 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-tls") pod "image-registry-7cf999c598-b2ntz" (UID: "1f12457f-eade-449c-81d5-09c1fcc72abb") : secret "image-registry-tls" not found
May 21 15:34:22.603931 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:22.603893    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7cf999c598-b2ntz"]
May 21 15:34:22.604369 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:34:22.604144    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7cf999c598-b2ntz" podUID="1f12457f-eade-449c-81d5-09c1fcc72abb"
May 21 15:34:22.685666 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:22.685630    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wnbcd"]
May 21 15:34:22.690034 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:22.690015    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wnbcd"
May 21 15:34:22.693028 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:22.693005    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 21 15:34:22.693140 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:22.693006    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 21 15:34:22.693140 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:22.693006    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jgjmm\""
May 21 15:34:22.699846 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:22.699822    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wnbcd"]
May 21 15:34:22.830606 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:22.830560    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c868d1c-1548-47d4-9d62-540c80a091a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wnbcd\" (UID: \"6c868d1c-1548-47d4-9d62-540c80a091a5\") " pod="openshift-insights/insights-runtime-extractor-wnbcd"
May 21 15:34:22.830807 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:22.830615    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6c868d1c-1548-47d4-9d62-540c80a091a5-crio-socket\") pod \"insights-runtime-extractor-wnbcd\" (UID: \"6c868d1c-1548-47d4-9d62-540c80a091a5\") " pod="openshift-insights/insights-runtime-extractor-wnbcd"
May 21 15:34:22.830807 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:22.830637    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c868d1c-1548-47d4-9d62-540c80a091a5-data-volume\") pod \"insights-runtime-extractor-wnbcd\" (UID: \"6c868d1c-1548-47d4-9d62-540c80a091a5\") " pod="openshift-insights/insights-runtime-extractor-wnbcd"
May 21 15:34:22.830807 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:22.830660    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c868d1c-1548-47d4-9d62-540c80a091a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wnbcd\" (UID: \"6c868d1c-1548-47d4-9d62-540c80a091a5\") " pod="openshift-insights/insights-runtime-extractor-wnbcd"
May 21 15:34:22.830807 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:22.830720    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s79k\" (UniqueName: \"kubernetes.io/projected/6c868d1c-1548-47d4-9d62-540c80a091a5-kube-api-access-8s79k\") pod \"insights-runtime-extractor-wnbcd\" (UID: \"6c868d1c-1548-47d4-9d62-540c80a091a5\") " pod="openshift-insights/insights-runtime-extractor-wnbcd"
May 21 15:34:22.932014 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:22.931986    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c868d1c-1548-47d4-9d62-540c80a091a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wnbcd\" (UID: \"6c868d1c-1548-47d4-9d62-540c80a091a5\") " pod="openshift-insights/insights-runtime-extractor-wnbcd"
May 21 15:34:22.932215 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:22.932023    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6c868d1c-1548-47d4-9d62-540c80a091a5-crio-socket\") pod \"insights-runtime-extractor-wnbcd\" (UID: \"6c868d1c-1548-47d4-9d62-540c80a091a5\") " pod="openshift-insights/insights-runtime-extractor-wnbcd"
May 21 15:34:22.932215 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:22.932045    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c868d1c-1548-47d4-9d62-540c80a091a5-data-volume\") pod \"insights-runtime-extractor-wnbcd\" (UID: \"6c868d1c-1548-47d4-9d62-540c80a091a5\") " pod="openshift-insights/insights-runtime-extractor-wnbcd"
May 21 15:34:22.932215 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:22.932062    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c868d1c-1548-47d4-9d62-540c80a091a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wnbcd\" (UID: \"6c868d1c-1548-47d4-9d62-540c80a091a5\") " pod="openshift-insights/insights-runtime-extractor-wnbcd"
May 21 15:34:22.932215 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:22.932138    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6c868d1c-1548-47d4-9d62-540c80a091a5-crio-socket\") pod \"insights-runtime-extractor-wnbcd\" (UID: \"6c868d1c-1548-47d4-9d62-540c80a091a5\") " pod="openshift-insights/insights-runtime-extractor-wnbcd"
May 21 15:34:22.932456 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:22.932216    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8s79k\" (UniqueName: \"kubernetes.io/projected/6c868d1c-1548-47d4-9d62-540c80a091a5-kube-api-access-8s79k\") pod \"insights-runtime-extractor-wnbcd\" (UID: \"6c868d1c-1548-47d4-9d62-540c80a091a5\") " pod="openshift-insights/insights-runtime-extractor-wnbcd"
May 21 15:34:22.932507 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:22.932489    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c868d1c-1548-47d4-9d62-540c80a091a5-data-volume\") pod \"insights-runtime-extractor-wnbcd\" (UID: \"6c868d1c-1548-47d4-9d62-540c80a091a5\") " pod="openshift-insights/insights-runtime-extractor-wnbcd"
May 21 15:34:22.932726 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:22.932709    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c868d1c-1548-47d4-9d62-540c80a091a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wnbcd\" (UID: \"6c868d1c-1548-47d4-9d62-540c80a091a5\") " pod="openshift-insights/insights-runtime-extractor-wnbcd"
May 21 15:34:22.934496 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:22.934475    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c868d1c-1548-47d4-9d62-540c80a091a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wnbcd\" (UID: \"6c868d1c-1548-47d4-9d62-540c80a091a5\") " pod="openshift-insights/insights-runtime-extractor-wnbcd"
May 21 15:34:22.943040 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:22.943018    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s79k\" (UniqueName: \"kubernetes.io/projected/6c868d1c-1548-47d4-9d62-540c80a091a5-kube-api-access-8s79k\") pod \"insights-runtime-extractor-wnbcd\" (UID: \"6c868d1c-1548-47d4-9d62-540c80a091a5\") " pod="openshift-insights/insights-runtime-extractor-wnbcd"
May 21 15:34:22.999152 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:22.999122    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wnbcd"
May 21 15:34:23.127105 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:23.127072    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wnbcd"]
May 21 15:34:23.130154 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:34:23.130124    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c868d1c_1548_47d4_9d62_540c80a091a5.slice/crio-d96c0bf8422252fd6ebab4d98a5a1ef5846218cce32728f02d58854624006949 WatchSource:0}: Error finding container d96c0bf8422252fd6ebab4d98a5a1ef5846218cce32728f02d58854624006949: Status 404 returned error can't find the container with id d96c0bf8422252fd6ebab4d98a5a1ef5846218cce32728f02d58854624006949
May 21 15:34:23.184360 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:23.184291    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:34:23.184478 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:23.184283    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wnbcd" event={"ID":"6c868d1c-1548-47d4-9d62-540c80a091a5","Type":"ContainerStarted","Data":"d96c0bf8422252fd6ebab4d98a5a1ef5846218cce32728f02d58854624006949"}
May 21 15:34:23.188917 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:23.188900    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:34:23.335834 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:23.335799    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1f12457f-eade-449c-81d5-09c1fcc72abb-installation-pull-secrets\") pod \"1f12457f-eade-449c-81d5-09c1fcc72abb\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") "
May 21 15:34:23.336029 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:23.335847    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnfbt\" (UniqueName: \"kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-kube-api-access-bnfbt\") pod \"1f12457f-eade-449c-81d5-09c1fcc72abb\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") "
May 21 15:34:23.336029 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:23.335866    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1f12457f-eade-449c-81d5-09c1fcc72abb-trusted-ca\") pod \"1f12457f-eade-449c-81d5-09c1fcc72abb\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") "
May 21 15:34:23.336029 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:23.335906    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-bound-sa-token\") pod \"1f12457f-eade-449c-81d5-09c1fcc72abb\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") "
May 21 15:34:23.336029 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:23.335942    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-certificates\") pod \"1f12457f-eade-449c-81d5-09c1fcc72abb\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") "
May 21 15:34:23.336029 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:23.335962    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1f12457f-eade-449c-81d5-09c1fcc72abb-ca-trust-extracted\") pod \"1f12457f-eade-449c-81d5-09c1fcc72abb\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") "
May 21 15:34:23.336029 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:23.335983    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1f12457f-eade-449c-81d5-09c1fcc72abb-image-registry-private-configuration\") pod \"1f12457f-eade-449c-81d5-09c1fcc72abb\" (UID: \"1f12457f-eade-449c-81d5-09c1fcc72abb\") "
May 21 15:34:23.336439 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:23.336404    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f12457f-eade-449c-81d5-09c1fcc72abb-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1f12457f-eade-449c-81d5-09c1fcc72abb" (UID: "1f12457f-eade-449c-81d5-09c1fcc72abb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 15:34:23.336508 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:23.336474    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f12457f-eade-449c-81d5-09c1fcc72abb-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1f12457f-eade-449c-81d5-09c1fcc72abb" (UID: "1f12457f-eade-449c-81d5-09c1fcc72abb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:34:23.336508 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:23.336488    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1f12457f-eade-449c-81d5-09c1fcc72abb" (UID: "1f12457f-eade-449c-81d5-09c1fcc72abb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:34:23.338130 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:23.338109    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1f12457f-eade-449c-81d5-09c1fcc72abb" (UID: "1f12457f-eade-449c-81d5-09c1fcc72abb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:34:23.338130 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:23.338114    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f12457f-eade-449c-81d5-09c1fcc72abb-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1f12457f-eade-449c-81d5-09c1fcc72abb" (UID: "1f12457f-eade-449c-81d5-09c1fcc72abb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:34:23.338402 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:23.338384    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f12457f-eade-449c-81d5-09c1fcc72abb-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1f12457f-eade-449c-81d5-09c1fcc72abb" (UID: "1f12457f-eade-449c-81d5-09c1fcc72abb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:34:23.338460 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:23.338414    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-kube-api-access-bnfbt" (OuterVolumeSpecName: "kube-api-access-bnfbt") pod "1f12457f-eade-449c-81d5-09c1fcc72abb" (UID: "1f12457f-eade-449c-81d5-09c1fcc72abb"). InnerVolumeSpecName "kube-api-access-bnfbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:34:23.436827 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:23.436744    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnfbt\" (UniqueName: \"kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-kube-api-access-bnfbt\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:34:23.436827 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:23.436774    2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1f12457f-eade-449c-81d5-09c1fcc72abb-trusted-ca\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:34:23.436827 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:23.436788    2552 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-bound-sa-token\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:34:23.436827 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:23.436796    2552 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-certificates\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:34:23.436827 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:23.436806    2552 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1f12457f-eade-449c-81d5-09c1fcc72abb-ca-trust-extracted\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:34:23.436827 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:23.436816    2552 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1f12457f-eade-449c-81d5-09c1fcc72abb-image-registry-private-configuration\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:34:23.436827 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:23.436826    2552 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1f12457f-eade-449c-81d5-09c1fcc72abb-installation-pull-secrets\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:34:24.188505 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:24.188464    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wnbcd" event={"ID":"6c868d1c-1548-47d4-9d62-540c80a091a5","Type":"ContainerStarted","Data":"ac3854cfe5e56f342980a0c67157f40e21f17589a92038e3d05af6f0db999441"}
May 21 15:34:24.188505 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:24.188508    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wnbcd" event={"ID":"6c868d1c-1548-47d4-9d62-540c80a091a5","Type":"ContainerStarted","Data":"1c6ab1260c90deb4f0255bf9b70241d45e594ff03beeb69ccadf483878090c83"}
May 21 15:34:24.188942 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:24.188512    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cf999c598-b2ntz"
May 21 15:34:24.218026 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:24.217998    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7cf999c598-b2ntz"]
May 21 15:34:24.225547 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:24.225521    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7cf999c598-b2ntz"]
May 21 15:34:24.345115 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:24.345086    2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f12457f-eade-449c-81d5-09c1fcc72abb-registry-tls\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:34:25.844119 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:25.844088    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f12457f-eade-449c-81d5-09c1fcc72abb" path="/var/lib/kubelet/pods/1f12457f-eade-449c-81d5-09c1fcc72abb/volumes"
May 21 15:34:26.195463 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:26.195429    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wnbcd" event={"ID":"6c868d1c-1548-47d4-9d62-540c80a091a5","Type":"ContainerStarted","Data":"ed05cc3e208f7c3332915a1d15287ce10c2c687ad3ee8932d3c50a7b8389e729"}
May 21 15:34:26.213677 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:26.213630    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wnbcd" podStartSLOduration=1.582387297 podStartE2EDuration="4.213615906s" podCreationTimestamp="2026-05-21 15:34:22 +0000 UTC" firstStartedPulling="2026-05-21 15:34:23.18602523 +0000 UTC m=+123.906187747" lastFinishedPulling="2026-05-21 15:34:25.81725382 +0000 UTC m=+126.537416356" observedRunningTime="2026-05-21 15:34:26.212348727 +0000 UTC m=+126.932511265" watchObservedRunningTime="2026-05-21 15:34:26.213615906 +0000 UTC m=+126.933778444"
May 21 15:34:26.864497 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:26.864445    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a9db6ef-d398-4685-b493-d4413f18216b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-2mxqr\" (UID: \"3a9db6ef-d398-4685-b493-d4413f18216b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2mxqr"
May 21 15:34:26.866903 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:26.866876    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a9db6ef-d398-4685-b493-d4413f18216b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-2mxqr\" (UID: \"3a9db6ef-d398-4685-b493-d4413f18216b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2mxqr"
May 21 15:34:27.149178 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:27.149095    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ltbd5\""
May 21 15:34:27.157325 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:27.157303    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2mxqr"
May 21 15:34:27.279944 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:27.279913    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-2mxqr"]
May 21 15:34:27.282929 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:34:27.282907    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a9db6ef_d398_4685_b493_d4413f18216b.slice/crio-0b8ded8c02c528cea4d3ed7f13afbdeea19f1207fb4e8769bfac586947837ae7 WatchSource:0}: Error finding container 0b8ded8c02c528cea4d3ed7f13afbdeea19f1207fb4e8769bfac586947837ae7: Status 404 returned error can't find the container with id 0b8ded8c02c528cea4d3ed7f13afbdeea19f1207fb4e8769bfac586947837ae7
May 21 15:34:28.201458 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:28.201421    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2mxqr" event={"ID":"3a9db6ef-d398-4685-b493-d4413f18216b","Type":"ContainerStarted","Data":"0b8ded8c02c528cea4d3ed7f13afbdeea19f1207fb4e8769bfac586947837ae7"}
May 21 15:34:29.687125 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:29.687042    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs\") pod \"network-metrics-daemon-x7ttm\" (UID: \"a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0\") " pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:34:29.689611 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:29.689587    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0-metrics-certs\") pod \"network-metrics-daemon-x7ttm\" (UID: \"a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0\") " pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:34:29.955759 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:29.955671    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qfdh8\""
May 21 15:34:29.964082 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:29.964056    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x7ttm"
May 21 15:34:30.087889 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:30.087858    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x7ttm"]
May 21 15:34:30.090975 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:34:30.090939    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8cc8955_2ba7_4f0c_8de0_cf324f3a49f0.slice/crio-16bc3e3a562a352f063d8ac6541345cc9a8887522319f0ba9ab80281b6279637 WatchSource:0}: Error finding container 16bc3e3a562a352f063d8ac6541345cc9a8887522319f0ba9ab80281b6279637: Status 404 returned error can't find the container with id 16bc3e3a562a352f063d8ac6541345cc9a8887522319f0ba9ab80281b6279637
May 21 15:34:30.207979 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:30.207882    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x7ttm" event={"ID":"a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0","Type":"ContainerStarted","Data":"16bc3e3a562a352f063d8ac6541345cc9a8887522319f0ba9ab80281b6279637"}
May 21 15:34:30.209219 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:30.209183    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2mxqr" event={"ID":"3a9db6ef-d398-4685-b493-d4413f18216b","Type":"ContainerStarted","Data":"ae0086298b6f8696bbe69f5d2a37936a3ecb10371d04f0249cc37b12af79176f"}
May 21 15:34:30.224598 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:30.224548    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2mxqr" podStartSLOduration=33.091692572 podStartE2EDuration="35.224530659s" podCreationTimestamp="2026-05-21 15:33:55 +0000 UTC" firstStartedPulling="2026-05-21 15:34:27.284691483 +0000 UTC m=+128.004854003" lastFinishedPulling="2026-05-21 15:34:29.41752957 +0000 UTC m=+130.137692090" observedRunningTime="2026-05-21 15:34:30.223680758 +0000 UTC m=+130.943843299" watchObservedRunningTime="2026-05-21 15:34:30.224530659 +0000 UTC m=+130.944693199"
May 21 15:34:32.216813 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:32.216777    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x7ttm" event={"ID":"a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0","Type":"ContainerStarted","Data":"012968c46f61573896b5dbd84f1cd3e880e971057ea00e2822cb288e4b74e1b2"}
May 21 15:34:32.216813 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:32.216813    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x7ttm" event={"ID":"a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0","Type":"ContainerStarted","Data":"a21610d04c0d3530f91c8fd656974e87f3b80866d2eb31f6e1a754de9f183dfb"}
May 21 15:34:32.235921 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:32.235872    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-x7ttm" podStartSLOduration=131.001665046 podStartE2EDuration="2m12.235856858s" podCreationTimestamp="2026-05-21 15:32:20 +0000 UTC" firstStartedPulling="2026-05-21 15:34:30.092872868 +0000 UTC m=+130.813035385" lastFinishedPulling="2026-05-21 15:34:31.327064671 +0000 UTC m=+132.047227197" observedRunningTime="2026-05-21 15:34:32.2350715 +0000 UTC m=+132.955234039" watchObservedRunningTime="2026-05-21 15:34:32.235856858 +0000 UTC m=+132.956019396"
May 21 15:34:32.956243 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:32.956204    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-qkm4z"]
May 21 15:34:32.989814 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:32.989781    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-qkm4z"]
May 21 15:34:32.989963 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:32.989869    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-qkm4z"
May 21 15:34:32.993757 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:32.993730    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 21 15:34:32.993757 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:32.993734    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-tp92h\""
May 21 15:34:32.993969 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:32.993734    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 21 15:34:32.993969 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:32.993737    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 21 15:34:33.013280 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:33.013231    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53841a71-2844-4102-88aa-69eb82c128db-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-qkm4z\" (UID: \"53841a71-2844-4102-88aa-69eb82c128db\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-qkm4z"
May 21 15:34:33.013439 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:33.013347    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2p9j\" (UniqueName: \"kubernetes.io/projected/53841a71-2844-4102-88aa-69eb82c128db-kube-api-access-n2p9j\") pod \"prometheus-operator-7779bbdd78-qkm4z\" (UID: \"53841a71-2844-4102-88aa-69eb82c128db\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-qkm4z"
May 21 15:34:33.013439 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:33.013413    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53841a71-2844-4102-88aa-69eb82c128db-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-qkm4z\" (UID: \"53841a71-2844-4102-88aa-69eb82c128db\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-qkm4z"
May 21 15:34:33.013526 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:33.013501    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/53841a71-2844-4102-88aa-69eb82c128db-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-qkm4z\" (UID: \"53841a71-2844-4102-88aa-69eb82c128db\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-qkm4z"
May 21 15:34:33.114369 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:33.114333    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/53841a71-2844-4102-88aa-69eb82c128db-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-qkm4z\" (UID: \"53841a71-2844-4102-88aa-69eb82c128db\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-qkm4z"
May 21 15:34:33.114565 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:33.114385    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53841a71-2844-4102-88aa-69eb82c128db-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-qkm4z\" (UID: \"53841a71-2844-4102-88aa-69eb82c128db\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-qkm4z"
May 21 15:34:33.114565 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:33.114426    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2p9j\" (UniqueName: \"kubernetes.io/projected/53841a71-2844-4102-88aa-69eb82c128db-kube-api-access-n2p9j\") pod \"prometheus-operator-7779bbdd78-qkm4z\" (UID: \"53841a71-2844-4102-88aa-69eb82c128db\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-qkm4z"
May 21 15:34:33.114565 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:33.114454    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53841a71-2844-4102-88aa-69eb82c128db-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-qkm4z\" (UID: \"53841a71-2844-4102-88aa-69eb82c128db\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-qkm4z"
May 21 15:34:33.115077 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:33.115053    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53841a71-2844-4102-88aa-69eb82c128db-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-qkm4z\" (UID: \"53841a71-2844-4102-88aa-69eb82c128db\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-qkm4z"
May 21 15:34:33.116774 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:33.116748    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53841a71-2844-4102-88aa-69eb82c128db-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-qkm4z\" (UID: \"53841a71-2844-4102-88aa-69eb82c128db\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-qkm4z"
May 21 15:34:33.116860 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:33.116825    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/53841a71-2844-4102-88aa-69eb82c128db-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-qkm4z\" (UID: \"53841a71-2844-4102-88aa-69eb82c128db\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-qkm4z"
May 21 15:34:33.122164 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:33.122129    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2p9j\" (UniqueName: \"kubernetes.io/projected/53841a71-2844-4102-88aa-69eb82c128db-kube-api-access-n2p9j\") pod \"prometheus-operator-7779bbdd78-qkm4z\" (UID: \"53841a71-2844-4102-88aa-69eb82c128db\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-qkm4z"
May 21 15:34:33.299467 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:33.299382    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-qkm4z"
May 21 15:34:33.422567 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:33.422519    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-qkm4z"]
May 21 15:34:33.425405 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:34:33.425372    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53841a71_2844_4102_88aa_69eb82c128db.slice/crio-3cb12f9fa6701f0577576ace16fc0b576fe306bdb90ff830946203431a3b8ac2 WatchSource:0}: Error finding container 3cb12f9fa6701f0577576ace16fc0b576fe306bdb90ff830946203431a3b8ac2: Status 404 returned error can't find the container with id 3cb12f9fa6701f0577576ace16fc0b576fe306bdb90ff830946203431a3b8ac2
May 21 15:34:34.225688 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:34.225642    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-qkm4z" event={"ID":"53841a71-2844-4102-88aa-69eb82c128db","Type":"ContainerStarted","Data":"3cb12f9fa6701f0577576ace16fc0b576fe306bdb90ff830946203431a3b8ac2"}
May 21 15:34:35.231996 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:35.231913    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-qkm4z" event={"ID":"53841a71-2844-4102-88aa-69eb82c128db","Type":"ContainerStarted","Data":"c8289a13af350e73f8bea764eb680e1a5418dbff0a00e355b97f77cd71049576"}
May 21 15:34:35.231996 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:35.231950    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-qkm4z" event={"ID":"53841a71-2844-4102-88aa-69eb82c128db","Type":"ContainerStarted","Data":"ebc19e0904b6cc7d54ad1d4dc4a7f7651c7ad76f3cd664f6723e28be8f39f3d1"}
May 21 15:34:35.248662 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:35.248613    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-qkm4z" podStartSLOduration=1.725773977 podStartE2EDuration="3.248598726s" podCreationTimestamp="2026-05-21 15:34:32 +0000 UTC" firstStartedPulling="2026-05-21 15:34:33.427208415 +0000 UTC m=+134.147370935" lastFinishedPulling="2026-05-21 15:34:34.950033164 +0000 UTC m=+135.670195684" observedRunningTime="2026-05-21 15:34:35.247128797 +0000 UTC m=+135.967291334" watchObservedRunningTime="2026-05-21 15:34:35.248598726 +0000 UTC m=+135.968761310"
May 21 15:34:37.293497 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.293449    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-bk85s"]
May 21 15:34:37.296104 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.296084    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-bk85s"
May 21 15:34:37.298740 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.298555    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 21 15:34:37.298740 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.298559    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 21 15:34:37.298740 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.298721    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-mw2r2\""
May 21 15:34:37.302601 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.302577    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-frpqj"]
May 21 15:34:37.306328 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.304902    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.306840 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.306804    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-bk85s"]
May 21 15:34:37.308933 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.308581    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kt8nz\""
May 21 15:34:37.308933 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.308628    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 21 15:34:37.308933 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.308815    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 21 15:34:37.308933 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.308828    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 21 15:34:37.344958 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.344929    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58380163-c364-4a3d-92a7-b256b590c38f-node-exporter-wtmp\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.345159 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.344969    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58380163-c364-4a3d-92a7-b256b590c38f-node-exporter-accelerators-collector-config\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.345159 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.345004    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d030417-7063-40d7-80cd-7732da0989bb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-bk85s\" (UID: \"1d030417-7063-40d7-80cd-7732da0989bb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bk85s"
May 21 15:34:37.345159 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.345030    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58380163-c364-4a3d-92a7-b256b590c38f-sys\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.345159 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.345065    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58380163-c364-4a3d-92a7-b256b590c38f-node-exporter-tls\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.345159 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.345096    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58380163-c364-4a3d-92a7-b256b590c38f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.345159 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.345126    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58380163-c364-4a3d-92a7-b256b590c38f-metrics-client-ca\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.345480 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.345212    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6npf\" (UniqueName: \"kubernetes.io/projected/1d030417-7063-40d7-80cd-7732da0989bb-kube-api-access-x6npf\") pod \"openshift-state-metrics-9c959559f-bk85s\" (UID: \"1d030417-7063-40d7-80cd-7732da0989bb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bk85s"
May 21 15:34:37.345480 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.345252    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glfxb\" (UniqueName: \"kubernetes.io/projected/58380163-c364-4a3d-92a7-b256b590c38f-kube-api-access-glfxb\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.345480 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.345324    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58380163-c364-4a3d-92a7-b256b590c38f-root\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.345480 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.345374    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58380163-c364-4a3d-92a7-b256b590c38f-node-exporter-textfile\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.345480 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.345401    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d030417-7063-40d7-80cd-7732da0989bb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-bk85s\" (UID: \"1d030417-7063-40d7-80cd-7732da0989bb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bk85s"
May 21 15:34:37.345480 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.345434    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d030417-7063-40d7-80cd-7732da0989bb-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-bk85s\" (UID: \"1d030417-7063-40d7-80cd-7732da0989bb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bk85s"
May 21 15:34:37.446534 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.446493    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d030417-7063-40d7-80cd-7732da0989bb-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-bk85s\" (UID: \"1d030417-7063-40d7-80cd-7732da0989bb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bk85s"
May 21 15:34:37.446730 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.446582    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58380163-c364-4a3d-92a7-b256b590c38f-node-exporter-wtmp\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.446730 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.446615    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58380163-c364-4a3d-92a7-b256b590c38f-node-exporter-accelerators-collector-config\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.446730 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.446637    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d030417-7063-40d7-80cd-7732da0989bb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-bk85s\" (UID: \"1d030417-7063-40d7-80cd-7732da0989bb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bk85s"
May 21 15:34:37.446730 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.446658    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58380163-c364-4a3d-92a7-b256b590c38f-sys\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.446730 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.446683    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58380163-c364-4a3d-92a7-b256b590c38f-node-exporter-tls\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.446730 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.446710    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58380163-c364-4a3d-92a7-b256b590c38f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.447035 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.446751    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58380163-c364-4a3d-92a7-b256b590c38f-sys\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.447035 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.446911    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58380163-c364-4a3d-92a7-b256b590c38f-node-exporter-wtmp\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.447035 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.446948    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58380163-c364-4a3d-92a7-b256b590c38f-metrics-client-ca\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.447035 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.447004    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x6npf\" (UniqueName: \"kubernetes.io/projected/1d030417-7063-40d7-80cd-7732da0989bb-kube-api-access-x6npf\") pod \"openshift-state-metrics-9c959559f-bk85s\" (UID: \"1d030417-7063-40d7-80cd-7732da0989bb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bk85s"
May 21 15:34:37.447035 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:34:37.447010    2552 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 21 15:34:37.447283 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.447039    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-glfxb\" (UniqueName: \"kubernetes.io/projected/58380163-c364-4a3d-92a7-b256b590c38f-kube-api-access-glfxb\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.447283 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:34:37.447067    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58380163-c364-4a3d-92a7-b256b590c38f-node-exporter-tls podName:58380163-c364-4a3d-92a7-b256b590c38f nodeName:}" failed. No retries permitted until 2026-05-21 15:34:37.947047585 +0000 UTC m=+138.667210106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/58380163-c364-4a3d-92a7-b256b590c38f-node-exporter-tls") pod "node-exporter-frpqj" (UID: "58380163-c364-4a3d-92a7-b256b590c38f") : secret "node-exporter-tls" not found
May 21 15:34:37.447283 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.447106    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58380163-c364-4a3d-92a7-b256b590c38f-root\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.447283 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.447132    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58380163-c364-4a3d-92a7-b256b590c38f-node-exporter-textfile\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.447283 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.447160    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d030417-7063-40d7-80cd-7732da0989bb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-bk85s\" (UID: \"1d030417-7063-40d7-80cd-7732da0989bb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bk85s"
May 21 15:34:37.447283 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.447277    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58380163-c364-4a3d-92a7-b256b590c38f-node-exporter-accelerators-collector-config\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.447570 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.447343    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58380163-c364-4a3d-92a7-b256b590c38f-root\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.447822 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.447801    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58380163-c364-4a3d-92a7-b256b590c38f-node-exporter-textfile\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.448069 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.448048    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58380163-c364-4a3d-92a7-b256b590c38f-metrics-client-ca\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.448312 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.448293    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d030417-7063-40d7-80cd-7732da0989bb-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-bk85s\" (UID: \"1d030417-7063-40d7-80cd-7732da0989bb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bk85s"
May 21 15:34:37.449661 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.449640    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58380163-c364-4a3d-92a7-b256b590c38f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.450502 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.450473    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d030417-7063-40d7-80cd-7732da0989bb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-bk85s\" (UID: \"1d030417-7063-40d7-80cd-7732da0989bb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bk85s"
May 21 15:34:37.450605 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.450508    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d030417-7063-40d7-80cd-7732da0989bb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-bk85s\" (UID: \"1d030417-7063-40d7-80cd-7732da0989bb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bk85s"
May 21 15:34:37.458486 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.458411    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glfxb\" (UniqueName: \"kubernetes.io/projected/58380163-c364-4a3d-92a7-b256b590c38f-kube-api-access-glfxb\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.459405 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.459381    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6npf\" (UniqueName: \"kubernetes.io/projected/1d030417-7063-40d7-80cd-7732da0989bb-kube-api-access-x6npf\") pod \"openshift-state-metrics-9c959559f-bk85s\" (UID: \"1d030417-7063-40d7-80cd-7732da0989bb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bk85s"
May 21 15:34:37.612893 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.612806    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-bk85s"
May 21 15:34:37.748970 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.748335    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-bk85s"]
May 21 15:34:37.952005 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.951964    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58380163-c364-4a3d-92a7-b256b590c38f-node-exporter-tls\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:37.954271 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:37.954236    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58380163-c364-4a3d-92a7-b256b590c38f-node-exporter-tls\") pod \"node-exporter-frpqj\" (UID: \"58380163-c364-4a3d-92a7-b256b590c38f\") " pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:38.219775 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.219742    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-frpqj"
May 21 15:34:38.227913 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:34:38.227874    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58380163_c364_4a3d_92a7_b256b590c38f.slice/crio-e0737a8086b0bbb4b402a95daad6515559a85062aca885c85e08aa94a34c33ed WatchSource:0}: Error finding container e0737a8086b0bbb4b402a95daad6515559a85062aca885c85e08aa94a34c33ed: Status 404 returned error can't find the container with id e0737a8086b0bbb4b402a95daad6515559a85062aca885c85e08aa94a34c33ed
May 21 15:34:38.240509 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.240476    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-frpqj" event={"ID":"58380163-c364-4a3d-92a7-b256b590c38f","Type":"ContainerStarted","Data":"e0737a8086b0bbb4b402a95daad6515559a85062aca885c85e08aa94a34c33ed"}
May 21 15:34:38.242092 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.242069    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-bk85s" event={"ID":"1d030417-7063-40d7-80cd-7732da0989bb","Type":"ContainerStarted","Data":"1e4b3aceacfa993ec5a70b61beac18473333997d491e62c7f6c67cd95ee39783"}
May 21 15:34:38.242184 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.242100    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-bk85s" event={"ID":"1d030417-7063-40d7-80cd-7732da0989bb","Type":"ContainerStarted","Data":"57c51bccc66c8ad31a94d6ef022453c96be75fd78c63ff558d9ac64af002fa1f"}
May 21 15:34:38.242184 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.242114    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-bk85s" event={"ID":"1d030417-7063-40d7-80cd-7732da0989bb","Type":"ContainerStarted","Data":"47667dfc8c71f73213f9f8668deb799bc0c0723d4c34df9f3e94f8cfcf22638c"}
May 21 15:34:38.404599 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.404560    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 15:34:38.408117 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.408093    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.410900 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.410543    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 21 15:34:38.410900 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.410574    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 21 15:34:38.410900 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.410592    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 21 15:34:38.410900 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.410680    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 21 15:34:38.410900 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.410766    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6bvjh\""
May 21 15:34:38.410900 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.410777    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 21 15:34:38.410900 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.410816    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 21 15:34:38.411281 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.410906    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 21 15:34:38.411281 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.410917    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 21 15:34:38.411281 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.411019    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 21 15:34:38.420497 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.420475    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 15:34:38.456861 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.456820    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-config-volume\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.456861 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.456862    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-config-out\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.457082 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.456883    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.457082 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.456900    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.457082 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.456958    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.457082 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.457072    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.457296 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.457102    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.457296 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.457134    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.457296 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.457162    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-web-config\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.457296 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.457193    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qss9q\" (UniqueName: \"kubernetes.io/projected/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-kube-api-access-qss9q\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.457296 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.457232    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.457296 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.457271    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.457296 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.457295    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.558680 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.558586    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.558680 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.558654    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.558860 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.558684    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.558860 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.558723    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-config-volume\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.558860 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.558755    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-config-out\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.558860 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.558783    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.558860 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.558809    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.559145 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.558849    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.559145 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.558958    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.559145 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.558988    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.559145 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.559017    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.559145 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.559042    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-web-config\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.559145 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.559073    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qss9q\" (UniqueName: \"kubernetes.io/projected/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-kube-api-access-qss9q\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.559145 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:34:38.559075    2552 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
May 21 15:34:38.559494 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:34:38.559156    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-main-tls podName:d49c96ea-38a3-4e9c-aa9f-895fae222ef7 nodeName:}" failed. No retries permitted until 2026-05-21 15:34:39.059134792 +0000 UTC m=+139.779297322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "d49c96ea-38a3-4e9c-aa9f-895fae222ef7") : secret "alertmanager-main-tls" not found
May 21 15:34:38.560977 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.559757    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.560977 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.560648    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.562499 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.562471    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-config-volume\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.562643 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:34:38.562625    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-alertmanager-trusted-ca-bundle podName:d49c96ea-38a3-4e9c-aa9f-895fae222ef7 nodeName:}" failed. No retries permitted until 2026-05-21 15:34:39.062605958 +0000 UTC m=+139.782768480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "d49c96ea-38a3-4e9c-aa9f-895fae222ef7") : configmap references non-existent config key: ca-bundle.crt
May 21 15:34:38.564766 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.564706    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.565017 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.564995    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-web-config\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.565276 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.565236    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.565687 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.565659    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.565819 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.565802    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.565949 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.565930    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-config-out\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.566246 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.566226    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:38.575096 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:38.575056    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qss9q\" (UniqueName: \"kubernetes.io/projected/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-kube-api-access-qss9q\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:39.064356 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:39.064318    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:39.064539 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:39.064391    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:39.064585 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:34:39.064562    2552 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
May 21 15:34:39.064655 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:34:39.064642    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-main-tls podName:d49c96ea-38a3-4e9c-aa9f-895fae222ef7 nodeName:}" failed. No retries permitted until 2026-05-21 15:34:40.064622305 +0000 UTC m=+140.784784828 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "d49c96ea-38a3-4e9c-aa9f-895fae222ef7") : secret "alertmanager-main-tls" not found
May 21 15:34:39.065045 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:39.065025    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:40.074939 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.074905    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:40.077213 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.077193    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:40.218857 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.218823    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 15:34:40.251324 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.251234    2552 generic.go:358] "Generic (PLEG): container finished" podID="58380163-c364-4a3d-92a7-b256b590c38f" containerID="022a83cdaa4d094b506a28d0888911fcf24fe0d59dd9e2f571a0712368f1e013" exitCode=0
May 21 15:34:40.251473 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.251321    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-frpqj" event={"ID":"58380163-c364-4a3d-92a7-b256b590c38f","Type":"ContainerDied","Data":"022a83cdaa4d094b506a28d0888911fcf24fe0d59dd9e2f571a0712368f1e013"}
May 21 15:34:40.253971 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.253944    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-bk85s" event={"ID":"1d030417-7063-40d7-80cd-7732da0989bb","Type":"ContainerStarted","Data":"ca325571f1b04f5c13c16988cb572193d02a9d54c50b47a80185e40e04618105"}
May 21 15:34:40.294140 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.294082    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-bk85s" podStartSLOduration=1.8290290759999999 podStartE2EDuration="3.294061329s" podCreationTimestamp="2026-05-21 15:34:37 +0000 UTC" firstStartedPulling="2026-05-21 15:34:37.890119557 +0000 UTC m=+138.610282081" lastFinishedPulling="2026-05-21 15:34:39.355151799 +0000 UTC m=+140.075314334" observedRunningTime="2026-05-21 15:34:40.293765015 +0000 UTC m=+141.013927554" watchObservedRunningTime="2026-05-21 15:34:40.294061329 +0000 UTC m=+141.014223869"
May 21 15:34:40.379486 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.379455    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 15:34:40.382510 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:34:40.382478    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd49c96ea_38a3_4e9c_aa9f_895fae222ef7.slice/crio-6173083911de968dc7c7029caf51c6a5cfb86f9f2b1448974d6955c922330b64 WatchSource:0}: Error finding container 6173083911de968dc7c7029caf51c6a5cfb86f9f2b1448974d6955c922330b64: Status 404 returned error can't find the container with id 6173083911de968dc7c7029caf51c6a5cfb86f9f2b1448974d6955c922330b64
May 21 15:34:40.459387 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.459354    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-687b844f85-kpgpq"]
May 21 15:34:40.463108 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.463078    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.465551 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.465526    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 21 15:34:40.465689 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.465655    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-djs2q\""
May 21 15:34:40.465745 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.465729    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cmsqb57b4rlnd\""
May 21 15:34:40.465978 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.465915    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 21 15:34:40.465978 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.465935    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 21 15:34:40.466124 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.465990    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 21 15:34:40.466124 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.466018    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 21 15:34:40.473388 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.473368    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-687b844f85-kpgpq"]
May 21 15:34:40.584027 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.583935    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/76ce92de-a2a4-4185-b19f-8c6a513e115e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-687b844f85-kpgpq\" (UID: \"76ce92de-a2a4-4185-b19f-8c6a513e115e\") " pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.584027 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.583990    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/76ce92de-a2a4-4185-b19f-8c6a513e115e-secret-thanos-querier-tls\") pod \"thanos-querier-687b844f85-kpgpq\" (UID: \"76ce92de-a2a4-4185-b19f-8c6a513e115e\") " pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.584027 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.584020    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgjwq\" (UniqueName: \"kubernetes.io/projected/76ce92de-a2a4-4185-b19f-8c6a513e115e-kube-api-access-hgjwq\") pod \"thanos-querier-687b844f85-kpgpq\" (UID: \"76ce92de-a2a4-4185-b19f-8c6a513e115e\") " pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.584250 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.584075    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76ce92de-a2a4-4185-b19f-8c6a513e115e-metrics-client-ca\") pod \"thanos-querier-687b844f85-kpgpq\" (UID: \"76ce92de-a2a4-4185-b19f-8c6a513e115e\") " pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.584250 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.584106    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/76ce92de-a2a4-4185-b19f-8c6a513e115e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-687b844f85-kpgpq\" (UID: \"76ce92de-a2a4-4185-b19f-8c6a513e115e\") " pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.584250 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.584127    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/76ce92de-a2a4-4185-b19f-8c6a513e115e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-687b844f85-kpgpq\" (UID: \"76ce92de-a2a4-4185-b19f-8c6a513e115e\") " pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.584250 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.584230    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/76ce92de-a2a4-4185-b19f-8c6a513e115e-secret-grpc-tls\") pod \"thanos-querier-687b844f85-kpgpq\" (UID: \"76ce92de-a2a4-4185-b19f-8c6a513e115e\") " pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.584442 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.584286    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/76ce92de-a2a4-4185-b19f-8c6a513e115e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-687b844f85-kpgpq\" (UID: \"76ce92de-a2a4-4185-b19f-8c6a513e115e\") " pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.684710 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.684673    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/76ce92de-a2a4-4185-b19f-8c6a513e115e-secret-grpc-tls\") pod \"thanos-querier-687b844f85-kpgpq\" (UID: \"76ce92de-a2a4-4185-b19f-8c6a513e115e\") " pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.684710 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.684712    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/76ce92de-a2a4-4185-b19f-8c6a513e115e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-687b844f85-kpgpq\" (UID: \"76ce92de-a2a4-4185-b19f-8c6a513e115e\") " pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.684906 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.684812    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/76ce92de-a2a4-4185-b19f-8c6a513e115e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-687b844f85-kpgpq\" (UID: \"76ce92de-a2a4-4185-b19f-8c6a513e115e\") " pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.684906 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.684836    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/76ce92de-a2a4-4185-b19f-8c6a513e115e-secret-thanos-querier-tls\") pod \"thanos-querier-687b844f85-kpgpq\" (UID: \"76ce92de-a2a4-4185-b19f-8c6a513e115e\") " pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.684906 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.684855    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hgjwq\" (UniqueName: \"kubernetes.io/projected/76ce92de-a2a4-4185-b19f-8c6a513e115e-kube-api-access-hgjwq\") pod \"thanos-querier-687b844f85-kpgpq\" (UID: \"76ce92de-a2a4-4185-b19f-8c6a513e115e\") " pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.684906 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.684878    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76ce92de-a2a4-4185-b19f-8c6a513e115e-metrics-client-ca\") pod \"thanos-querier-687b844f85-kpgpq\" (UID: \"76ce92de-a2a4-4185-b19f-8c6a513e115e\") " pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.684906 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.684900    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/76ce92de-a2a4-4185-b19f-8c6a513e115e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-687b844f85-kpgpq\" (UID: \"76ce92de-a2a4-4185-b19f-8c6a513e115e\") " pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.685130 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.685015    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/76ce92de-a2a4-4185-b19f-8c6a513e115e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-687b844f85-kpgpq\" (UID: \"76ce92de-a2a4-4185-b19f-8c6a513e115e\") " pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.685684 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.685653    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76ce92de-a2a4-4185-b19f-8c6a513e115e-metrics-client-ca\") pod \"thanos-querier-687b844f85-kpgpq\" (UID: \"76ce92de-a2a4-4185-b19f-8c6a513e115e\") " pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.687601 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.687550    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/76ce92de-a2a4-4185-b19f-8c6a513e115e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-687b844f85-kpgpq\" (UID: \"76ce92de-a2a4-4185-b19f-8c6a513e115e\") " pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.687781 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.687760    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/76ce92de-a2a4-4185-b19f-8c6a513e115e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-687b844f85-kpgpq\" (UID: \"76ce92de-a2a4-4185-b19f-8c6a513e115e\") " pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.687902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.687879    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/76ce92de-a2a4-4185-b19f-8c6a513e115e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-687b844f85-kpgpq\" (UID: \"76ce92de-a2a4-4185-b19f-8c6a513e115e\") " pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.687954 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.687933    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/76ce92de-a2a4-4185-b19f-8c6a513e115e-secret-grpc-tls\") pod \"thanos-querier-687b844f85-kpgpq\" (UID: \"76ce92de-a2a4-4185-b19f-8c6a513e115e\") " pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.688311 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.688291    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/76ce92de-a2a4-4185-b19f-8c6a513e115e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-687b844f85-kpgpq\" (UID: \"76ce92de-a2a4-4185-b19f-8c6a513e115e\") " pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.688384 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.688317    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/76ce92de-a2a4-4185-b19f-8c6a513e115e-secret-thanos-querier-tls\") pod \"thanos-querier-687b844f85-kpgpq\" (UID: \"76ce92de-a2a4-4185-b19f-8c6a513e115e\") " pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.692813 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.692786    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgjwq\" (UniqueName: \"kubernetes.io/projected/76ce92de-a2a4-4185-b19f-8c6a513e115e-kube-api-access-hgjwq\") pod \"thanos-querier-687b844f85-kpgpq\" (UID: \"76ce92de-a2a4-4185-b19f-8c6a513e115e\") " pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.773765 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.773727    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:40.901008 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:40.900975    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-687b844f85-kpgpq"]
May 21 15:34:40.904207 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:34:40.904171    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76ce92de_a2a4_4185_b19f_8c6a513e115e.slice/crio-296c1e5d8cc725a06ca89cfc4e0574bda8a5bd588ed19271f7ff5c081812482f WatchSource:0}: Error finding container 296c1e5d8cc725a06ca89cfc4e0574bda8a5bd588ed19271f7ff5c081812482f: Status 404 returned error can't find the container with id 296c1e5d8cc725a06ca89cfc4e0574bda8a5bd588ed19271f7ff5c081812482f
May 21 15:34:41.258447 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:41.258414    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq" event={"ID":"76ce92de-a2a4-4185-b19f-8c6a513e115e","Type":"ContainerStarted","Data":"296c1e5d8cc725a06ca89cfc4e0574bda8a5bd588ed19271f7ff5c081812482f"}
May 21 15:34:41.260234 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:41.260203    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-frpqj" event={"ID":"58380163-c364-4a3d-92a7-b256b590c38f","Type":"ContainerStarted","Data":"372a0517eb4b07ef16712967ea4b1ef6d4644c3fd5a25aad873744537f8efe9e"}
May 21 15:34:41.260234 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:41.260230    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-frpqj" event={"ID":"58380163-c364-4a3d-92a7-b256b590c38f","Type":"ContainerStarted","Data":"a5441ffec67b09f2a44597f1b9090ecb1045512899e49d06e1ce2de8cf735bb1"}
May 21 15:34:41.261367 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:41.261345    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d49c96ea-38a3-4e9c-aa9f-895fae222ef7","Type":"ContainerStarted","Data":"6173083911de968dc7c7029caf51c6a5cfb86f9f2b1448974d6955c922330b64"}
May 21 15:34:41.284439 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:41.284375    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-frpqj" podStartSLOduration=3.160467456 podStartE2EDuration="4.284355759s" podCreationTimestamp="2026-05-21 15:34:37 +0000 UTC" firstStartedPulling="2026-05-21 15:34:38.22995147 +0000 UTC m=+138.950113997" lastFinishedPulling="2026-05-21 15:34:39.35383977 +0000 UTC m=+140.074002300" observedRunningTime="2026-05-21 15:34:41.282326041 +0000 UTC m=+142.002488580" watchObservedRunningTime="2026-05-21 15:34:41.284355759 +0000 UTC m=+142.004518298"
May 21 15:34:42.265803 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:42.265763    2552 generic.go:358] "Generic (PLEG): container finished" podID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerID="b28e5bfcbfb21f4737095e139ca805a860628e21d8bdb3af33da2d132efc4edc" exitCode=0
May 21 15:34:42.266532 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:42.265927    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d49c96ea-38a3-4e9c-aa9f-895fae222ef7","Type":"ContainerDied","Data":"b28e5bfcbfb21f4737095e139ca805a860628e21d8bdb3af33da2d132efc4edc"}
May 21 15:34:43.271989 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.271942    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq" event={"ID":"76ce92de-a2a4-4185-b19f-8c6a513e115e","Type":"ContainerStarted","Data":"e9453bd3bd35bd13024bd65f301df5490f6aae4355ee243b5f21b425e5476810"}
May 21 15:34:43.271989 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.271984    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq" event={"ID":"76ce92de-a2a4-4185-b19f-8c6a513e115e","Type":"ContainerStarted","Data":"14e76217068a9036abab9f7c8fd693c6b9ed11215ab3808e29d2a85ea8ad3ced"}
May 21 15:34:43.271989 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.271997    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq" event={"ID":"76ce92de-a2a4-4185-b19f-8c6a513e115e","Type":"ContainerStarted","Data":"e4b347c79f303edd10ea548800a8894e6172e8d2d19957ddd53cc055a2b9e785"}
May 21 15:34:43.520039 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.520002    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 15:34:43.523207 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.523133    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.525565 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.525538    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 21 15:34:43.526135 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.525800    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 21 15:34:43.526135 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.525854    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 21 15:34:43.526135 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.525879    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 21 15:34:43.526135 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.525970    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 21 15:34:43.526135 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.526036    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 21 15:34:43.526501 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.526401    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6l5fr\""
May 21 15:34:43.527059 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.526904    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 21 15:34:43.527059 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.526934    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 21 15:34:43.527059 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.527007    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 21 15:34:43.529894 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.529870    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 21 15:34:43.529894 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.529885    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 21 15:34:43.530065 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.530011    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2lq6tuok3gjsq\""
May 21 15:34:43.530595 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.530575    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 21 15:34:43.530805 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.530783    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 21 15:34:43.536802 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.536780    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 15:34:43.614437 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.614399    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.614711 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.614690    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-config-out\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.614827 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.614814    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.614985 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.614970    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.615104 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.615082    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.615184 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.615115    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.615184 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.615152    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.615306 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.615181    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-config\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.615306 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.615223    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.615306 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.615290    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.615462 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.615317    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.615462 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.615347    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.615462 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.615376    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-web-config\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.615462 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.615416    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.615462 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.615441    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.615619 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.615515    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.615619 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.615552    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.615619 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.615589    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wt96\" (UniqueName: \"kubernetes.io/projected/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-kube-api-access-5wt96\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.716347 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.716195    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.716347 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.716381    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.716618 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.716440    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wt96\" (UniqueName: \"kubernetes.io/projected/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-kube-api-access-5wt96\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.716618 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.716499    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.716618 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.716533    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-config-out\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.716618 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.716559    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.717602 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.716792    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.717602 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.716935    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.717602 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.716988    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.717602 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.717020    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.717602 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.717053    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-config\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.717602 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.717096    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.717602 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.717148    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.717602 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.717172    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.717602 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.717207    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.717602 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.717229    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-web-config\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.717602 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.717277    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.717602 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.717353    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.718241 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.718205    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.718326 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.717577    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.719581 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.719508    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.721088 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.720531    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.721987 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.721218    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.721987 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.721369    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.730676 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.724989    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.730676 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.725519    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-web-config\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.730676 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.729675    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-config\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.731677 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.731654    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.732225 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.732198    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.737748 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.737719    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-config-out\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.738314 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.738289    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.738717 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.738646    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.739945 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.739920    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.740289 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.740246    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.741865 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.741843    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wt96\" (UniqueName: \"kubernetes.io/projected/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-kube-api-access-5wt96\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.742394 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.742373    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:43.838351 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:43.837778    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:44.016489 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:44.015918    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 15:34:44.037914 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:34:44.037878    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6b73b8d_f902_415f_a4f7_50abd9fe0a72.slice/crio-4e9a8632d5126a123590ca888e3450e63ca7b702c590fad2c2c471e690a91e6f WatchSource:0}: Error finding container 4e9a8632d5126a123590ca888e3450e63ca7b702c590fad2c2c471e690a91e6f: Status 404 returned error can't find the container with id 4e9a8632d5126a123590ca888e3450e63ca7b702c590fad2c2c471e690a91e6f
May 21 15:34:44.276950 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:44.276907    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6b73b8d-f902-415f-a4f7-50abd9fe0a72","Type":"ContainerStarted","Data":"4e9a8632d5126a123590ca888e3450e63ca7b702c590fad2c2c471e690a91e6f"}
May 21 15:34:45.282120 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:45.282081    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq" event={"ID":"76ce92de-a2a4-4185-b19f-8c6a513e115e","Type":"ContainerStarted","Data":"62f33b3e84fbf7013c395b4d2b62193f8273d164cca732f855d785e245a792e7"}
May 21 15:34:45.282120 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:45.282123    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq" event={"ID":"76ce92de-a2a4-4185-b19f-8c6a513e115e","Type":"ContainerStarted","Data":"375e2659e1eb3cb5e1c9c52b553208cc1fc42bc755b0e009d63737789b01f930"}
May 21 15:34:45.282622 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:45.282136    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq" event={"ID":"76ce92de-a2a4-4185-b19f-8c6a513e115e","Type":"ContainerStarted","Data":"e8030d26a06b57342404b858d7d2a20e0385568b4c294c0dbe5a9016d375201d"}
May 21 15:34:45.282622 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:45.282334    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:45.283405 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:45.283378    2552 generic.go:358] "Generic (PLEG): container finished" podID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerID="e508f7eb0f5f6bec4f849277f111b5883be6232426786f8a4f0231dcba56e014" exitCode=0
May 21 15:34:45.283515 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:45.283460    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6b73b8d-f902-415f-a4f7-50abd9fe0a72","Type":"ContainerDied","Data":"e508f7eb0f5f6bec4f849277f111b5883be6232426786f8a4f0231dcba56e014"}
May 21 15:34:45.286626 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:45.286594    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d49c96ea-38a3-4e9c-aa9f-895fae222ef7","Type":"ContainerStarted","Data":"38845541cb3aa547a550a4f6f077489af4bc4b0f42b510254c96228c3996d36b"}
May 21 15:34:45.286713 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:45.286627    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d49c96ea-38a3-4e9c-aa9f-895fae222ef7","Type":"ContainerStarted","Data":"e15de93f787c2f956726fb1bbab5e9bdd1a28ccb983e737d025451362e9b71ba"}
May 21 15:34:45.286713 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:45.286641    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d49c96ea-38a3-4e9c-aa9f-895fae222ef7","Type":"ContainerStarted","Data":"88eaccf173a2bf2359300317aaa562f39be4385d4da601df044ec65066b21ff3"}
May 21 15:34:45.286713 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:45.286654    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d49c96ea-38a3-4e9c-aa9f-895fae222ef7","Type":"ContainerStarted","Data":"46419e62d8e0428ce445add02903425bf66459af0609169d66f667ad61738230"}
May 21 15:34:45.286713 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:45.286666    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d49c96ea-38a3-4e9c-aa9f-895fae222ef7","Type":"ContainerStarted","Data":"1cda3bde4dec474e0f4d05187e1175a715083539c1bbaa061a2b17ac656d9672"}
May 21 15:34:45.286713 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:45.286678    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d49c96ea-38a3-4e9c-aa9f-895fae222ef7","Type":"ContainerStarted","Data":"9e2b28340689d2a3437a686b334cdcfb410de8ff094032dddeb3f067da0f8695"}
May 21 15:34:45.304819 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:45.304755    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq" podStartSLOduration=1.819002628 podStartE2EDuration="5.304738862s" podCreationTimestamp="2026-05-21 15:34:40 +0000 UTC" firstStartedPulling="2026-05-21 15:34:40.905924136 +0000 UTC m=+141.626086656" lastFinishedPulling="2026-05-21 15:34:44.391660375 +0000 UTC m=+145.111822890" observedRunningTime="2026-05-21 15:34:45.302861249 +0000 UTC m=+146.023023799" watchObservedRunningTime="2026-05-21 15:34:45.304738862 +0000 UTC m=+146.024901401"
May 21 15:34:45.332164 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:45.332114    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.320054539 podStartE2EDuration="7.332098877s" podCreationTimestamp="2026-05-21 15:34:38 +0000 UTC" firstStartedPulling="2026-05-21 15:34:40.384424353 +0000 UTC m=+141.104586869" lastFinishedPulling="2026-05-21 15:34:44.396468675 +0000 UTC m=+145.116631207" observedRunningTime="2026-05-21 15:34:45.329984359 +0000 UTC m=+146.050146897" watchObservedRunningTime="2026-05-21 15:34:45.332098877 +0000 UTC m=+146.052261415"
May 21 15:34:49.304825 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:49.304745    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6b73b8d-f902-415f-a4f7-50abd9fe0a72","Type":"ContainerStarted","Data":"040771f44842e62c6095527b7ac49c32c7c67b9613ba18487c614084c44f6934"}
May 21 15:34:49.304825 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:49.304780    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6b73b8d-f902-415f-a4f7-50abd9fe0a72","Type":"ContainerStarted","Data":"222f3995b814669e43aa7387f0896bbdaf5c40ffcc0ef32e04f07d06730ea97c"}
May 21 15:34:49.304825 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:49.304789    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6b73b8d-f902-415f-a4f7-50abd9fe0a72","Type":"ContainerStarted","Data":"8bf1153f39c6b6f202db14a2906e077a7859abcecb581c02e1231b61340fbab6"}
May 21 15:34:49.304825 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:49.304798    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6b73b8d-f902-415f-a4f7-50abd9fe0a72","Type":"ContainerStarted","Data":"53fab06699e3aa597b09d067b0f2f7657e974849bd9f0862e301653242e8d584"}
May 21 15:34:49.304825 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:49.304806    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6b73b8d-f902-415f-a4f7-50abd9fe0a72","Type":"ContainerStarted","Data":"6d5b4363e93d3581a287d518f3971c258d9acb3a2441b8341661abaa35f747a6"}
May 21 15:34:49.304825 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:49.304814    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6b73b8d-f902-415f-a4f7-50abd9fe0a72","Type":"ContainerStarted","Data":"f5fa6cf2ca8304fa4cdc0a1e2db64c1aa5a13b35e65aec3e93b8d32217b54603"}
May 21 15:34:49.331971 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:49.331882    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.939409599 podStartE2EDuration="6.331864335s" podCreationTimestamp="2026-05-21 15:34:43 +0000 UTC" firstStartedPulling="2026-05-21 15:34:45.284596148 +0000 UTC m=+146.004758664" lastFinishedPulling="2026-05-21 15:34:48.677050878 +0000 UTC m=+149.397213400" observedRunningTime="2026-05-21 15:34:49.329467571 +0000 UTC m=+150.049630109" watchObservedRunningTime="2026-05-21 15:34:49.331864335 +0000 UTC m=+150.052026875"
May 21 15:34:51.298032 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:51.298003    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-687b844f85-kpgpq"
May 21 15:34:53.839301 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:53.839239    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:34:56.224289 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:34:56.224205    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-frrjc" podUID="048c373f-4ec1-416d-9720-992cc8c4a7d7"
May 21 15:34:56.244968 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:34:56.244928    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-79k9q" podUID="c5ac7608-600f-40c3-96e3-7d09db3d0aeb"
May 21 15:34:56.326557 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:56.326521    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-79k9q"
May 21 15:34:56.326722 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:34:56.326523    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-frrjc"
May 21 15:35:01.185049 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:01.184965    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert\") pod \"ingress-canary-79k9q\" (UID: \"c5ac7608-600f-40c3-96e3-7d09db3d0aeb\") " pod="openshift-ingress-canary/ingress-canary-79k9q"
May 21 15:35:01.185049 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:01.185005    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls\") pod \"dns-default-frrjc\" (UID: \"048c373f-4ec1-416d-9720-992cc8c4a7d7\") " pod="openshift-dns/dns-default-frrjc"
May 21 15:35:01.187346 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:01.187316    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048c373f-4ec1-416d-9720-992cc8c4a7d7-metrics-tls\") pod \"dns-default-frrjc\" (UID: \"048c373f-4ec1-416d-9720-992cc8c4a7d7\") " pod="openshift-dns/dns-default-frrjc"
May 21 15:35:01.187467 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:01.187445    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5ac7608-600f-40c3-96e3-7d09db3d0aeb-cert\") pod \"ingress-canary-79k9q\" (UID: \"c5ac7608-600f-40c3-96e3-7d09db3d0aeb\") " pod="openshift-ingress-canary/ingress-canary-79k9q"
May 21 15:35:01.429909 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:01.429878    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2wggx\""
May 21 15:35:01.430688 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:01.430669    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5bcp9\""
May 21 15:35:01.438528 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:01.438471    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-79k9q"
May 21 15:35:01.438528 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:01.438506    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-frrjc"
May 21 15:35:01.573209 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:01.573177    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-frrjc"]
May 21 15:35:01.576393 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:35:01.576357    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod048c373f_4ec1_416d_9720_992cc8c4a7d7.slice/crio-536a30067a34ce16efe8e0e26ac7fbd2857a8f83231d1723bb52a29df7592dbb WatchSource:0}: Error finding container 536a30067a34ce16efe8e0e26ac7fbd2857a8f83231d1723bb52a29df7592dbb: Status 404 returned error can't find the container with id 536a30067a34ce16efe8e0e26ac7fbd2857a8f83231d1723bb52a29df7592dbb
May 21 15:35:01.587773 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:01.587750    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-79k9q"]
May 21 15:35:01.590144 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:35:01.590117    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ac7608_600f_40c3_96e3_7d09db3d0aeb.slice/crio-ce5e961451d91a18669365d82c0879a0c5fbc59d693539ffb0ecceb32c625a31 WatchSource:0}: Error finding container ce5e961451d91a18669365d82c0879a0c5fbc59d693539ffb0ecceb32c625a31: Status 404 returned error can't find the container with id ce5e961451d91a18669365d82c0879a0c5fbc59d693539ffb0ecceb32c625a31
May 21 15:35:02.345169 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:02.345129    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-79k9q" event={"ID":"c5ac7608-600f-40c3-96e3-7d09db3d0aeb","Type":"ContainerStarted","Data":"ce5e961451d91a18669365d82c0879a0c5fbc59d693539ffb0ecceb32c625a31"}
May 21 15:35:02.346549 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:02.346513    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-frrjc" event={"ID":"048c373f-4ec1-416d-9720-992cc8c4a7d7","Type":"ContainerStarted","Data":"536a30067a34ce16efe8e0e26ac7fbd2857a8f83231d1723bb52a29df7592dbb"}
May 21 15:35:04.354226 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:04.354188    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-79k9q" event={"ID":"c5ac7608-600f-40c3-96e3-7d09db3d0aeb","Type":"ContainerStarted","Data":"83d39ab15bafb3b4bb540fdb6b5ac3e2e8ac297512fb24de51bdb85b84b225b6"}
May 21 15:35:04.355747 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:04.355725    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-frrjc" event={"ID":"048c373f-4ec1-416d-9720-992cc8c4a7d7","Type":"ContainerStarted","Data":"0660abc8708c60629817815a1a73a799bb795b756089d311b7e8aafdf9bddc0e"}
May 21 15:35:04.355853 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:04.355752    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-frrjc" event={"ID":"048c373f-4ec1-416d-9720-992cc8c4a7d7","Type":"ContainerStarted","Data":"ba3e73920702afbf364399f689945521ef37f17a3733102fcd64625b528c01fc"}
May 21 15:35:04.355853 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:04.355840    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-frrjc"
May 21 15:35:04.370987 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:04.370944    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-79k9q" podStartSLOduration=129.433915243 podStartE2EDuration="2m11.370931208s" podCreationTimestamp="2026-05-21 15:32:53 +0000 UTC" firstStartedPulling="2026-05-21 15:35:01.592193235 +0000 UTC m=+162.312355755" lastFinishedPulling="2026-05-21 15:35:03.529209204 +0000 UTC m=+164.249371720" observedRunningTime="2026-05-21 15:35:04.370002445 +0000 UTC m=+165.090164994" watchObservedRunningTime="2026-05-21 15:35:04.370931208 +0000 UTC m=+165.091093747"
May 21 15:35:04.387288 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:04.387215    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-frrjc" podStartSLOduration=129.438778728 podStartE2EDuration="2m11.387195562s" podCreationTimestamp="2026-05-21 15:32:53 +0000 UTC" firstStartedPulling="2026-05-21 15:35:01.578431017 +0000 UTC m=+162.298593533" lastFinishedPulling="2026-05-21 15:35:03.52684785 +0000 UTC m=+164.247010367" observedRunningTime="2026-05-21 15:35:04.385950746 +0000 UTC m=+165.106113276" watchObservedRunningTime="2026-05-21 15:35:04.387195562 +0000 UTC m=+165.107358100"
May 21 15:35:09.371833 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:09.371795    2552 generic.go:358] "Generic (PLEG): container finished" podID="3a9b516d-7367-4b03-80f2-79812b492374" containerID="b3ed77a2bb3232a76582d25778c02b670430b797fcff663bdc7b03ce97a95fac" exitCode=0
May 21 15:35:09.372278 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:09.371862    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nsf22" event={"ID":"3a9b516d-7367-4b03-80f2-79812b492374","Type":"ContainerDied","Data":"b3ed77a2bb3232a76582d25778c02b670430b797fcff663bdc7b03ce97a95fac"}
May 21 15:35:09.372278 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:09.372137    2552 scope.go:117] "RemoveContainer" containerID="b3ed77a2bb3232a76582d25778c02b670430b797fcff663bdc7b03ce97a95fac"
May 21 15:35:10.380887 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:10.380821    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-nsf22" event={"ID":"3a9b516d-7367-4b03-80f2-79812b492374","Type":"ContainerStarted","Data":"c017b7206b0b1db2dcefc73e3900c4da331708c2c5b707e257c728d74ac45cc7"}
May 21 15:35:14.360965 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:14.360937    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-frrjc"
May 21 15:35:28.437651 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:28.437615    2552 generic.go:358] "Generic (PLEG): container finished" podID="f3525871-7436-4b57-b837-22389075c03f" containerID="8f9bc5fe92e80b5ab39d3f72c82caa20c523c530120b761855de1fba75f9b968" exitCode=0
May 21 15:35:28.438100 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:28.437691    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-6r828" event={"ID":"f3525871-7436-4b57-b837-22389075c03f","Type":"ContainerDied","Data":"8f9bc5fe92e80b5ab39d3f72c82caa20c523c530120b761855de1fba75f9b968"}
May 21 15:35:28.438173 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:28.438127    2552 scope.go:117] "RemoveContainer" containerID="8f9bc5fe92e80b5ab39d3f72c82caa20c523c530120b761855de1fba75f9b968"
May 21 15:35:29.442574 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:29.442540    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-6r828" event={"ID":"f3525871-7436-4b57-b837-22389075c03f","Type":"ContainerStarted","Data":"4d9e3810994de9fe3886f3daf3f722b7d937d2cd16b567570cce1112e2227c5b"}
May 21 15:35:43.839077 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:43.839042    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:35:43.858234 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:43.858207    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:35:44.505333 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:44.505303    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:35:57.731438 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:57.731399    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 15:35:57.731943 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:57.731884    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="alertmanager" containerID="cri-o://9e2b28340689d2a3437a686b334cdcfb410de8ff094032dddeb3f067da0f8695" gracePeriod=120
May 21 15:35:57.732145 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:57.732093    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="config-reloader" containerID="cri-o://1cda3bde4dec474e0f4d05187e1175a715083539c1bbaa061a2b17ac656d9672" gracePeriod=120
May 21 15:35:57.732282 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:57.731942    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="kube-rbac-proxy-metric" containerID="cri-o://e15de93f787c2f956726fb1bbab5e9bdd1a28ccb983e737d025451362e9b71ba" gracePeriod=120
May 21 15:35:57.732282 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:57.731969    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="kube-rbac-proxy-web" containerID="cri-o://46419e62d8e0428ce445add02903425bf66459af0609169d66f667ad61738230" gracePeriod=120
May 21 15:35:57.732282 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:57.731998    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="kube-rbac-proxy" containerID="cri-o://88eaccf173a2bf2359300317aaa562f39be4385d4da601df044ec65066b21ff3" gracePeriod=120
May 21 15:35:57.732282 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:57.732020    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="prom-label-proxy" containerID="cri-o://38845541cb3aa547a550a4f6f077489af4bc4b0f42b510254c96228c3996d36b" gracePeriod=120
May 21 15:35:58.531921 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:58.531885    2552 generic.go:358] "Generic (PLEG): container finished" podID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerID="38845541cb3aa547a550a4f6f077489af4bc4b0f42b510254c96228c3996d36b" exitCode=0
May 21 15:35:58.531921 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:58.531911    2552 generic.go:358] "Generic (PLEG): container finished" podID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerID="e15de93f787c2f956726fb1bbab5e9bdd1a28ccb983e737d025451362e9b71ba" exitCode=0
May 21 15:35:58.531921 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:58.531919    2552 generic.go:358] "Generic (PLEG): container finished" podID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerID="88eaccf173a2bf2359300317aaa562f39be4385d4da601df044ec65066b21ff3" exitCode=0
May 21 15:35:58.531921 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:58.531926    2552 generic.go:358] "Generic (PLEG): container finished" podID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerID="1cda3bde4dec474e0f4d05187e1175a715083539c1bbaa061a2b17ac656d9672" exitCode=0
May 21 15:35:58.531921 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:58.531932    2552 generic.go:358] "Generic (PLEG): container finished" podID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerID="9e2b28340689d2a3437a686b334cdcfb410de8ff094032dddeb3f067da0f8695" exitCode=0
May 21 15:35:58.532227 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:58.531962    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d49c96ea-38a3-4e9c-aa9f-895fae222ef7","Type":"ContainerDied","Data":"38845541cb3aa547a550a4f6f077489af4bc4b0f42b510254c96228c3996d36b"}
May 21 15:35:58.532227 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:58.532002    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d49c96ea-38a3-4e9c-aa9f-895fae222ef7","Type":"ContainerDied","Data":"e15de93f787c2f956726fb1bbab5e9bdd1a28ccb983e737d025451362e9b71ba"}
May 21 15:35:58.532227 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:58.532014    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d49c96ea-38a3-4e9c-aa9f-895fae222ef7","Type":"ContainerDied","Data":"88eaccf173a2bf2359300317aaa562f39be4385d4da601df044ec65066b21ff3"}
May 21 15:35:58.532227 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:58.532025    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d49c96ea-38a3-4e9c-aa9f-895fae222ef7","Type":"ContainerDied","Data":"1cda3bde4dec474e0f4d05187e1175a715083539c1bbaa061a2b17ac656d9672"}
May 21 15:35:58.532227 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:58.532034    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d49c96ea-38a3-4e9c-aa9f-895fae222ef7","Type":"ContainerDied","Data":"9e2b28340689d2a3437a686b334cdcfb410de8ff094032dddeb3f067da0f8695"}
May 21 15:35:58.978006 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:58.977983    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.074398 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.074315    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-kube-rbac-proxy\") pod \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") "
May 21 15:35:59.074398 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.074353    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-metrics-client-ca\") pod \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") "
May 21 15:35:59.074599 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.074551    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-config-out\") pod \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") "
May 21 15:35:59.074599 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.074592    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-alertmanager-main-db\") pod \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") "
May 21 15:35:59.074706 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.074659    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-kube-rbac-proxy-web\") pod \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") "
May 21 15:35:59.074706 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.074691    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-web-config\") pod \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") "
May 21 15:35:59.074802 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.074701    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d49c96ea-38a3-4e9c-aa9f-895fae222ef7" (UID: "d49c96ea-38a3-4e9c-aa9f-895fae222ef7"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:35:59.074802 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.074723    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-cluster-tls-config\") pod \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") "
May 21 15:35:59.074802 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.074763    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-tls-assets\") pod \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") "
May 21 15:35:59.074802 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.074793    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") "
May 21 15:35:59.074991 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.074841    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-alertmanager-trusted-ca-bundle\") pod \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") "
May 21 15:35:59.074991 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.074875    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-main-tls\") pod \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") "
May 21 15:35:59.074991 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.074909    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-config-volume\") pod \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") "
May 21 15:35:59.074991 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.074934    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qss9q\" (UniqueName: \"kubernetes.io/projected/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-kube-api-access-qss9q\") pod \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\" (UID: \"d49c96ea-38a3-4e9c-aa9f-895fae222ef7\") "
May 21 15:35:59.074991 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.074971    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d49c96ea-38a3-4e9c-aa9f-895fae222ef7" (UID: "d49c96ea-38a3-4e9c-aa9f-895fae222ef7"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 15:35:59.075218 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.075183    2552 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-metrics-client-ca\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:35:59.075218 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.075202    2552 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-alertmanager-main-db\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:35:59.075630 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.075349    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d49c96ea-38a3-4e9c-aa9f-895fae222ef7" (UID: "d49c96ea-38a3-4e9c-aa9f-895fae222ef7"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:35:59.077739 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.077697    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d49c96ea-38a3-4e9c-aa9f-895fae222ef7" (UID: "d49c96ea-38a3-4e9c-aa9f-895fae222ef7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:35:59.078075 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.078031    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-config-out" (OuterVolumeSpecName: "config-out") pod "d49c96ea-38a3-4e9c-aa9f-895fae222ef7" (UID: "d49c96ea-38a3-4e9c-aa9f-895fae222ef7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 15:35:59.078198 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.078107    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d49c96ea-38a3-4e9c-aa9f-895fae222ef7" (UID: "d49c96ea-38a3-4e9c-aa9f-895fae222ef7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:35:59.078198 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.078129    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-config-volume" (OuterVolumeSpecName: "config-volume") pod "d49c96ea-38a3-4e9c-aa9f-895fae222ef7" (UID: "d49c96ea-38a3-4e9c-aa9f-895fae222ef7"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:35:59.078346 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.078208    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d49c96ea-38a3-4e9c-aa9f-895fae222ef7" (UID: "d49c96ea-38a3-4e9c-aa9f-895fae222ef7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:35:59.078429 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.078408    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d49c96ea-38a3-4e9c-aa9f-895fae222ef7" (UID: "d49c96ea-38a3-4e9c-aa9f-895fae222ef7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:35:59.078623 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.078596    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-kube-api-access-qss9q" (OuterVolumeSpecName: "kube-api-access-qss9q") pod "d49c96ea-38a3-4e9c-aa9f-895fae222ef7" (UID: "d49c96ea-38a3-4e9c-aa9f-895fae222ef7"). InnerVolumeSpecName "kube-api-access-qss9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:35:59.078827 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.078799    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d49c96ea-38a3-4e9c-aa9f-895fae222ef7" (UID: "d49c96ea-38a3-4e9c-aa9f-895fae222ef7"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:35:59.083127 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.083105    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d49c96ea-38a3-4e9c-aa9f-895fae222ef7" (UID: "d49c96ea-38a3-4e9c-aa9f-895fae222ef7"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:35:59.090491 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.090350    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-web-config" (OuterVolumeSpecName: "web-config") pod "d49c96ea-38a3-4e9c-aa9f-895fae222ef7" (UID: "d49c96ea-38a3-4e9c-aa9f-895fae222ef7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:35:59.176047 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.175996    2552 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-main-tls\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:35:59.176047 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.176044    2552 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-config-volume\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:35:59.176047 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.176055    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qss9q\" (UniqueName: \"kubernetes.io/projected/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-kube-api-access-qss9q\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:35:59.176047 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.176066    2552 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:35:59.176357 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.176077    2552 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-config-out\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:35:59.176357 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.176086    2552 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:35:59.176357 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.176095    2552 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-web-config\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:35:59.176357 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.176103    2552 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-cluster-tls-config\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:35:59.176357 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.176111    2552 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-tls-assets\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:35:59.176357 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.176119    2552 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:35:59.176357 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.176129    2552 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d49c96ea-38a3-4e9c-aa9f-895fae222ef7-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:35:59.537458 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.537416    2552 generic.go:358] "Generic (PLEG): container finished" podID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerID="46419e62d8e0428ce445add02903425bf66459af0609169d66f667ad61738230" exitCode=0
May 21 15:35:59.537637 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.537474    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d49c96ea-38a3-4e9c-aa9f-895fae222ef7","Type":"ContainerDied","Data":"46419e62d8e0428ce445add02903425bf66459af0609169d66f667ad61738230"}
May 21 15:35:59.537637 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.537514    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d49c96ea-38a3-4e9c-aa9f-895fae222ef7","Type":"ContainerDied","Data":"6173083911de968dc7c7029caf51c6a5cfb86f9f2b1448974d6955c922330b64"}
May 21 15:35:59.537637 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.537530    2552 scope.go:117] "RemoveContainer" containerID="38845541cb3aa547a550a4f6f077489af4bc4b0f42b510254c96228c3996d36b"
May 21 15:35:59.537637 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.537536    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.544929 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.544913    2552 scope.go:117] "RemoveContainer" containerID="e15de93f787c2f956726fb1bbab5e9bdd1a28ccb983e737d025451362e9b71ba"
May 21 15:35:59.552007 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.551986    2552 scope.go:117] "RemoveContainer" containerID="88eaccf173a2bf2359300317aaa562f39be4385d4da601df044ec65066b21ff3"
May 21 15:35:59.558377 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.558358    2552 scope.go:117] "RemoveContainer" containerID="46419e62d8e0428ce445add02903425bf66459af0609169d66f667ad61738230"
May 21 15:35:59.563146 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.563121    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 15:35:59.566906 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.566778    2552 scope.go:117] "RemoveContainer" containerID="1cda3bde4dec474e0f4d05187e1175a715083539c1bbaa061a2b17ac656d9672"
May 21 15:35:59.567745 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.567722    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 15:35:59.573738 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.573720    2552 scope.go:117] "RemoveContainer" containerID="9e2b28340689d2a3437a686b334cdcfb410de8ff094032dddeb3f067da0f8695"
May 21 15:35:59.580054 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.580039    2552 scope.go:117] "RemoveContainer" containerID="b28e5bfcbfb21f4737095e139ca805a860628e21d8bdb3af33da2d132efc4edc"
May 21 15:35:59.586972 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.586956    2552 scope.go:117] "RemoveContainer" containerID="38845541cb3aa547a550a4f6f077489af4bc4b0f42b510254c96228c3996d36b"
May 21 15:35:59.587216 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:35:59.587199    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38845541cb3aa547a550a4f6f077489af4bc4b0f42b510254c96228c3996d36b\": container with ID starting with 38845541cb3aa547a550a4f6f077489af4bc4b0f42b510254c96228c3996d36b not found: ID does not exist" containerID="38845541cb3aa547a550a4f6f077489af4bc4b0f42b510254c96228c3996d36b"
May 21 15:35:59.587279 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.587225    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38845541cb3aa547a550a4f6f077489af4bc4b0f42b510254c96228c3996d36b"} err="failed to get container status \"38845541cb3aa547a550a4f6f077489af4bc4b0f42b510254c96228c3996d36b\": rpc error: code = NotFound desc = could not find container \"38845541cb3aa547a550a4f6f077489af4bc4b0f42b510254c96228c3996d36b\": container with ID starting with 38845541cb3aa547a550a4f6f077489af4bc4b0f42b510254c96228c3996d36b not found: ID does not exist"
May 21 15:35:59.587279 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.587275    2552 scope.go:117] "RemoveContainer" containerID="e15de93f787c2f956726fb1bbab5e9bdd1a28ccb983e737d025451362e9b71ba"
May 21 15:35:59.587493 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:35:59.587475    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e15de93f787c2f956726fb1bbab5e9bdd1a28ccb983e737d025451362e9b71ba\": container with ID starting with e15de93f787c2f956726fb1bbab5e9bdd1a28ccb983e737d025451362e9b71ba not found: ID does not exist" containerID="e15de93f787c2f956726fb1bbab5e9bdd1a28ccb983e737d025451362e9b71ba"
May 21 15:35:59.587538 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.587496    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e15de93f787c2f956726fb1bbab5e9bdd1a28ccb983e737d025451362e9b71ba"} err="failed to get container status \"e15de93f787c2f956726fb1bbab5e9bdd1a28ccb983e737d025451362e9b71ba\": rpc error: code = NotFound desc = could not find container \"e15de93f787c2f956726fb1bbab5e9bdd1a28ccb983e737d025451362e9b71ba\": container with ID starting with e15de93f787c2f956726fb1bbab5e9bdd1a28ccb983e737d025451362e9b71ba not found: ID does not exist"
May 21 15:35:59.587538 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.587507    2552 scope.go:117] "RemoveContainer" containerID="88eaccf173a2bf2359300317aaa562f39be4385d4da601df044ec65066b21ff3"
May 21 15:35:59.587712 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:35:59.587696    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88eaccf173a2bf2359300317aaa562f39be4385d4da601df044ec65066b21ff3\": container with ID starting with 88eaccf173a2bf2359300317aaa562f39be4385d4da601df044ec65066b21ff3 not found: ID does not exist" containerID="88eaccf173a2bf2359300317aaa562f39be4385d4da601df044ec65066b21ff3"
May 21 15:35:59.587751 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.587716    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88eaccf173a2bf2359300317aaa562f39be4385d4da601df044ec65066b21ff3"} err="failed to get container status \"88eaccf173a2bf2359300317aaa562f39be4385d4da601df044ec65066b21ff3\": rpc error: code = NotFound desc = could not find container \"88eaccf173a2bf2359300317aaa562f39be4385d4da601df044ec65066b21ff3\": container with ID starting with 88eaccf173a2bf2359300317aaa562f39be4385d4da601df044ec65066b21ff3 not found: ID does not exist"
May 21 15:35:59.587751 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.587728    2552 scope.go:117] "RemoveContainer" containerID="46419e62d8e0428ce445add02903425bf66459af0609169d66f667ad61738230"
May 21 15:35:59.587953 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:35:59.587934    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46419e62d8e0428ce445add02903425bf66459af0609169d66f667ad61738230\": container with ID starting with 46419e62d8e0428ce445add02903425bf66459af0609169d66f667ad61738230 not found: ID does not exist" containerID="46419e62d8e0428ce445add02903425bf66459af0609169d66f667ad61738230"
May 21 15:35:59.588010 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.587959    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46419e62d8e0428ce445add02903425bf66459af0609169d66f667ad61738230"} err="failed to get container status \"46419e62d8e0428ce445add02903425bf66459af0609169d66f667ad61738230\": rpc error: code = NotFound desc = could not find container \"46419e62d8e0428ce445add02903425bf66459af0609169d66f667ad61738230\": container with ID starting with 46419e62d8e0428ce445add02903425bf66459af0609169d66f667ad61738230 not found: ID does not exist"
May 21 15:35:59.588010 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.587975    2552 scope.go:117] "RemoveContainer" containerID="1cda3bde4dec474e0f4d05187e1175a715083539c1bbaa061a2b17ac656d9672"
May 21 15:35:59.588200 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:35:59.588182    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cda3bde4dec474e0f4d05187e1175a715083539c1bbaa061a2b17ac656d9672\": container with ID starting with 1cda3bde4dec474e0f4d05187e1175a715083539c1bbaa061a2b17ac656d9672 not found: ID does not exist" containerID="1cda3bde4dec474e0f4d05187e1175a715083539c1bbaa061a2b17ac656d9672"
May 21 15:35:59.588334 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.588201    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cda3bde4dec474e0f4d05187e1175a715083539c1bbaa061a2b17ac656d9672"} err="failed to get container status \"1cda3bde4dec474e0f4d05187e1175a715083539c1bbaa061a2b17ac656d9672\": rpc error: code = NotFound desc = could not find container \"1cda3bde4dec474e0f4d05187e1175a715083539c1bbaa061a2b17ac656d9672\": container with ID starting with 1cda3bde4dec474e0f4d05187e1175a715083539c1bbaa061a2b17ac656d9672 not found: ID does not exist"
May 21 15:35:59.588334 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.588213    2552 scope.go:117] "RemoveContainer" containerID="9e2b28340689d2a3437a686b334cdcfb410de8ff094032dddeb3f067da0f8695"
May 21 15:35:59.588429 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:35:59.588402    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e2b28340689d2a3437a686b334cdcfb410de8ff094032dddeb3f067da0f8695\": container with ID starting with 9e2b28340689d2a3437a686b334cdcfb410de8ff094032dddeb3f067da0f8695 not found: ID does not exist" containerID="9e2b28340689d2a3437a686b334cdcfb410de8ff094032dddeb3f067da0f8695"
May 21 15:35:59.588429 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.588420    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e2b28340689d2a3437a686b334cdcfb410de8ff094032dddeb3f067da0f8695"} err="failed to get container status \"9e2b28340689d2a3437a686b334cdcfb410de8ff094032dddeb3f067da0f8695\": rpc error: code = NotFound desc = could not find container \"9e2b28340689d2a3437a686b334cdcfb410de8ff094032dddeb3f067da0f8695\": container with ID starting with 9e2b28340689d2a3437a686b334cdcfb410de8ff094032dddeb3f067da0f8695 not found: ID does not exist"
May 21 15:35:59.588498 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.588433    2552 scope.go:117] "RemoveContainer" containerID="b28e5bfcbfb21f4737095e139ca805a860628e21d8bdb3af33da2d132efc4edc"
May 21 15:35:59.588619 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:35:59.588602    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b28e5bfcbfb21f4737095e139ca805a860628e21d8bdb3af33da2d132efc4edc\": container with ID starting with b28e5bfcbfb21f4737095e139ca805a860628e21d8bdb3af33da2d132efc4edc not found: ID does not exist" containerID="b28e5bfcbfb21f4737095e139ca805a860628e21d8bdb3af33da2d132efc4edc"
May 21 15:35:59.588651 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.588625    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b28e5bfcbfb21f4737095e139ca805a860628e21d8bdb3af33da2d132efc4edc"} err="failed to get container status \"b28e5bfcbfb21f4737095e139ca805a860628e21d8bdb3af33da2d132efc4edc\": rpc error: code = NotFound desc = could not find container \"b28e5bfcbfb21f4737095e139ca805a860628e21d8bdb3af33da2d132efc4edc\": container with ID starting with b28e5bfcbfb21f4737095e139ca805a860628e21d8bdb3af33da2d132efc4edc not found: ID does not exist"
May 21 15:35:59.595636 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.595615    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 15:35:59.595911 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.595900    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="init-config-reloader"
May 21 15:35:59.595997 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.595913    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="init-config-reloader"
May 21 15:35:59.595997 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.595922    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="kube-rbac-proxy"
May 21 15:35:59.595997 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.595927    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="kube-rbac-proxy"
May 21 15:35:59.595997 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.595934    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="kube-rbac-proxy-web"
May 21 15:35:59.595997 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.595940    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="kube-rbac-proxy-web"
May 21 15:35:59.595997 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.595947    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="kube-rbac-proxy-metric"
May 21 15:35:59.595997 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.595952    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="kube-rbac-proxy-metric"
May 21 15:35:59.595997 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.595967    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="prom-label-proxy"
May 21 15:35:59.595997 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.595972    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="prom-label-proxy"
May 21 15:35:59.595997 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.595980    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="alertmanager"
May 21 15:35:59.595997 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.595985    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="alertmanager"
May 21 15:35:59.595997 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.595992    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="config-reloader"
May 21 15:35:59.595997 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.595997    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="config-reloader"
May 21 15:35:59.596396 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.596039    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="alertmanager"
May 21 15:35:59.596396 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.596047    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="config-reloader"
May 21 15:35:59.596396 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.596052    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="prom-label-proxy"
May 21 15:35:59.596396 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.596060    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="kube-rbac-proxy-web"
May 21 15:35:59.596396 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.596067    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="kube-rbac-proxy-metric"
May 21 15:35:59.596396 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.596074    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" containerName="kube-rbac-proxy"
May 21 15:35:59.599362 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.599346    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.602023 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.602000    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 21 15:35:59.602141 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.602036    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 21 15:35:59.602141 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.602097    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 21 15:35:59.602325 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.602311    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 21 15:35:59.602440 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.602335    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 21 15:35:59.602549 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.602528    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 21 15:35:59.602649 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.602575    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6bvjh\""
May 21 15:35:59.602649 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.602577    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 21 15:35:59.602649 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.602632    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 21 15:35:59.610912 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.609930    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 21 15:35:59.613227 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.612518    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 15:35:59.780723 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.780685    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.780723 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.780724    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-config-volume\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.780955 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.780745    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.780955 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.780768    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.780955 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.780812    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.780955 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.780833    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-config-out\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.780955 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.780847    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.780955 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.780870    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.780955 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.780897    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-web-config\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.780955 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.780918    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.780955 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.780956    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.781240 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.780977    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.781240 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.780999    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnk9p\" (UniqueName: \"kubernetes.io/projected/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-kube-api-access-wnk9p\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.845067 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.845021    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d49c96ea-38a3-4e9c-aa9f-895fae222ef7" path="/var/lib/kubelet/pods/d49c96ea-38a3-4e9c-aa9f-895fae222ef7/volumes"
May 21 15:35:59.882230 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.882201    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.882394 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.882238    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.882394 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.882284    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.882394 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.882310    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-config-out\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.882394 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.882334    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.882394 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.882366    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.882394 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.882395    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-web-config\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.882687 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.882543    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.882687 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.882613    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.882687 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.882656    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.882826 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.882695    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wnk9p\" (UniqueName: \"kubernetes.io/projected/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-kube-api-access-wnk9p\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.882826 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.882730    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.882826 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.882758    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-config-volume\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.882969 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.882812    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.883355 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.883328    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.885168 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.885136    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-config-out\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.885564 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.885407    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.885564 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.885452    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-config-volume\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.885564 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.885488    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.885564 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.885558    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.885954 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.885925    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.886038 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.885978    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.886291 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.886250    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-web-config\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.886602 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.886587    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.887579 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.887563    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.891942 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.891924    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnk9p\" (UniqueName: \"kubernetes.io/projected/9e086c5b-eb09-41bb-9605-7ae2d2ad345a-kube-api-access-wnk9p\") pod \"alertmanager-main-0\" (UID: \"9e086c5b-eb09-41bb-9605-7ae2d2ad345a\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 15:35:59.910486 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:35:59.910464    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 15:36:00.043855 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:00.043831    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 15:36:00.046451 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:36:00.046424    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e086c5b_eb09_41bb_9605_7ae2d2ad345a.slice/crio-194b1d3d190c00d9aef84446ca5863488936696fff593cd336d1934d90fa6069 WatchSource:0}: Error finding container 194b1d3d190c00d9aef84446ca5863488936696fff593cd336d1934d90fa6069: Status 404 returned error can't find the container with id 194b1d3d190c00d9aef84446ca5863488936696fff593cd336d1934d90fa6069
May 21 15:36:00.542086 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:00.542053    2552 generic.go:358] "Generic (PLEG): container finished" podID="9e086c5b-eb09-41bb-9605-7ae2d2ad345a" containerID="3f5384195a3e36e4a85b73f7e64ebd6786fe6afb5b9f7aba717aa20efe1441c5" exitCode=0
May 21 15:36:00.542300 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:00.542150    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9e086c5b-eb09-41bb-9605-7ae2d2ad345a","Type":"ContainerDied","Data":"3f5384195a3e36e4a85b73f7e64ebd6786fe6afb5b9f7aba717aa20efe1441c5"}
May 21 15:36:00.542300 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:00.542206    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9e086c5b-eb09-41bb-9605-7ae2d2ad345a","Type":"ContainerStarted","Data":"194b1d3d190c00d9aef84446ca5863488936696fff593cd336d1934d90fa6069"}
May 21 15:36:01.549298 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:01.549242    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9e086c5b-eb09-41bb-9605-7ae2d2ad345a","Type":"ContainerStarted","Data":"8965837beb28c767b6ae9cc9083e5ae683e0eca40017e4cb0e0ab10a2b344d10"}
May 21 15:36:01.549728 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:01.549310    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9e086c5b-eb09-41bb-9605-7ae2d2ad345a","Type":"ContainerStarted","Data":"3d67e3bc9a2217ac4899294051311f98ee60ab7ac8c15659168bfbf4baa8eea0"}
May 21 15:36:01.549728 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:01.549327    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9e086c5b-eb09-41bb-9605-7ae2d2ad345a","Type":"ContainerStarted","Data":"b1baf5977d12c24cd5d4f5744c1867be6cab7f57ffe6cb330bb4c75775e051f8"}
May 21 15:36:01.549728 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:01.549337    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9e086c5b-eb09-41bb-9605-7ae2d2ad345a","Type":"ContainerStarted","Data":"89eaa532094b028e1ce5b172c1fd65305416af0d013628d82cfe8368320c7d9c"}
May 21 15:36:01.549728 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:01.549349    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9e086c5b-eb09-41bb-9605-7ae2d2ad345a","Type":"ContainerStarted","Data":"d71c1e994c550e9b929f5b129486ce9ce819176858d422cc8d5e13903bdb818f"}
May 21 15:36:01.549728 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:01.549359    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9e086c5b-eb09-41bb-9605-7ae2d2ad345a","Type":"ContainerStarted","Data":"0f70f66ecd18f51db78e8b26977b22eaa37d03b483f272894297c971b0dfe2cc"}
May 21 15:36:01.583675 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:01.583625    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.583610329 podStartE2EDuration="2.583610329s" podCreationTimestamp="2026-05-21 15:35:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:36:01.581878896 +0000 UTC m=+222.302041433" watchObservedRunningTime="2026-05-21 15:36:01.583610329 +0000 UTC m=+222.303772867"
May 21 15:36:01.971689 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:01.971648    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 15:36:01.972315 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:01.972160    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="prometheus" containerID="cri-o://f5fa6cf2ca8304fa4cdc0a1e2db64c1aa5a13b35e65aec3e93b8d32217b54603" gracePeriod=600
May 21 15:36:01.972315 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:01.972174    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="kube-rbac-proxy" containerID="cri-o://222f3995b814669e43aa7387f0896bbdaf5c40ffcc0ef32e04f07d06730ea97c" gracePeriod=600
May 21 15:36:01.972315 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:01.972207    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="kube-rbac-proxy-web" containerID="cri-o://8bf1153f39c6b6f202db14a2906e077a7859abcecb581c02e1231b61340fbab6" gracePeriod=600
May 21 15:36:01.972315 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:01.972218    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="config-reloader" containerID="cri-o://6d5b4363e93d3581a287d518f3971c258d9acb3a2441b8341661abaa35f747a6" gracePeriod=600
May 21 15:36:01.972315 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:01.972181    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="thanos-sidecar" containerID="cri-o://53fab06699e3aa597b09d067b0f2f7657e974849bd9f0862e301653242e8d584" gracePeriod=600
May 21 15:36:01.972624 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:01.972397    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="kube-rbac-proxy-thanos" containerID="cri-o://040771f44842e62c6095527b7ac49c32c7c67b9613ba18487c614084c44f6934" gracePeriod=600
May 21 15:36:02.555903 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:02.555865    2552 generic.go:358] "Generic (PLEG): container finished" podID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerID="040771f44842e62c6095527b7ac49c32c7c67b9613ba18487c614084c44f6934" exitCode=0
May 21 15:36:02.555903 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:02.555893    2552 generic.go:358] "Generic (PLEG): container finished" podID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerID="222f3995b814669e43aa7387f0896bbdaf5c40ffcc0ef32e04f07d06730ea97c" exitCode=0
May 21 15:36:02.555903 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:02.555899    2552 generic.go:358] "Generic (PLEG): container finished" podID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerID="53fab06699e3aa597b09d067b0f2f7657e974849bd9f0862e301653242e8d584" exitCode=0
May 21 15:36:02.555903 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:02.555904    2552 generic.go:358] "Generic (PLEG): container finished" podID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerID="6d5b4363e93d3581a287d518f3971c258d9acb3a2441b8341661abaa35f747a6" exitCode=0
May 21 15:36:02.555903 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:02.555910    2552 generic.go:358] "Generic (PLEG): container finished" podID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerID="f5fa6cf2ca8304fa4cdc0a1e2db64c1aa5a13b35e65aec3e93b8d32217b54603" exitCode=0
May 21 15:36:02.556423 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:02.555932    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6b73b8d-f902-415f-a4f7-50abd9fe0a72","Type":"ContainerDied","Data":"040771f44842e62c6095527b7ac49c32c7c67b9613ba18487c614084c44f6934"}
May 21 15:36:02.556423 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:02.555966    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6b73b8d-f902-415f-a4f7-50abd9fe0a72","Type":"ContainerDied","Data":"222f3995b814669e43aa7387f0896bbdaf5c40ffcc0ef32e04f07d06730ea97c"}
May 21 15:36:02.556423 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:02.555976    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6b73b8d-f902-415f-a4f7-50abd9fe0a72","Type":"ContainerDied","Data":"53fab06699e3aa597b09d067b0f2f7657e974849bd9f0862e301653242e8d584"}
May 21 15:36:02.556423 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:02.555987    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6b73b8d-f902-415f-a4f7-50abd9fe0a72","Type":"ContainerDied","Data":"6d5b4363e93d3581a287d518f3971c258d9acb3a2441b8341661abaa35f747a6"}
May 21 15:36:02.556423 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:02.555995    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6b73b8d-f902-415f-a4f7-50abd9fe0a72","Type":"ContainerDied","Data":"f5fa6cf2ca8304fa4cdc0a1e2db64c1aa5a13b35e65aec3e93b8d32217b54603"}
May 21 15:36:03.218140 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.218119    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.313195 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.313102    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-config-out\") pod \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") "
May 21 15:36:03.313195 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.313140    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-tls-assets\") pod \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") "
May 21 15:36:03.313195 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.313159    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-prometheus-k8s-rulefiles-0\") pod \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") "
May 21 15:36:03.313195 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.313184    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-prometheus-k8s-tls\") pod \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") "
May 21 15:36:03.313543 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.313203    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-configmap-metrics-client-ca\") pod \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") "
May 21 15:36:03.313543 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.313227    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-kube-rbac-proxy\") pod \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") "
May 21 15:36:03.313543 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.313335    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-prometheus-k8s-db\") pod \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") "
May 21 15:36:03.313543 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.313393    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") "
May 21 15:36:03.313543 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.313454    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-config\") pod \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") "
May 21 15:36:03.313543 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.313500    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-thanos-prometheus-http-client-file\") pod \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") "
May 21 15:36:03.313829 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.313546    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-prometheus-trusted-ca-bundle\") pod \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") "
May 21 15:36:03.313829 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.313584    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") "
May 21 15:36:03.313829 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.313613    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-configmap-serving-certs-ca-bundle\") pod \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") "
May 21 15:36:03.313829 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.313649    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wt96\" (UniqueName: \"kubernetes.io/projected/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-kube-api-access-5wt96\") pod \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") "
May 21 15:36:03.313829 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.313673    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a6b73b8d-f902-415f-a4f7-50abd9fe0a72" (UID: "a6b73b8d-f902-415f-a4f7-50abd9fe0a72"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:36:03.313829 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.313680    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-metrics-client-certs\") pod \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") "
May 21 15:36:03.313829 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.313752    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-configmap-kubelet-serving-ca-bundle\") pod \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") "
May 21 15:36:03.313829 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.313778    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-grpc-tls\") pod \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") "
May 21 15:36:03.313829 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.313822    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-web-config\") pod \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\" (UID: \"a6b73b8d-f902-415f-a4f7-50abd9fe0a72\") "
May 21 15:36:03.314276 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.314205    2552 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-configmap-metrics-client-ca\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:36:03.314627 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.314325    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a6b73b8d-f902-415f-a4f7-50abd9fe0a72" (UID: "a6b73b8d-f902-415f-a4f7-50abd9fe0a72"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:36:03.315226 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.315196    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a6b73b8d-f902-415f-a4f7-50abd9fe0a72" (UID: "a6b73b8d-f902-415f-a4f7-50abd9fe0a72"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:36:03.315379 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.315349    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a6b73b8d-f902-415f-a4f7-50abd9fe0a72" (UID: "a6b73b8d-f902-415f-a4f7-50abd9fe0a72"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:36:03.315880 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.315849    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a6b73b8d-f902-415f-a4f7-50abd9fe0a72" (UID: "a6b73b8d-f902-415f-a4f7-50abd9fe0a72"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 15:36:03.316596 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.316568    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a6b73b8d-f902-415f-a4f7-50abd9fe0a72" (UID: "a6b73b8d-f902-415f-a4f7-50abd9fe0a72"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:36:03.316681 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.316603    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a6b73b8d-f902-415f-a4f7-50abd9fe0a72" (UID: "a6b73b8d-f902-415f-a4f7-50abd9fe0a72"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:36:03.316872 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.316830    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a6b73b8d-f902-415f-a4f7-50abd9fe0a72" (UID: "a6b73b8d-f902-415f-a4f7-50abd9fe0a72"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:36:03.317447 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.317418    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-config-out" (OuterVolumeSpecName: "config-out") pod "a6b73b8d-f902-415f-a4f7-50abd9fe0a72" (UID: "a6b73b8d-f902-415f-a4f7-50abd9fe0a72"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 15:36:03.317551 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.317469    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a6b73b8d-f902-415f-a4f7-50abd9fe0a72" (UID: "a6b73b8d-f902-415f-a4f7-50abd9fe0a72"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:36:03.317934 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.317898    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a6b73b8d-f902-415f-a4f7-50abd9fe0a72" (UID: "a6b73b8d-f902-415f-a4f7-50abd9fe0a72"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:36:03.318216 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.318181    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a6b73b8d-f902-415f-a4f7-50abd9fe0a72" (UID: "a6b73b8d-f902-415f-a4f7-50abd9fe0a72"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:36:03.318404 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.318375    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a6b73b8d-f902-415f-a4f7-50abd9fe0a72" (UID: "a6b73b8d-f902-415f-a4f7-50abd9fe0a72"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:36:03.318490 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.318431    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-config" (OuterVolumeSpecName: "config") pod "a6b73b8d-f902-415f-a4f7-50abd9fe0a72" (UID: "a6b73b8d-f902-415f-a4f7-50abd9fe0a72"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:36:03.318774 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.318748    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a6b73b8d-f902-415f-a4f7-50abd9fe0a72" (UID: "a6b73b8d-f902-415f-a4f7-50abd9fe0a72"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:36:03.318979 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.318956    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a6b73b8d-f902-415f-a4f7-50abd9fe0a72" (UID: "a6b73b8d-f902-415f-a4f7-50abd9fe0a72"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:36:03.319052 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.318994    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-kube-api-access-5wt96" (OuterVolumeSpecName: "kube-api-access-5wt96") pod "a6b73b8d-f902-415f-a4f7-50abd9fe0a72" (UID: "a6b73b8d-f902-415f-a4f7-50abd9fe0a72"). InnerVolumeSpecName "kube-api-access-5wt96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:36:03.328581 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.328549    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-web-config" (OuterVolumeSpecName: "web-config") pod "a6b73b8d-f902-415f-a4f7-50abd9fe0a72" (UID: "a6b73b8d-f902-415f-a4f7-50abd9fe0a72"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:36:03.415028 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.414985    2552 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-web-config\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:36:03.415028 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.415021    2552 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-config-out\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:36:03.415028 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.415034    2552 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-tls-assets\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:36:03.415342 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.415046    2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:36:03.415342 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.415061    2552 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:36:03.415342 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.415074    2552 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-kube-rbac-proxy\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:36:03.415342 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.415085    2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-prometheus-k8s-db\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:36:03.415342 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.415099    2552 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:36:03.415342 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.415112    2552 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-config\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:36:03.415342 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.415124    2552 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:36:03.415342 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.415136    2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:36:03.415342 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.415149    2552 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:36:03.415342 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.415164    2552 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:36:03.415342 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.415176    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wt96\" (UniqueName: \"kubernetes.io/projected/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-kube-api-access-5wt96\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:36:03.415342 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.415188    2552 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-metrics-client-certs\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:36:03.415342 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.415201    2552 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:36:03.415342 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.415214    2552 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6b73b8d-f902-415f-a4f7-50abd9fe0a72-secret-grpc-tls\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:36:03.561903 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.561867    2552 generic.go:358] "Generic (PLEG): container finished" podID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerID="8bf1153f39c6b6f202db14a2906e077a7859abcecb581c02e1231b61340fbab6" exitCode=0
May 21 15:36:03.562302 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.561930    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6b73b8d-f902-415f-a4f7-50abd9fe0a72","Type":"ContainerDied","Data":"8bf1153f39c6b6f202db14a2906e077a7859abcecb581c02e1231b61340fbab6"}
May 21 15:36:03.562302 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.561957    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6b73b8d-f902-415f-a4f7-50abd9fe0a72","Type":"ContainerDied","Data":"4e9a8632d5126a123590ca888e3450e63ca7b702c590fad2c2c471e690a91e6f"}
May 21 15:36:03.562302 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.561966    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.562302 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.561974    2552 scope.go:117] "RemoveContainer" containerID="040771f44842e62c6095527b7ac49c32c7c67b9613ba18487c614084c44f6934"
May 21 15:36:03.569739 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.569705    2552 scope.go:117] "RemoveContainer" containerID="222f3995b814669e43aa7387f0896bbdaf5c40ffcc0ef32e04f07d06730ea97c"
May 21 15:36:03.576614 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.576600    2552 scope.go:117] "RemoveContainer" containerID="8bf1153f39c6b6f202db14a2906e077a7859abcecb581c02e1231b61340fbab6"
May 21 15:36:03.582957 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.582940    2552 scope.go:117] "RemoveContainer" containerID="53fab06699e3aa597b09d067b0f2f7657e974849bd9f0862e301653242e8d584"
May 21 15:36:03.586855 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.586829    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 15:36:03.590178 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.590160    2552 scope.go:117] "RemoveContainer" containerID="6d5b4363e93d3581a287d518f3971c258d9acb3a2441b8341661abaa35f747a6"
May 21 15:36:03.590747 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.590730    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 15:36:03.597051 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.597036    2552 scope.go:117] "RemoveContainer" containerID="f5fa6cf2ca8304fa4cdc0a1e2db64c1aa5a13b35e65aec3e93b8d32217b54603"
May 21 15:36:03.605104 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.605086    2552 scope.go:117] "RemoveContainer" containerID="e508f7eb0f5f6bec4f849277f111b5883be6232426786f8a4f0231dcba56e014"
May 21 15:36:03.611828 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.611814    2552 scope.go:117] "RemoveContainer" containerID="040771f44842e62c6095527b7ac49c32c7c67b9613ba18487c614084c44f6934"
May 21 15:36:03.612049 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:36:03.612031    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"040771f44842e62c6095527b7ac49c32c7c67b9613ba18487c614084c44f6934\": container with ID starting with 040771f44842e62c6095527b7ac49c32c7c67b9613ba18487c614084c44f6934 not found: ID does not exist" containerID="040771f44842e62c6095527b7ac49c32c7c67b9613ba18487c614084c44f6934"
May 21 15:36:03.612122 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.612062    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"040771f44842e62c6095527b7ac49c32c7c67b9613ba18487c614084c44f6934"} err="failed to get container status \"040771f44842e62c6095527b7ac49c32c7c67b9613ba18487c614084c44f6934\": rpc error: code = NotFound desc = could not find container \"040771f44842e62c6095527b7ac49c32c7c67b9613ba18487c614084c44f6934\": container with ID starting with 040771f44842e62c6095527b7ac49c32c7c67b9613ba18487c614084c44f6934 not found: ID does not exist"
May 21 15:36:03.612122 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.612089    2552 scope.go:117] "RemoveContainer" containerID="222f3995b814669e43aa7387f0896bbdaf5c40ffcc0ef32e04f07d06730ea97c"
May 21 15:36:03.612386 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:36:03.612367    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"222f3995b814669e43aa7387f0896bbdaf5c40ffcc0ef32e04f07d06730ea97c\": container with ID starting with 222f3995b814669e43aa7387f0896bbdaf5c40ffcc0ef32e04f07d06730ea97c not found: ID does not exist" containerID="222f3995b814669e43aa7387f0896bbdaf5c40ffcc0ef32e04f07d06730ea97c"
May 21 15:36:03.612429 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.612396    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"222f3995b814669e43aa7387f0896bbdaf5c40ffcc0ef32e04f07d06730ea97c"} err="failed to get container status \"222f3995b814669e43aa7387f0896bbdaf5c40ffcc0ef32e04f07d06730ea97c\": rpc error: code = NotFound desc = could not find container \"222f3995b814669e43aa7387f0896bbdaf5c40ffcc0ef32e04f07d06730ea97c\": container with ID starting with 222f3995b814669e43aa7387f0896bbdaf5c40ffcc0ef32e04f07d06730ea97c not found: ID does not exist"
May 21 15:36:03.612429 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.612413    2552 scope.go:117] "RemoveContainer" containerID="8bf1153f39c6b6f202db14a2906e077a7859abcecb581c02e1231b61340fbab6"
May 21 15:36:03.612642 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:36:03.612621    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bf1153f39c6b6f202db14a2906e077a7859abcecb581c02e1231b61340fbab6\": container with ID starting with 8bf1153f39c6b6f202db14a2906e077a7859abcecb581c02e1231b61340fbab6 not found: ID does not exist" containerID="8bf1153f39c6b6f202db14a2906e077a7859abcecb581c02e1231b61340fbab6"
May 21 15:36:03.612686 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.612657    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bf1153f39c6b6f202db14a2906e077a7859abcecb581c02e1231b61340fbab6"} err="failed to get container status \"8bf1153f39c6b6f202db14a2906e077a7859abcecb581c02e1231b61340fbab6\": rpc error: code = NotFound desc = could not find container \"8bf1153f39c6b6f202db14a2906e077a7859abcecb581c02e1231b61340fbab6\": container with ID starting with 8bf1153f39c6b6f202db14a2906e077a7859abcecb581c02e1231b61340fbab6 not found: ID does not exist"
May 21 15:36:03.612686 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.612676    2552 scope.go:117] "RemoveContainer" containerID="53fab06699e3aa597b09d067b0f2f7657e974849bd9f0862e301653242e8d584"
May 21 15:36:03.613027 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:36:03.613006    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53fab06699e3aa597b09d067b0f2f7657e974849bd9f0862e301653242e8d584\": container with ID starting with 53fab06699e3aa597b09d067b0f2f7657e974849bd9f0862e301653242e8d584 not found: ID does not exist" containerID="53fab06699e3aa597b09d067b0f2f7657e974849bd9f0862e301653242e8d584"
May 21 15:36:03.613116 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.613034    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53fab06699e3aa597b09d067b0f2f7657e974849bd9f0862e301653242e8d584"} err="failed to get container status \"53fab06699e3aa597b09d067b0f2f7657e974849bd9f0862e301653242e8d584\": rpc error: code = NotFound desc = could not find container \"53fab06699e3aa597b09d067b0f2f7657e974849bd9f0862e301653242e8d584\": container with ID starting with 53fab06699e3aa597b09d067b0f2f7657e974849bd9f0862e301653242e8d584 not found: ID does not exist"
May 21 15:36:03.613116 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.613050    2552 scope.go:117] "RemoveContainer" containerID="6d5b4363e93d3581a287d518f3971c258d9acb3a2441b8341661abaa35f747a6"
May 21 15:36:03.613288 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:36:03.613252    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d5b4363e93d3581a287d518f3971c258d9acb3a2441b8341661abaa35f747a6\": container with ID starting with 6d5b4363e93d3581a287d518f3971c258d9acb3a2441b8341661abaa35f747a6 not found: ID does not exist" containerID="6d5b4363e93d3581a287d518f3971c258d9acb3a2441b8341661abaa35f747a6"
May 21 15:36:03.613351 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.613293    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d5b4363e93d3581a287d518f3971c258d9acb3a2441b8341661abaa35f747a6"} err="failed to get container status \"6d5b4363e93d3581a287d518f3971c258d9acb3a2441b8341661abaa35f747a6\": rpc error: code = NotFound desc = could not find container \"6d5b4363e93d3581a287d518f3971c258d9acb3a2441b8341661abaa35f747a6\": container with ID starting with 6d5b4363e93d3581a287d518f3971c258d9acb3a2441b8341661abaa35f747a6 not found: ID does not exist"
May 21 15:36:03.613351 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.613309    2552 scope.go:117] "RemoveContainer" containerID="f5fa6cf2ca8304fa4cdc0a1e2db64c1aa5a13b35e65aec3e93b8d32217b54603"
May 21 15:36:03.613605 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:36:03.613575    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5fa6cf2ca8304fa4cdc0a1e2db64c1aa5a13b35e65aec3e93b8d32217b54603\": container with ID starting with f5fa6cf2ca8304fa4cdc0a1e2db64c1aa5a13b35e65aec3e93b8d32217b54603 not found: ID does not exist" containerID="f5fa6cf2ca8304fa4cdc0a1e2db64c1aa5a13b35e65aec3e93b8d32217b54603"
May 21 15:36:03.613769 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.613607    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5fa6cf2ca8304fa4cdc0a1e2db64c1aa5a13b35e65aec3e93b8d32217b54603"} err="failed to get container status \"f5fa6cf2ca8304fa4cdc0a1e2db64c1aa5a13b35e65aec3e93b8d32217b54603\": rpc error: code = NotFound desc = could not find container \"f5fa6cf2ca8304fa4cdc0a1e2db64c1aa5a13b35e65aec3e93b8d32217b54603\": container with ID starting with f5fa6cf2ca8304fa4cdc0a1e2db64c1aa5a13b35e65aec3e93b8d32217b54603 not found: ID does not exist"
May 21 15:36:03.613769 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.613628    2552 scope.go:117] "RemoveContainer" containerID="e508f7eb0f5f6bec4f849277f111b5883be6232426786f8a4f0231dcba56e014"
May 21 15:36:03.614024 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:36:03.613984    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e508f7eb0f5f6bec4f849277f111b5883be6232426786f8a4f0231dcba56e014\": container with ID starting with e508f7eb0f5f6bec4f849277f111b5883be6232426786f8a4f0231dcba56e014 not found: ID does not exist" containerID="e508f7eb0f5f6bec4f849277f111b5883be6232426786f8a4f0231dcba56e014"
May 21 15:36:03.614105 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.614041    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e508f7eb0f5f6bec4f849277f111b5883be6232426786f8a4f0231dcba56e014"} err="failed to get container status \"e508f7eb0f5f6bec4f849277f111b5883be6232426786f8a4f0231dcba56e014\": rpc error: code = NotFound desc = could not find container \"e508f7eb0f5f6bec4f849277f111b5883be6232426786f8a4f0231dcba56e014\": container with ID starting with e508f7eb0f5f6bec4f849277f111b5883be6232426786f8a4f0231dcba56e014 not found: ID does not exist"
May 21 15:36:03.615477 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.615455    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 15:36:03.615797 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.615783    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="init-config-reloader"
May 21 15:36:03.615837 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.615799    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="init-config-reloader"
May 21 15:36:03.615837 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.615817    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="thanos-sidecar"
May 21 15:36:03.615837 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.615824    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="thanos-sidecar"
May 21 15:36:03.615837 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.615830    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="kube-rbac-proxy"
May 21 15:36:03.615837 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.615835    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="kube-rbac-proxy"
May 21 15:36:03.615971 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.615844    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="prometheus"
May 21 15:36:03.615971 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.615849    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="prometheus"
May 21 15:36:03.615971 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.615855    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="config-reloader"
May 21 15:36:03.615971 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.615859    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="config-reloader"
May 21 15:36:03.615971 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.615865    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="kube-rbac-proxy-thanos"
May 21 15:36:03.615971 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.615871    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="kube-rbac-proxy-thanos"
May 21 15:36:03.615971 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.615880    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="kube-rbac-proxy-web"
May 21 15:36:03.615971 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.615885    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="kube-rbac-proxy-web"
May 21 15:36:03.615971 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.615928    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="prometheus"
May 21 15:36:03.615971 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.615937    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="kube-rbac-proxy-web"
May 21 15:36:03.615971 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.615944    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="config-reloader"
May 21 15:36:03.615971 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.615951    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="thanos-sidecar"
May 21 15:36:03.615971 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.615958    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="kube-rbac-proxy-thanos"
May 21 15:36:03.615971 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.615964    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" containerName="kube-rbac-proxy"
May 21 15:36:03.619595 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.619579    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.622777 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.622759    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 21 15:36:03.622885 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.622759    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 21 15:36:03.622885 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.622758    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 21 15:36:03.622885 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.622759    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 21 15:36:03.623065 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.622999    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 21 15:36:03.623065 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.623003    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6l5fr\""
May 21 15:36:03.623065 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.623049    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 21 15:36:03.623228 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.623186    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 21 15:36:03.623310 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.623224    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 21 15:36:03.623310 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.623244    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 21 15:36:03.623310 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.623285    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 21 15:36:03.623474 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.623224    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 21 15:36:03.623474 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.623432    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2lq6tuok3gjsq\""
May 21 15:36:03.630269 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.630238    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 21 15:36:03.633843 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.633823    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 21 15:36:03.635013 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.634991    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 15:36:03.718415 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.718379    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57908494-bacf-436c-af62-2ab9fe92e66f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.718415 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.718423    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57908494-bacf-436c-af62-2ab9fe92e66f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.718613 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.718446    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57908494-bacf-436c-af62-2ab9fe92e66f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.718613 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.718470    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/57908494-bacf-436c-af62-2ab9fe92e66f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.718613 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.718494    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-web-config\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.718613 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.718543    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.718613 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.718563    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.718613 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.718584    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57908494-bacf-436c-af62-2ab9fe92e66f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.718613 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.718604    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.718928 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.718637    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vtm7\" (UniqueName: \"kubernetes.io/projected/57908494-bacf-436c-af62-2ab9fe92e66f-kube-api-access-7vtm7\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.718928 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.718663    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.718928 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.718678    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-config\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.718928 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.718758    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57908494-bacf-436c-af62-2ab9fe92e66f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.718928 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.718786    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.718928 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.718813    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.718928 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.718850    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.718928 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.718868    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57908494-bacf-436c-af62-2ab9fe92e66f-config-out\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.718928 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.718888    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/57908494-bacf-436c-af62-2ab9fe92e66f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.819814 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.819720    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.819814 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.819763    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57908494-bacf-436c-af62-2ab9fe92e66f-config-out\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.819814 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.819794    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/57908494-bacf-436c-af62-2ab9fe92e66f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.820077 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.819825    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57908494-bacf-436c-af62-2ab9fe92e66f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.820077 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.819858    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57908494-bacf-436c-af62-2ab9fe92e66f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.820077 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.819886    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57908494-bacf-436c-af62-2ab9fe92e66f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.820077 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.820017    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/57908494-bacf-436c-af62-2ab9fe92e66f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.820077 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.820063    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-web-config\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.820364 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.820106    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.820364 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.820140    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.820364 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.820179    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57908494-bacf-436c-af62-2ab9fe92e66f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.820364 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.820210    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.820364 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.820235    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7vtm7\" (UniqueName: \"kubernetes.io/projected/57908494-bacf-436c-af62-2ab9fe92e66f-kube-api-access-7vtm7\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.820364 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.820317    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.820364 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.820326    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/57908494-bacf-436c-af62-2ab9fe92e66f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.820364 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.820348    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-config\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.820916 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.820390    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57908494-bacf-436c-af62-2ab9fe92e66f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.820916 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.820416    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.820916 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.820720    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57908494-bacf-436c-af62-2ab9fe92e66f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.820916 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.820878    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57908494-bacf-436c-af62-2ab9fe92e66f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.821501 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.821318    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.821501 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.821404    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57908494-bacf-436c-af62-2ab9fe92e66f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.822206 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.822136    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57908494-bacf-436c-af62-2ab9fe92e66f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.823170 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.822729    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57908494-bacf-436c-af62-2ab9fe92e66f-config-out\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.823170 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.823131    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.823389 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.823361    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-web-config\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.824105 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.824078    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.824371 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.824320    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.824469 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.824457    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.824913 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.824884    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-config\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.825073 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.825050    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/57908494-bacf-436c-af62-2ab9fe92e66f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.825254 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.825237    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.825378 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.825347    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.825621 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.825606    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57908494-bacf-436c-af62-2ab9fe92e66f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.825689 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.825669    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/57908494-bacf-436c-af62-2ab9fe92e66f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.829054 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.829033    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vtm7\" (UniqueName: \"kubernetes.io/projected/57908494-bacf-436c-af62-2ab9fe92e66f-kube-api-access-7vtm7\") pod \"prometheus-k8s-0\" (UID: \"57908494-bacf-436c-af62-2ab9fe92e66f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:03.845749 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.845725    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6b73b8d-f902-415f-a4f7-50abd9fe0a72" path="/var/lib/kubelet/pods/a6b73b8d-f902-415f-a4f7-50abd9fe0a72/volumes"
May 21 15:36:03.929177 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:03.929137    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:04.061359 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:04.061327    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 15:36:04.064687 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:36:04.064656    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57908494_bacf_436c_af62_2ab9fe92e66f.slice/crio-870e500a0e869ec5edde0eaeae0f0f149ba4b44cbd5b0cbefd5294b73e3bfba5 WatchSource:0}: Error finding container 870e500a0e869ec5edde0eaeae0f0f149ba4b44cbd5b0cbefd5294b73e3bfba5: Status 404 returned error can't find the container with id 870e500a0e869ec5edde0eaeae0f0f149ba4b44cbd5b0cbefd5294b73e3bfba5
May 21 15:36:04.567060 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:04.567016    2552 generic.go:358] "Generic (PLEG): container finished" podID="57908494-bacf-436c-af62-2ab9fe92e66f" containerID="7f21e1cab1c291ed5fa61618b8f1a15f1c458687341f03b69e96cd37b7e6c425" exitCode=0
May 21 15:36:04.567421 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:04.567107    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57908494-bacf-436c-af62-2ab9fe92e66f","Type":"ContainerDied","Data":"7f21e1cab1c291ed5fa61618b8f1a15f1c458687341f03b69e96cd37b7e6c425"}
May 21 15:36:04.567421 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:04.567141    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57908494-bacf-436c-af62-2ab9fe92e66f","Type":"ContainerStarted","Data":"870e500a0e869ec5edde0eaeae0f0f149ba4b44cbd5b0cbefd5294b73e3bfba5"}
May 21 15:36:05.573426 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:05.573389    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57908494-bacf-436c-af62-2ab9fe92e66f","Type":"ContainerStarted","Data":"f7688f22523821cc1684520657dced02131f87252f6b580d1f8ab302f3c7bd4e"}
May 21 15:36:05.573426 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:05.573427    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57908494-bacf-436c-af62-2ab9fe92e66f","Type":"ContainerStarted","Data":"cbc0cae7d83a0e2cfbce4b1c1a66bf007eb23142ed81e874828deb835a799288"}
May 21 15:36:05.573816 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:05.573436    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57908494-bacf-436c-af62-2ab9fe92e66f","Type":"ContainerStarted","Data":"f2b3810a3f71c9faa2d93680241de9862ffac910ac066e3b098c99c8be020819"}
May 21 15:36:05.573816 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:05.573447    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57908494-bacf-436c-af62-2ab9fe92e66f","Type":"ContainerStarted","Data":"fc0a7c1c35273a5812732efb2d38ed457812e4cda07e18ad5afe3e85ff58dc2c"}
May 21 15:36:05.573816 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:05.573456    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57908494-bacf-436c-af62-2ab9fe92e66f","Type":"ContainerStarted","Data":"df600a342e3b9966de0a51f8c2eb31fb56404914b279d7b57b53568635b455ba"}
May 21 15:36:05.573816 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:05.573465    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57908494-bacf-436c-af62-2ab9fe92e66f","Type":"ContainerStarted","Data":"731684a9da80f742d7f925a1388be873f767247b68b674f324a11fdf5fa01cd8"}
May 21 15:36:05.603803 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:05.603748    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.603731481 podStartE2EDuration="2.603731481s" podCreationTimestamp="2026-05-21 15:36:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:36:05.602146937 +0000 UTC m=+226.322309475" watchObservedRunningTime="2026-05-21 15:36:05.603731481 +0000 UTC m=+226.323894020"
May 21 15:36:08.929619 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:08.929572    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:36:22.712173 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:22.712136    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-f6cm6"]
May 21 15:36:22.715162 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:22.715142    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6cm6"
May 21 15:36:22.717653 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:22.717634    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 21 15:36:22.727350 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:22.727324    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f6cm6"]
May 21 15:36:22.777305 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:22.777242    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c595139-6ece-41c7-9eb2-cdb6cda3df6d-original-pull-secret\") pod \"global-pull-secret-syncer-f6cm6\" (UID: \"9c595139-6ece-41c7-9eb2-cdb6cda3df6d\") " pod="kube-system/global-pull-secret-syncer-f6cm6"
May 21 15:36:22.777490 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:22.777328    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9c595139-6ece-41c7-9eb2-cdb6cda3df6d-dbus\") pod \"global-pull-secret-syncer-f6cm6\" (UID: \"9c595139-6ece-41c7-9eb2-cdb6cda3df6d\") " pod="kube-system/global-pull-secret-syncer-f6cm6"
May 21 15:36:22.777490 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:22.777404    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9c595139-6ece-41c7-9eb2-cdb6cda3df6d-kubelet-config\") pod \"global-pull-secret-syncer-f6cm6\" (UID: \"9c595139-6ece-41c7-9eb2-cdb6cda3df6d\") " pod="kube-system/global-pull-secret-syncer-f6cm6"
May 21 15:36:22.878180 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:22.878138    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9c595139-6ece-41c7-9eb2-cdb6cda3df6d-kubelet-config\") pod \"global-pull-secret-syncer-f6cm6\" (UID: \"9c595139-6ece-41c7-9eb2-cdb6cda3df6d\") " pod="kube-system/global-pull-secret-syncer-f6cm6"
May 21 15:36:22.878180 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:22.878193    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c595139-6ece-41c7-9eb2-cdb6cda3df6d-original-pull-secret\") pod \"global-pull-secret-syncer-f6cm6\" (UID: \"9c595139-6ece-41c7-9eb2-cdb6cda3df6d\") " pod="kube-system/global-pull-secret-syncer-f6cm6"
May 21 15:36:22.878446 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:22.878230    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9c595139-6ece-41c7-9eb2-cdb6cda3df6d-dbus\") pod \"global-pull-secret-syncer-f6cm6\" (UID: \"9c595139-6ece-41c7-9eb2-cdb6cda3df6d\") " pod="kube-system/global-pull-secret-syncer-f6cm6"
May 21 15:36:22.878446 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:22.878309    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9c595139-6ece-41c7-9eb2-cdb6cda3df6d-kubelet-config\") pod \"global-pull-secret-syncer-f6cm6\" (UID: \"9c595139-6ece-41c7-9eb2-cdb6cda3df6d\") " pod="kube-system/global-pull-secret-syncer-f6cm6"
May 21 15:36:22.878446 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:22.878435    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9c595139-6ece-41c7-9eb2-cdb6cda3df6d-dbus\") pod \"global-pull-secret-syncer-f6cm6\" (UID: \"9c595139-6ece-41c7-9eb2-cdb6cda3df6d\") " pod="kube-system/global-pull-secret-syncer-f6cm6"
May 21 15:36:22.880562 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:22.880545    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c595139-6ece-41c7-9eb2-cdb6cda3df6d-original-pull-secret\") pod \"global-pull-secret-syncer-f6cm6\" (UID: \"9c595139-6ece-41c7-9eb2-cdb6cda3df6d\") " pod="kube-system/global-pull-secret-syncer-f6cm6"
May 21 15:36:23.024186 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:23.024107    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6cm6"
May 21 15:36:23.151675 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:23.151632    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f6cm6"]
May 21 15:36:23.154633 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:36:23.154603    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c595139_6ece_41c7_9eb2_cdb6cda3df6d.slice/crio-6be1a332760136825e35dad0d8c0ccc8f87e589720ddb34b8b2236d347e14cb8 WatchSource:0}: Error finding container 6be1a332760136825e35dad0d8c0ccc8f87e589720ddb34b8b2236d347e14cb8: Status 404 returned error can't find the container with id 6be1a332760136825e35dad0d8c0ccc8f87e589720ddb34b8b2236d347e14cb8
May 21 15:36:23.628425 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:23.628385    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f6cm6" event={"ID":"9c595139-6ece-41c7-9eb2-cdb6cda3df6d","Type":"ContainerStarted","Data":"6be1a332760136825e35dad0d8c0ccc8f87e589720ddb34b8b2236d347e14cb8"}
May 21 15:36:27.642046 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:27.642011    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f6cm6" event={"ID":"9c595139-6ece-41c7-9eb2-cdb6cda3df6d","Type":"ContainerStarted","Data":"83d103528057bbf86ba983f7017c14f30eaec008d01ebd11ca02e7116c030692"}
May 21 15:36:27.657858 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:36:27.657802    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-f6cm6" podStartSLOduration=1.683714197 podStartE2EDuration="5.657788062s" podCreationTimestamp="2026-05-21 15:36:22 +0000 UTC" firstStartedPulling="2026-05-21 15:36:23.156230429 +0000 UTC m=+243.876392948" lastFinishedPulling="2026-05-21 15:36:27.130304286 +0000 UTC m=+247.850466813" observedRunningTime="2026-05-21 15:36:27.657133979 +0000 UTC m=+248.377296519" watchObservedRunningTime="2026-05-21 15:36:27.657788062 +0000 UTC m=+248.377950603"
May 21 15:37:03.929932 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:03.929893    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:37:03.945481 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:03.945454    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:37:04.769656 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:04.769626    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:37:19.739910 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:19.739887    2552 kubelet.go:1628] "Image garbage collection succeeded"
May 21 15:37:54.837551 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:54.837510    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5544b565-k5zb7"]
May 21 15:37:54.839912 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:54.839896    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5544b565-k5zb7"
May 21 15:37:54.843275 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:54.843224    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 21 15:37:54.843405 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:54.843377    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 21 15:37:54.843633 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:54.843617    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fgvqz\""
May 21 15:37:54.847066 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:54.847049    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 21 15:37:54.847171 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:54.847139    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 21 15:37:54.858427 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:54.858401    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5544b565-k5zb7"]
May 21 15:37:54.902116 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:54.902084    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmmdc\" (UniqueName: \"kubernetes.io/projected/25647832-639e-4fd2-97c1-cc9398c366e6-kube-api-access-nmmdc\") pod \"opendatahub-operator-controller-manager-5544b565-k5zb7\" (UID: \"25647832-639e-4fd2-97c1-cc9398c366e6\") " pod="opendatahub/opendatahub-operator-controller-manager-5544b565-k5zb7"
May 21 15:37:54.902356 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:54.902145    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/25647832-639e-4fd2-97c1-cc9398c366e6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5544b565-k5zb7\" (UID: \"25647832-639e-4fd2-97c1-cc9398c366e6\") " pod="opendatahub/opendatahub-operator-controller-manager-5544b565-k5zb7"
May 21 15:37:54.902356 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:54.902185    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/25647832-639e-4fd2-97c1-cc9398c366e6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5544b565-k5zb7\" (UID: \"25647832-639e-4fd2-97c1-cc9398c366e6\") " pod="opendatahub/opendatahub-operator-controller-manager-5544b565-k5zb7"
May 21 15:37:55.003045 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:55.003012    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/25647832-639e-4fd2-97c1-cc9398c366e6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5544b565-k5zb7\" (UID: \"25647832-639e-4fd2-97c1-cc9398c366e6\") " pod="opendatahub/opendatahub-operator-controller-manager-5544b565-k5zb7"
May 21 15:37:55.003241 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:55.003058    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/25647832-639e-4fd2-97c1-cc9398c366e6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5544b565-k5zb7\" (UID: \"25647832-639e-4fd2-97c1-cc9398c366e6\") " pod="opendatahub/opendatahub-operator-controller-manager-5544b565-k5zb7"
May 21 15:37:55.003241 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:55.003130    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nmmdc\" (UniqueName: \"kubernetes.io/projected/25647832-639e-4fd2-97c1-cc9398c366e6-kube-api-access-nmmdc\") pod \"opendatahub-operator-controller-manager-5544b565-k5zb7\" (UID: \"25647832-639e-4fd2-97c1-cc9398c366e6\") " pod="opendatahub/opendatahub-operator-controller-manager-5544b565-k5zb7"
May 21 15:37:55.005587 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:55.005555    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/25647832-639e-4fd2-97c1-cc9398c366e6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5544b565-k5zb7\" (UID: \"25647832-639e-4fd2-97c1-cc9398c366e6\") " pod="opendatahub/opendatahub-operator-controller-manager-5544b565-k5zb7"
May 21 15:37:55.005689 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:55.005616    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/25647832-639e-4fd2-97c1-cc9398c366e6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5544b565-k5zb7\" (UID: \"25647832-639e-4fd2-97c1-cc9398c366e6\") " pod="opendatahub/opendatahub-operator-controller-manager-5544b565-k5zb7"
May 21 15:37:55.015890 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:55.015868    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmmdc\" (UniqueName: \"kubernetes.io/projected/25647832-639e-4fd2-97c1-cc9398c366e6-kube-api-access-nmmdc\") pod \"opendatahub-operator-controller-manager-5544b565-k5zb7\" (UID: \"25647832-639e-4fd2-97c1-cc9398c366e6\") " pod="opendatahub/opendatahub-operator-controller-manager-5544b565-k5zb7"
May 21 15:37:55.150841 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:55.150754    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5544b565-k5zb7"
May 21 15:37:55.277734 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:55.277698    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5544b565-k5zb7"]
May 21 15:37:55.281678 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:37:55.281649    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25647832_639e_4fd2_97c1_cc9398c366e6.slice/crio-8495c5425235c2c82630300e1b3a73cc7b836ffd626db55c072d3d849faeba00 WatchSource:0}: Error finding container 8495c5425235c2c82630300e1b3a73cc7b836ffd626db55c072d3d849faeba00: Status 404 returned error can't find the container with id 8495c5425235c2c82630300e1b3a73cc7b836ffd626db55c072d3d849faeba00
May 21 15:37:55.283287 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:55.283254    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 15:37:55.911514 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:55.911477    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5544b565-k5zb7" event={"ID":"25647832-639e-4fd2-97c1-cc9398c366e6","Type":"ContainerStarted","Data":"8495c5425235c2c82630300e1b3a73cc7b836ffd626db55c072d3d849faeba00"}
May 21 15:37:57.919114 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:57.919078    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5544b565-k5zb7" event={"ID":"25647832-639e-4fd2-97c1-cc9398c366e6","Type":"ContainerStarted","Data":"0d735cf9d8f93fcd88992ebfda4af1eaef7e03df2d6fe2822d78cd5b0d394cf6"}
May 21 15:37:57.919520 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:57.919133    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5544b565-k5zb7"
May 21 15:37:57.941439 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:37:57.941380    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5544b565-k5zb7" podStartSLOduration=1.444789908 podStartE2EDuration="3.94136072s" podCreationTimestamp="2026-05-21 15:37:54 +0000 UTC" firstStartedPulling="2026-05-21 15:37:55.283389962 +0000 UTC m=+336.003552477" lastFinishedPulling="2026-05-21 15:37:57.77996077 +0000 UTC m=+338.500123289" observedRunningTime="2026-05-21 15:37:57.938328854 +0000 UTC m=+338.658491391" watchObservedRunningTime="2026-05-21 15:37:57.94136072 +0000 UTC m=+338.661523262"
May 21 15:38:08.924619 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:08.924536    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5544b565-k5zb7"
May 21 15:38:10.195589 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:10.195557    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7665979896-mj6dk"]
May 21 15:38:10.198672 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:10.198653    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7665979896-mj6dk"
May 21 15:38:10.201884 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:10.201863    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 21 15:38:10.202911 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:10.202883    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 21 15:38:10.203019 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:10.202956    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 21 15:38:10.203019 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:10.202965    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4m5t6\""
May 21 15:38:10.203019 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:10.202978    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 21 15:38:10.203019 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:10.202956    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 21 15:38:10.212501 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:10.212468    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7665979896-mj6dk"]
May 21 15:38:10.336650 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:10.336616    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf585\" (UniqueName: \"kubernetes.io/projected/474dfac0-c187-4da6-8ed4-07cf022b14d4-kube-api-access-jf585\") pod \"lws-controller-manager-7665979896-mj6dk\" (UID: \"474dfac0-c187-4da6-8ed4-07cf022b14d4\") " pod="openshift-lws-operator/lws-controller-manager-7665979896-mj6dk"
May 21 15:38:10.336844 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:10.336666    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/474dfac0-c187-4da6-8ed4-07cf022b14d4-manager-config\") pod \"lws-controller-manager-7665979896-mj6dk\" (UID: \"474dfac0-c187-4da6-8ed4-07cf022b14d4\") " pod="openshift-lws-operator/lws-controller-manager-7665979896-mj6dk"
May 21 15:38:10.336844 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:10.336785    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/474dfac0-c187-4da6-8ed4-07cf022b14d4-metrics-cert\") pod \"lws-controller-manager-7665979896-mj6dk\" (UID: \"474dfac0-c187-4da6-8ed4-07cf022b14d4\") " pod="openshift-lws-operator/lws-controller-manager-7665979896-mj6dk"
May 21 15:38:10.336957 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:10.336843    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/474dfac0-c187-4da6-8ed4-07cf022b14d4-cert\") pod \"lws-controller-manager-7665979896-mj6dk\" (UID: \"474dfac0-c187-4da6-8ed4-07cf022b14d4\") " pod="openshift-lws-operator/lws-controller-manager-7665979896-mj6dk"
May 21 15:38:10.437962 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:10.437921    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/474dfac0-c187-4da6-8ed4-07cf022b14d4-manager-config\") pod \"lws-controller-manager-7665979896-mj6dk\" (UID: \"474dfac0-c187-4da6-8ed4-07cf022b14d4\") " pod="openshift-lws-operator/lws-controller-manager-7665979896-mj6dk"
May 21 15:38:10.438163 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:10.437984    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/474dfac0-c187-4da6-8ed4-07cf022b14d4-metrics-cert\") pod \"lws-controller-manager-7665979896-mj6dk\" (UID: \"474dfac0-c187-4da6-8ed4-07cf022b14d4\") " pod="openshift-lws-operator/lws-controller-manager-7665979896-mj6dk"
May 21 15:38:10.438163 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:10.438020    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/474dfac0-c187-4da6-8ed4-07cf022b14d4-cert\") pod \"lws-controller-manager-7665979896-mj6dk\" (UID: \"474dfac0-c187-4da6-8ed4-07cf022b14d4\") " pod="openshift-lws-operator/lws-controller-manager-7665979896-mj6dk"
May 21 15:38:10.438163 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:10.438068    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jf585\" (UniqueName: \"kubernetes.io/projected/474dfac0-c187-4da6-8ed4-07cf022b14d4-kube-api-access-jf585\") pod \"lws-controller-manager-7665979896-mj6dk\" (UID: \"474dfac0-c187-4da6-8ed4-07cf022b14d4\") " pod="openshift-lws-operator/lws-controller-manager-7665979896-mj6dk"
May 21 15:38:10.438707 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:10.438680    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/474dfac0-c187-4da6-8ed4-07cf022b14d4-manager-config\") pod \"lws-controller-manager-7665979896-mj6dk\" (UID: \"474dfac0-c187-4da6-8ed4-07cf022b14d4\") " pod="openshift-lws-operator/lws-controller-manager-7665979896-mj6dk"
May 21 15:38:10.440501 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:10.440479    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/474dfac0-c187-4da6-8ed4-07cf022b14d4-metrics-cert\") pod \"lws-controller-manager-7665979896-mj6dk\" (UID: \"474dfac0-c187-4da6-8ed4-07cf022b14d4\") " pod="openshift-lws-operator/lws-controller-manager-7665979896-mj6dk"
May 21 15:38:10.440616 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:10.440597    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/474dfac0-c187-4da6-8ed4-07cf022b14d4-cert\") pod \"lws-controller-manager-7665979896-mj6dk\" (UID: \"474dfac0-c187-4da6-8ed4-07cf022b14d4\") " pod="openshift-lws-operator/lws-controller-manager-7665979896-mj6dk"
May 21 15:38:10.448601 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:10.448543    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf585\" (UniqueName: \"kubernetes.io/projected/474dfac0-c187-4da6-8ed4-07cf022b14d4-kube-api-access-jf585\") pod \"lws-controller-manager-7665979896-mj6dk\" (UID: \"474dfac0-c187-4da6-8ed4-07cf022b14d4\") " pod="openshift-lws-operator/lws-controller-manager-7665979896-mj6dk"
May 21 15:38:10.508140 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:10.508101    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7665979896-mj6dk"
May 21 15:38:10.644847 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:10.644821    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7665979896-mj6dk"]
May 21 15:38:10.647506 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:38:10.647476    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod474dfac0_c187_4da6_8ed4_07cf022b14d4.slice/crio-4b96234c50a9acca609de25f19a3353614db6e33aceaca1dabc0b5ecfcaa5e8b WatchSource:0}: Error finding container 4b96234c50a9acca609de25f19a3353614db6e33aceaca1dabc0b5ecfcaa5e8b: Status 404 returned error can't find the container with id 4b96234c50a9acca609de25f19a3353614db6e33aceaca1dabc0b5ecfcaa5e8b
May 21 15:38:10.962185 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:10.962148    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7665979896-mj6dk" event={"ID":"474dfac0-c187-4da6-8ed4-07cf022b14d4","Type":"ContainerStarted","Data":"4b96234c50a9acca609de25f19a3353614db6e33aceaca1dabc0b5ecfcaa5e8b"}
May 21 15:38:12.272408 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:12.272367    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5bc586767c-995lg"]
May 21 15:38:12.277905 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:12.277880    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5bc586767c-995lg"
May 21 15:38:12.283160 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:12.283138    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 21 15:38:12.283316 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:12.283189    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8qtnk\""
May 21 15:38:12.284439 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:12.284384    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 21 15:38:12.284439 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:12.284404    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 21 15:38:12.284439 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:12.284390    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 21 15:38:12.295569 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:12.295538    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5bc586767c-995lg"]
May 21 15:38:12.462508 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:12.462461    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6d4a708-8b03-4097-8d47-786cd77399f3-tmp\") pod \"kube-auth-proxy-5bc586767c-995lg\" (UID: \"d6d4a708-8b03-4097-8d47-786cd77399f3\") " pod="openshift-ingress/kube-auth-proxy-5bc586767c-995lg"
May 21 15:38:12.462687 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:12.462597    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6d4a708-8b03-4097-8d47-786cd77399f3-tls-certs\") pod \"kube-auth-proxy-5bc586767c-995lg\" (UID: \"d6d4a708-8b03-4097-8d47-786cd77399f3\") " pod="openshift-ingress/kube-auth-proxy-5bc586767c-995lg"
May 21 15:38:12.462687 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:12.462630    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj28f\" (UniqueName: \"kubernetes.io/projected/d6d4a708-8b03-4097-8d47-786cd77399f3-kube-api-access-xj28f\") pod \"kube-auth-proxy-5bc586767c-995lg\" (UID: \"d6d4a708-8b03-4097-8d47-786cd77399f3\") " pod="openshift-ingress/kube-auth-proxy-5bc586767c-995lg"
May 21 15:38:12.563749 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:12.563662    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6d4a708-8b03-4097-8d47-786cd77399f3-tmp\") pod \"kube-auth-proxy-5bc586767c-995lg\" (UID: \"d6d4a708-8b03-4097-8d47-786cd77399f3\") " pod="openshift-ingress/kube-auth-proxy-5bc586767c-995lg"
May 21 15:38:12.563949 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:12.563753    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6d4a708-8b03-4097-8d47-786cd77399f3-tls-certs\") pod \"kube-auth-proxy-5bc586767c-995lg\" (UID: \"d6d4a708-8b03-4097-8d47-786cd77399f3\") " pod="openshift-ingress/kube-auth-proxy-5bc586767c-995lg"
May 21 15:38:12.563949 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:12.563784    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xj28f\" (UniqueName: \"kubernetes.io/projected/d6d4a708-8b03-4097-8d47-786cd77399f3-kube-api-access-xj28f\") pod \"kube-auth-proxy-5bc586767c-995lg\" (UID: \"d6d4a708-8b03-4097-8d47-786cd77399f3\") " pod="openshift-ingress/kube-auth-proxy-5bc586767c-995lg"
May 21 15:38:12.566716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:12.566664    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6d4a708-8b03-4097-8d47-786cd77399f3-tls-certs\") pod \"kube-auth-proxy-5bc586767c-995lg\" (UID: \"d6d4a708-8b03-4097-8d47-786cd77399f3\") " pod="openshift-ingress/kube-auth-proxy-5bc586767c-995lg"
May 21 15:38:12.566954 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:12.566929    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6d4a708-8b03-4097-8d47-786cd77399f3-tmp\") pod \"kube-auth-proxy-5bc586767c-995lg\" (UID: \"d6d4a708-8b03-4097-8d47-786cd77399f3\") " pod="openshift-ingress/kube-auth-proxy-5bc586767c-995lg"
May 21 15:38:12.586195 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:12.586170    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj28f\" (UniqueName: \"kubernetes.io/projected/d6d4a708-8b03-4097-8d47-786cd77399f3-kube-api-access-xj28f\") pod \"kube-auth-proxy-5bc586767c-995lg\" (UID: \"d6d4a708-8b03-4097-8d47-786cd77399f3\") " pod="openshift-ingress/kube-auth-proxy-5bc586767c-995lg"
May 21 15:38:12.590892 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:12.590869    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5bc586767c-995lg"
May 21 15:38:13.317245 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:13.317217    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5bc586767c-995lg"]
May 21 15:38:13.319751 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:38:13.319723    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6d4a708_8b03_4097_8d47_786cd77399f3.slice/crio-d0a17c6ded3adc96d7131c77bdb831e2e3444b70074e72a418ff16c4b2d17769 WatchSource:0}: Error finding container d0a17c6ded3adc96d7131c77bdb831e2e3444b70074e72a418ff16c4b2d17769: Status 404 returned error can't find the container with id d0a17c6ded3adc96d7131c77bdb831e2e3444b70074e72a418ff16c4b2d17769
May 21 15:38:13.976616 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:13.976573    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7665979896-mj6dk" event={"ID":"474dfac0-c187-4da6-8ed4-07cf022b14d4","Type":"ContainerStarted","Data":"561060cc4bbb50d23a932699a69282f574e0d729d3822d8f7b83893f13263b60"}
May 21 15:38:13.977007 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:13.976967    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7665979896-mj6dk"
May 21 15:38:13.978319 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:13.978222    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5bc586767c-995lg" event={"ID":"d6d4a708-8b03-4097-8d47-786cd77399f3","Type":"ContainerStarted","Data":"d0a17c6ded3adc96d7131c77bdb831e2e3444b70074e72a418ff16c4b2d17769"}
May 21 15:38:13.993719 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:13.993651    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7665979896-mj6dk" podStartSLOduration=1.431806777 podStartE2EDuration="3.993637207s" podCreationTimestamp="2026-05-21 15:38:10 +0000 UTC" firstStartedPulling="2026-05-21 15:38:10.649336184 +0000 UTC m=+351.369498699" lastFinishedPulling="2026-05-21 15:38:13.211166612 +0000 UTC m=+353.931329129" observedRunningTime="2026-05-21 15:38:13.992377145 +0000 UTC m=+354.712539683" watchObservedRunningTime="2026-05-21 15:38:13.993637207 +0000 UTC m=+354.713799745"
May 21 15:38:16.989918 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:16.989870    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5bc586767c-995lg" event={"ID":"d6d4a708-8b03-4097-8d47-786cd77399f3","Type":"ContainerStarted","Data":"f40ef6933cda866582d0534d76e571d5e9894300c3ffa82d37e620fdb644c3d2"}
May 21 15:38:17.010940 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:17.010887    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5bc586767c-995lg" podStartSLOduration=2.3921538 podStartE2EDuration="5.010872024s" podCreationTimestamp="2026-05-21 15:38:12 +0000 UTC" firstStartedPulling="2026-05-21 15:38:13.321667174 +0000 UTC m=+354.041829693" lastFinishedPulling="2026-05-21 15:38:15.940385386 +0000 UTC m=+356.660547917" observedRunningTime="2026-05-21 15:38:17.009792403 +0000 UTC m=+357.729954942" watchObservedRunningTime="2026-05-21 15:38:17.010872024 +0000 UTC m=+357.731034592"
May 21 15:38:24.984772 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:38:24.984742    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7665979896-mj6dk"
May 21 15:39:49.115460 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:39:49.115360    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lt7hx"]
May 21 15:39:49.119181 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:39:49.119157    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lt7hx"
May 21 15:39:49.121954 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:39:49.121932    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-h25p5\""
May 21 15:39:49.122739 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:39:49.122720    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 15:39:49.122739 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:39:49.122732    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 15:39:49.131754 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:39:49.131729    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lt7hx"]
May 21 15:39:49.204023 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:39:49.203983    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdlss\" (UniqueName: \"kubernetes.io/projected/66836519-ab8b-4787-913a-f4caeea215a7-kube-api-access-cdlss\") pod \"limitador-operator-controller-manager-85c4996f8c-lt7hx\" (UID: \"66836519-ab8b-4787-913a-f4caeea215a7\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lt7hx"
May 21 15:39:49.305401 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:39:49.305370    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cdlss\" (UniqueName: \"kubernetes.io/projected/66836519-ab8b-4787-913a-f4caeea215a7-kube-api-access-cdlss\") pod \"limitador-operator-controller-manager-85c4996f8c-lt7hx\" (UID: \"66836519-ab8b-4787-913a-f4caeea215a7\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lt7hx"
May 21 15:39:49.328120 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:39:49.328097    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdlss\" (UniqueName: \"kubernetes.io/projected/66836519-ab8b-4787-913a-f4caeea215a7-kube-api-access-cdlss\") pod \"limitador-operator-controller-manager-85c4996f8c-lt7hx\" (UID: \"66836519-ab8b-4787-913a-f4caeea215a7\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lt7hx"
May 21 15:39:49.428958 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:39:49.428928    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lt7hx"
May 21 15:39:49.571206 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:39:49.571120    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lt7hx"]
May 21 15:39:49.573421 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:39:49.573389    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66836519_ab8b_4787_913a_f4caeea215a7.slice/crio-2c2b0ce79b65f7a6567b5b807aece82780d97ae145a6015883f27ee0d38ab55d WatchSource:0}: Error finding container 2c2b0ce79b65f7a6567b5b807aece82780d97ae145a6015883f27ee0d38ab55d: Status 404 returned error can't find the container with id 2c2b0ce79b65f7a6567b5b807aece82780d97ae145a6015883f27ee0d38ab55d
May 21 15:39:50.297498 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:39:50.297456    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lt7hx" event={"ID":"66836519-ab8b-4787-913a-f4caeea215a7","Type":"ContainerStarted","Data":"2c2b0ce79b65f7a6567b5b807aece82780d97ae145a6015883f27ee0d38ab55d"}
May 21 15:39:53.310736 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:39:53.310699    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lt7hx" event={"ID":"66836519-ab8b-4787-913a-f4caeea215a7","Type":"ContainerStarted","Data":"f46d2336129117f13667f40fc9a4db288b5413685366df0ced270478d0be7442"}
May 21 15:39:53.311189 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:39:53.310823    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lt7hx"
May 21 15:39:53.337317 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:39:53.337252    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lt7hx" podStartSLOduration=1.364319323 podStartE2EDuration="4.337238093s" podCreationTimestamp="2026-05-21 15:39:49 +0000 UTC" firstStartedPulling="2026-05-21 15:39:49.575319156 +0000 UTC m=+450.295481674" lastFinishedPulling="2026-05-21 15:39:52.548237925 +0000 UTC m=+453.268400444" observedRunningTime="2026-05-21 15:39:53.333314284 +0000 UTC m=+454.053476815" watchObservedRunningTime="2026-05-21 15:39:53.337238093 +0000 UTC m=+454.057400630"
May 21 15:40:04.316432 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:04.316399    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lt7hx"
May 21 15:40:06.714716 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:06.714678    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lt7hx"]
May 21 15:40:06.715126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:06.714961    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lt7hx" podUID="66836519-ab8b-4787-913a-f4caeea215a7" containerName="manager" containerID="cri-o://f46d2336129117f13667f40fc9a4db288b5413685366df0ced270478d0be7442" gracePeriod=2
May 21 15:40:06.772805 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:06.772771    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lt7hx"]
May 21 15:40:06.939789 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:06.939766    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lt7hx"
May 21 15:40:06.943820 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:06.943779    2552 status_manager.go:895] "Failed to get status for pod" podUID="66836519-ab8b-4787-913a-f4caeea215a7" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lt7hx" err="pods \"limitador-operator-controller-manager-85c4996f8c-lt7hx\" is forbidden: User \"system:node:ip-10-0-132-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-73.ec2.internal' and this object"
May 21 15:40:07.062680 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:07.062590    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdlss\" (UniqueName: \"kubernetes.io/projected/66836519-ab8b-4787-913a-f4caeea215a7-kube-api-access-cdlss\") pod \"66836519-ab8b-4787-913a-f4caeea215a7\" (UID: \"66836519-ab8b-4787-913a-f4caeea215a7\") "
May 21 15:40:07.064828 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:07.064803    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66836519-ab8b-4787-913a-f4caeea215a7-kube-api-access-cdlss" (OuterVolumeSpecName: "kube-api-access-cdlss") pod "66836519-ab8b-4787-913a-f4caeea215a7" (UID: "66836519-ab8b-4787-913a-f4caeea215a7"). InnerVolumeSpecName "kube-api-access-cdlss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:40:07.163145 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:07.163112    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdlss\" (UniqueName: \"kubernetes.io/projected/66836519-ab8b-4787-913a-f4caeea215a7-kube-api-access-cdlss\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:40:07.355873 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:07.355783    2552 generic.go:358] "Generic (PLEG): container finished" podID="66836519-ab8b-4787-913a-f4caeea215a7" containerID="f46d2336129117f13667f40fc9a4db288b5413685366df0ced270478d0be7442" exitCode=0
May 21 15:40:07.355873 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:07.355828    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lt7hx"
May 21 15:40:07.356047 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:07.355881    2552 scope.go:117] "RemoveContainer" containerID="f46d2336129117f13667f40fc9a4db288b5413685366df0ced270478d0be7442"
May 21 15:40:07.359126 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:07.359096    2552 status_manager.go:895] "Failed to get status for pod" podUID="66836519-ab8b-4787-913a-f4caeea215a7" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lt7hx" err="pods \"limitador-operator-controller-manager-85c4996f8c-lt7hx\" is forbidden: User \"system:node:ip-10-0-132-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-73.ec2.internal' and this object"
May 21 15:40:07.364866 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:07.364849    2552 scope.go:117] "RemoveContainer" containerID="f46d2336129117f13667f40fc9a4db288b5413685366df0ced270478d0be7442"
May 21 15:40:07.365116 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:40:07.365096    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f46d2336129117f13667f40fc9a4db288b5413685366df0ced270478d0be7442\": container with ID starting with f46d2336129117f13667f40fc9a4db288b5413685366df0ced270478d0be7442 not found: ID does not exist" containerID="f46d2336129117f13667f40fc9a4db288b5413685366df0ced270478d0be7442"
May 21 15:40:07.365182 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:07.365123    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f46d2336129117f13667f40fc9a4db288b5413685366df0ced270478d0be7442"} err="failed to get container status \"f46d2336129117f13667f40fc9a4db288b5413685366df0ced270478d0be7442\": rpc error: code = NotFound desc = could not find container \"f46d2336129117f13667f40fc9a4db288b5413685366df0ced270478d0be7442\": container with ID starting with f46d2336129117f13667f40fc9a4db288b5413685366df0ced270478d0be7442 not found: ID does not exist"
May 21 15:40:07.367493 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:07.367468    2552 status_manager.go:895] "Failed to get status for pod" podUID="66836519-ab8b-4787-913a-f4caeea215a7" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lt7hx" err="pods \"limitador-operator-controller-manager-85c4996f8c-lt7hx\" is forbidden: User \"system:node:ip-10-0-132-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-73.ec2.internal' and this object"
May 21 15:40:07.846242 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:07.846202    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66836519-ab8b-4787-913a-f4caeea215a7" path="/var/lib/kubelet/pods/66836519-ab8b-4787-913a-f4caeea215a7/volumes"
May 21 15:40:37.144141 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.144107    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"]
May 21 15:40:37.144604 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.144505    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66836519-ab8b-4787-913a-f4caeea215a7" containerName="manager"
May 21 15:40:37.144604 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.144520    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="66836519-ab8b-4787-913a-f4caeea215a7" containerName="manager"
May 21 15:40:37.144604 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.144590    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="66836519-ab8b-4787-913a-f4caeea215a7" containerName="manager"
May 21 15:40:37.147845 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.147820    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.150244 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.150199    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 21 15:40:37.150408 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.150199    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-fd9xw\""
May 21 15:40:37.163881 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.163853    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"]
May 21 15:40:37.218477 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.218442    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1621ed22-6820-4cf0-8007-f8de8431d5d0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.218676 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.218488    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1621ed22-6820-4cf0-8007-f8de8431d5d0-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.218676 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.218528    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1621ed22-6820-4cf0-8007-f8de8431d5d0-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.218676 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.218633    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn85b\" (UniqueName: \"kubernetes.io/projected/1621ed22-6820-4cf0-8007-f8de8431d5d0-kube-api-access-vn85b\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.218846 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.218678    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1621ed22-6820-4cf0-8007-f8de8431d5d0-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.218846 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.218736    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1621ed22-6820-4cf0-8007-f8de8431d5d0-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.218846 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.218796    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1621ed22-6820-4cf0-8007-f8de8431d5d0-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.218997 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.218869    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1621ed22-6820-4cf0-8007-f8de8431d5d0-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.218997 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.218902    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1621ed22-6820-4cf0-8007-f8de8431d5d0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.319830 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.319792    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vn85b\" (UniqueName: \"kubernetes.io/projected/1621ed22-6820-4cf0-8007-f8de8431d5d0-kube-api-access-vn85b\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.319830 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.319832    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1621ed22-6820-4cf0-8007-f8de8431d5d0-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.320078 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.319871    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1621ed22-6820-4cf0-8007-f8de8431d5d0-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.320078 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.319907    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1621ed22-6820-4cf0-8007-f8de8431d5d0-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.320078 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.319948    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1621ed22-6820-4cf0-8007-f8de8431d5d0-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.320078 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.319974    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1621ed22-6820-4cf0-8007-f8de8431d5d0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.320078 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.319999    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1621ed22-6820-4cf0-8007-f8de8431d5d0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.320078 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.320044    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1621ed22-6820-4cf0-8007-f8de8431d5d0-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.320440 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.320091    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1621ed22-6820-4cf0-8007-f8de8431d5d0-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.320496 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.320467    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1621ed22-6820-4cf0-8007-f8de8431d5d0-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.320496 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.320478    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1621ed22-6820-4cf0-8007-f8de8431d5d0-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.320669 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.320653    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1621ed22-6820-4cf0-8007-f8de8431d5d0-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.320715 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.320695    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1621ed22-6820-4cf0-8007-f8de8431d5d0-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.320976 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.320954    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1621ed22-6820-4cf0-8007-f8de8431d5d0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.322391 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.322363    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1621ed22-6820-4cf0-8007-f8de8431d5d0-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.322515 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.322465    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1621ed22-6820-4cf0-8007-f8de8431d5d0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.334505 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.334467    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn85b\" (UniqueName: \"kubernetes.io/projected/1621ed22-6820-4cf0-8007-f8de8431d5d0-kube-api-access-vn85b\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.335213 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.335195    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1621ed22-6820-4cf0-8007-f8de8431d5d0-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-kl2tj\" (UID: \"1621ed22-6820-4cf0-8007-f8de8431d5d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.460372 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.460319    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:37.591910 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:37.591883    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"]
May 21 15:40:37.594675 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:40:37.594648    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1621ed22_6820_4cf0_8007_f8de8431d5d0.slice/crio-260d76e012f22892fcff813a89d2e738468ff59c8f1adbd479bf21e39f7b6137 WatchSource:0}: Error finding container 260d76e012f22892fcff813a89d2e738468ff59c8f1adbd479bf21e39f7b6137: Status 404 returned error can't find the container with id 260d76e012f22892fcff813a89d2e738468ff59c8f1adbd479bf21e39f7b6137
May 21 15:40:38.466639 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:38.466589    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj" event={"ID":"1621ed22-6820-4cf0-8007-f8de8431d5d0","Type":"ContainerStarted","Data":"260d76e012f22892fcff813a89d2e738468ff59c8f1adbd479bf21e39f7b6137"}
May 21 15:40:40.152356 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:40.152314    2552 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 21 15:40:40.152613 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:40.152393    2552 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 21 15:40:40.152613 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:40.152423    2552 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 21 15:40:40.475486 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:40.475451    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj" event={"ID":"1621ed22-6820-4cf0-8007-f8de8431d5d0","Type":"ContainerStarted","Data":"7d6eb45477d713764ba91df8123b1f8492fa92352afb8c0abb9353c7dfd3dc70"}
May 21 15:40:40.499367 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:40.499312    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj" podStartSLOduration=0.94366791 podStartE2EDuration="3.49929212s" podCreationTimestamp="2026-05-21 15:40:37 +0000 UTC" firstStartedPulling="2026-05-21 15:40:37.596438983 +0000 UTC m=+498.316601500" lastFinishedPulling="2026-05-21 15:40:40.152063195 +0000 UTC m=+500.872225710" observedRunningTime="2026-05-21 15:40:40.49781957 +0000 UTC m=+501.217982119" watchObservedRunningTime="2026-05-21 15:40:40.49929212 +0000 UTC m=+501.219454657"
May 21 15:40:41.460871 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:41.460838    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:41.465516 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:41.465491    2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:41.480591 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:41.480564    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:41.481613 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:41.481578    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-kl2tj"
May 21 15:40:41.926170 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:41.926130    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-mg869"]
May 21 15:40:41.929785 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:41.929768    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-mg869"
May 21 15:40:41.932538 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:41.932501    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7t4hg\""
May 21 15:40:41.932671 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:41.932597    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 21 15:40:41.932726 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:41.932677    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 15:40:41.933696 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:41.933679    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 15:40:41.937312 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:41.937294    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-mg869"]
May 21 15:40:42.026353 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:42.026319    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-mg869"]
May 21 15:40:42.066043 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:42.065999    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dc65ae4e-8fc7-49c1-8f9c-7f534714dc13-config-file\") pod \"limitador-limitador-7d549b5b-mg869\" (UID: \"dc65ae4e-8fc7-49c1-8f9c-7f534714dc13\") " pod="kuadrant-system/limitador-limitador-7d549b5b-mg869"
May 21 15:40:42.066221 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:42.066070    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwqpd\" (UniqueName: \"kubernetes.io/projected/dc65ae4e-8fc7-49c1-8f9c-7f534714dc13-kube-api-access-wwqpd\") pod \"limitador-limitador-7d549b5b-mg869\" (UID: \"dc65ae4e-8fc7-49c1-8f9c-7f534714dc13\") " pod="kuadrant-system/limitador-limitador-7d549b5b-mg869"
May 21 15:40:42.167050 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:42.167013    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dc65ae4e-8fc7-49c1-8f9c-7f534714dc13-config-file\") pod \"limitador-limitador-7d549b5b-mg869\" (UID: \"dc65ae4e-8fc7-49c1-8f9c-7f534714dc13\") " pod="kuadrant-system/limitador-limitador-7d549b5b-mg869"
May 21 15:40:42.167050 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:42.167051    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wwqpd\" (UniqueName: \"kubernetes.io/projected/dc65ae4e-8fc7-49c1-8f9c-7f534714dc13-kube-api-access-wwqpd\") pod \"limitador-limitador-7d549b5b-mg869\" (UID: \"dc65ae4e-8fc7-49c1-8f9c-7f534714dc13\") " pod="kuadrant-system/limitador-limitador-7d549b5b-mg869"
May 21 15:40:42.167691 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:42.167669    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dc65ae4e-8fc7-49c1-8f9c-7f534714dc13-config-file\") pod \"limitador-limitador-7d549b5b-mg869\" (UID: \"dc65ae4e-8fc7-49c1-8f9c-7f534714dc13\") " pod="kuadrant-system/limitador-limitador-7d549b5b-mg869"
May 21 15:40:42.175550 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:42.175514    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwqpd\" (UniqueName: \"kubernetes.io/projected/dc65ae4e-8fc7-49c1-8f9c-7f534714dc13-kube-api-access-wwqpd\") pod \"limitador-limitador-7d549b5b-mg869\" (UID: \"dc65ae4e-8fc7-49c1-8f9c-7f534714dc13\") " pod="kuadrant-system/limitador-limitador-7d549b5b-mg869"
May 21 15:40:42.240837 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:42.240743    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-mg869"
May 21 15:40:42.367952 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:42.367912    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-mg869"]
May 21 15:40:42.370275 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:40:42.370232    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc65ae4e_8fc7_49c1_8f9c_7f534714dc13.slice/crio-8a64e43fbe33453ff425e822893e60ac2f06f2951357376d96a3f5579384bedb WatchSource:0}: Error finding container 8a64e43fbe33453ff425e822893e60ac2f06f2951357376d96a3f5579384bedb: Status 404 returned error can't find the container with id 8a64e43fbe33453ff425e822893e60ac2f06f2951357376d96a3f5579384bedb
May 21 15:40:42.484445 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:42.484404    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-mg869" event={"ID":"dc65ae4e-8fc7-49c1-8f9c-7f534714dc13","Type":"ContainerStarted","Data":"8a64e43fbe33453ff425e822893e60ac2f06f2951357376d96a3f5579384bedb"}
May 21 15:40:42.733188 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:42.733154    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-zqwz2"]
May 21 15:40:42.737958 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:42.737939    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-zqwz2"
May 21 15:40:42.740700 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:42.740679    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-x86r2\""
May 21 15:40:42.744656 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:42.744632    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-zqwz2"]
May 21 15:40:42.873490 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:42.873455    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btdj8\" (UniqueName: \"kubernetes.io/projected/4dae802b-0e21-48ac-acf5-f81237153c49-kube-api-access-btdj8\") pod \"authorino-f99f4b5cd-zqwz2\" (UID: \"4dae802b-0e21-48ac-acf5-f81237153c49\") " pod="kuadrant-system/authorino-f99f4b5cd-zqwz2"
May 21 15:40:42.974454 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:42.974419    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-btdj8\" (UniqueName: \"kubernetes.io/projected/4dae802b-0e21-48ac-acf5-f81237153c49-kube-api-access-btdj8\") pod \"authorino-f99f4b5cd-zqwz2\" (UID: \"4dae802b-0e21-48ac-acf5-f81237153c49\") " pod="kuadrant-system/authorino-f99f4b5cd-zqwz2"
May 21 15:40:42.987802 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:42.987743    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btdj8\" (UniqueName: \"kubernetes.io/projected/4dae802b-0e21-48ac-acf5-f81237153c49-kube-api-access-btdj8\") pod \"authorino-f99f4b5cd-zqwz2\" (UID: \"4dae802b-0e21-48ac-acf5-f81237153c49\") " pod="kuadrant-system/authorino-f99f4b5cd-zqwz2"
May 21 15:40:43.066276 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:43.066237    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-zqwz2"
May 21 15:40:43.193815 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:43.193784    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-zqwz2"]
May 21 15:40:43.196873 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:40:43.196842    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4dae802b_0e21_48ac_acf5_f81237153c49.slice/crio-a40c3b241b7dabebb75ea5247f8038372174f29ea55e3aa5282402c52bf4bfd7 WatchSource:0}: Error finding container a40c3b241b7dabebb75ea5247f8038372174f29ea55e3aa5282402c52bf4bfd7: Status 404 returned error can't find the container with id a40c3b241b7dabebb75ea5247f8038372174f29ea55e3aa5282402c52bf4bfd7
May 21 15:40:43.491103 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:43.491047    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-zqwz2" event={"ID":"4dae802b-0e21-48ac-acf5-f81237153c49","Type":"ContainerStarted","Data":"a40c3b241b7dabebb75ea5247f8038372174f29ea55e3aa5282402c52bf4bfd7"}
May 21 15:40:47.514341 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:47.514299    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-zqwz2" event={"ID":"4dae802b-0e21-48ac-acf5-f81237153c49","Type":"ContainerStarted","Data":"79c91ba86dac6629fc4b99cc7a98a4d2c645bbcf606fca874ffc053ba1f36000"}
May 21 15:40:47.515656 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:47.515631    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-mg869" event={"ID":"dc65ae4e-8fc7-49c1-8f9c-7f534714dc13","Type":"ContainerStarted","Data":"ed379c96b8e03493d0de34e51728cd5c74c1d60835bfa07c86c69c5f6f8281ab"}
May 21 15:40:47.515785 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:47.515773    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-mg869"
May 21 15:40:47.532914 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:47.532867    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-zqwz2" podStartSLOduration=1.6050557840000002 podStartE2EDuration="5.532854082s" podCreationTimestamp="2026-05-21 15:40:42 +0000 UTC" firstStartedPulling="2026-05-21 15:40:43.198190806 +0000 UTC m=+503.918353323" lastFinishedPulling="2026-05-21 15:40:47.125989092 +0000 UTC m=+507.846151621" observedRunningTime="2026-05-21 15:40:47.531167935 +0000 UTC m=+508.251330473" watchObservedRunningTime="2026-05-21 15:40:47.532854082 +0000 UTC m=+508.253016620"
May 21 15:40:47.555573 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:47.555504    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-mg869" podStartSLOduration=1.807814806 podStartE2EDuration="6.555484271s" podCreationTimestamp="2026-05-21 15:40:41 +0000 UTC" firstStartedPulling="2026-05-21 15:40:42.372146908 +0000 UTC m=+503.092309427" lastFinishedPulling="2026-05-21 15:40:47.119816373 +0000 UTC m=+507.839978892" observedRunningTime="2026-05-21 15:40:47.5551637 +0000 UTC m=+508.275326240" watchObservedRunningTime="2026-05-21 15:40:47.555484271 +0000 UTC m=+508.275646810"
May 21 15:40:48.949453 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:48.949422    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-zqwz2"]
May 21 15:40:49.522386 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:49.522347    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-zqwz2" podUID="4dae802b-0e21-48ac-acf5-f81237153c49" containerName="authorino" containerID="cri-o://79c91ba86dac6629fc4b99cc7a98a4d2c645bbcf606fca874ffc053ba1f36000" gracePeriod=30
May 21 15:40:49.770309 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:49.770286    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-zqwz2"
May 21 15:40:49.939131 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:49.939097    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btdj8\" (UniqueName: \"kubernetes.io/projected/4dae802b-0e21-48ac-acf5-f81237153c49-kube-api-access-btdj8\") pod \"4dae802b-0e21-48ac-acf5-f81237153c49\" (UID: \"4dae802b-0e21-48ac-acf5-f81237153c49\") "
May 21 15:40:49.941203 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:49.941177    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dae802b-0e21-48ac-acf5-f81237153c49-kube-api-access-btdj8" (OuterVolumeSpecName: "kube-api-access-btdj8") pod "4dae802b-0e21-48ac-acf5-f81237153c49" (UID: "4dae802b-0e21-48ac-acf5-f81237153c49"). InnerVolumeSpecName "kube-api-access-btdj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:40:50.040496 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:50.040458    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btdj8\" (UniqueName: \"kubernetes.io/projected/4dae802b-0e21-48ac-acf5-f81237153c49-kube-api-access-btdj8\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:40:50.526214 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:50.526178    2552 generic.go:358] "Generic (PLEG): container finished" podID="4dae802b-0e21-48ac-acf5-f81237153c49" containerID="79c91ba86dac6629fc4b99cc7a98a4d2c645bbcf606fca874ffc053ba1f36000" exitCode=0
May 21 15:40:50.526385 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:50.526232    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-zqwz2"
May 21 15:40:50.526385 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:50.526283    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-zqwz2" event={"ID":"4dae802b-0e21-48ac-acf5-f81237153c49","Type":"ContainerDied","Data":"79c91ba86dac6629fc4b99cc7a98a4d2c645bbcf606fca874ffc053ba1f36000"}
May 21 15:40:50.526385 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:50.526325    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-zqwz2" event={"ID":"4dae802b-0e21-48ac-acf5-f81237153c49","Type":"ContainerDied","Data":"a40c3b241b7dabebb75ea5247f8038372174f29ea55e3aa5282402c52bf4bfd7"}
May 21 15:40:50.526385 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:50.526346    2552 scope.go:117] "RemoveContainer" containerID="79c91ba86dac6629fc4b99cc7a98a4d2c645bbcf606fca874ffc053ba1f36000"
May 21 15:40:50.535342 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:50.535330    2552 scope.go:117] "RemoveContainer" containerID="79c91ba86dac6629fc4b99cc7a98a4d2c645bbcf606fca874ffc053ba1f36000"
May 21 15:40:50.535608 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:40:50.535590    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79c91ba86dac6629fc4b99cc7a98a4d2c645bbcf606fca874ffc053ba1f36000\": container with ID starting with 79c91ba86dac6629fc4b99cc7a98a4d2c645bbcf606fca874ffc053ba1f36000 not found: ID does not exist" containerID="79c91ba86dac6629fc4b99cc7a98a4d2c645bbcf606fca874ffc053ba1f36000"
May 21 15:40:50.535643 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:50.535618    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c91ba86dac6629fc4b99cc7a98a4d2c645bbcf606fca874ffc053ba1f36000"} err="failed to get container status \"79c91ba86dac6629fc4b99cc7a98a4d2c645bbcf606fca874ffc053ba1f36000\": rpc error: code = NotFound desc = could not find container \"79c91ba86dac6629fc4b99cc7a98a4d2c645bbcf606fca874ffc053ba1f36000\": container with ID starting with 79c91ba86dac6629fc4b99cc7a98a4d2c645bbcf606fca874ffc053ba1f36000 not found: ID does not exist"
May 21 15:40:50.549664 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:50.549638    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-zqwz2"]
May 21 15:40:50.553314 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:50.553292    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-zqwz2"]
May 21 15:40:51.846337 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:51.846300    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dae802b-0e21-48ac-acf5-f81237153c49" path="/var/lib/kubelet/pods/4dae802b-0e21-48ac-acf5-f81237153c49/volumes"
May 21 15:40:58.520197 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:58.520162    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-mg869"
May 21 15:40:59.952811 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:59.952772    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-mg869"]
May 21 15:40:59.953187 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:40:59.953039    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-mg869" podUID="dc65ae4e-8fc7-49c1-8f9c-7f534714dc13" containerName="limitador" containerID="cri-o://ed379c96b8e03493d0de34e51728cd5c74c1d60835bfa07c86c69c5f6f8281ab" gracePeriod=30
May 21 15:41:00.561948 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:00.561863    2552 generic.go:358] "Generic (PLEG): container finished" podID="dc65ae4e-8fc7-49c1-8f9c-7f534714dc13" containerID="ed379c96b8e03493d0de34e51728cd5c74c1d60835bfa07c86c69c5f6f8281ab" exitCode=0
May 21 15:41:00.561948 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:00.561932    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-mg869" event={"ID":"dc65ae4e-8fc7-49c1-8f9c-7f534714dc13","Type":"ContainerDied","Data":"ed379c96b8e03493d0de34e51728cd5c74c1d60835bfa07c86c69c5f6f8281ab"}
May 21 15:41:00.894672 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:00.894648    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-mg869"
May 21 15:41:00.944983 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:00.944951    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dc65ae4e-8fc7-49c1-8f9c-7f534714dc13-config-file\") pod \"dc65ae4e-8fc7-49c1-8f9c-7f534714dc13\" (UID: \"dc65ae4e-8fc7-49c1-8f9c-7f534714dc13\") "
May 21 15:41:00.945142 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:00.945042    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwqpd\" (UniqueName: \"kubernetes.io/projected/dc65ae4e-8fc7-49c1-8f9c-7f534714dc13-kube-api-access-wwqpd\") pod \"dc65ae4e-8fc7-49c1-8f9c-7f534714dc13\" (UID: \"dc65ae4e-8fc7-49c1-8f9c-7f534714dc13\") "
May 21 15:41:00.945329 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:00.945307    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc65ae4e-8fc7-49c1-8f9c-7f534714dc13-config-file" (OuterVolumeSpecName: "config-file") pod "dc65ae4e-8fc7-49c1-8f9c-7f534714dc13" (UID: "dc65ae4e-8fc7-49c1-8f9c-7f534714dc13"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:41:00.947049 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:00.947020    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc65ae4e-8fc7-49c1-8f9c-7f534714dc13-kube-api-access-wwqpd" (OuterVolumeSpecName: "kube-api-access-wwqpd") pod "dc65ae4e-8fc7-49c1-8f9c-7f534714dc13" (UID: "dc65ae4e-8fc7-49c1-8f9c-7f534714dc13"). InnerVolumeSpecName "kube-api-access-wwqpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:41:01.046319 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:01.046227    2552 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dc65ae4e-8fc7-49c1-8f9c-7f534714dc13-config-file\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:41:01.046319 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:01.046256    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwqpd\" (UniqueName: \"kubernetes.io/projected/dc65ae4e-8fc7-49c1-8f9c-7f534714dc13-kube-api-access-wwqpd\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:41:01.566917 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:01.566883    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-mg869" event={"ID":"dc65ae4e-8fc7-49c1-8f9c-7f534714dc13","Type":"ContainerDied","Data":"8a64e43fbe33453ff425e822893e60ac2f06f2951357376d96a3f5579384bedb"}
May 21 15:41:01.566917 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:01.566902    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-mg869"
May 21 15:41:01.567145 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:01.566931    2552 scope.go:117] "RemoveContainer" containerID="ed379c96b8e03493d0de34e51728cd5c74c1d60835bfa07c86c69c5f6f8281ab"
May 21 15:41:01.591292 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:01.591249    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-mg869"]
May 21 15:41:01.596062 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:01.596039    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-mg869"]
May 21 15:41:01.845812 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:01.845735    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc65ae4e-8fc7-49c1-8f9c-7f534714dc13" path="/var/lib/kubelet/pods/dc65ae4e-8fc7-49c1-8f9c-7f534714dc13/volumes"
May 21 15:41:03.193354 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:03.193318    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-txz52"]
May 21 15:41:03.193795 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:03.193698    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dae802b-0e21-48ac-acf5-f81237153c49" containerName="authorino"
May 21 15:41:03.193795 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:03.193711    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dae802b-0e21-48ac-acf5-f81237153c49" containerName="authorino"
May 21 15:41:03.193795 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:03.193720    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc65ae4e-8fc7-49c1-8f9c-7f534714dc13" containerName="limitador"
May 21 15:41:03.193795 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:03.193725    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc65ae4e-8fc7-49c1-8f9c-7f534714dc13" containerName="limitador"
May 21 15:41:03.193795 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:03.193781    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="4dae802b-0e21-48ac-acf5-f81237153c49" containerName="authorino"
May 21 15:41:03.193795 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:03.193790    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc65ae4e-8fc7-49c1-8f9c-7f534714dc13" containerName="limitador"
May 21 15:41:03.196713 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:03.196690    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-txz52"
May 21 15:41:03.199464 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:03.199426    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 21 15:41:03.199615 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:03.199590    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zldcb\""
May 21 15:41:03.212976 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:03.212897    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-txz52"]
May 21 15:41:03.265230 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:03.265190    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfxq2\" (UniqueName: \"kubernetes.io/projected/7300bd52-f735-4048-9ac2-292559ff17fa-kube-api-access-jfxq2\") pod \"postgres-68c4fbbd6f-txz52\" (UID: \"7300bd52-f735-4048-9ac2-292559ff17fa\") " pod="opendatahub/postgres-68c4fbbd6f-txz52"
May 21 15:41:03.265442 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:03.265325    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7300bd52-f735-4048-9ac2-292559ff17fa-data\") pod \"postgres-68c4fbbd6f-txz52\" (UID: \"7300bd52-f735-4048-9ac2-292559ff17fa\") " pod="opendatahub/postgres-68c4fbbd6f-txz52"
May 21 15:41:03.365821 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:03.365786    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7300bd52-f735-4048-9ac2-292559ff17fa-data\") pod \"postgres-68c4fbbd6f-txz52\" (UID: \"7300bd52-f735-4048-9ac2-292559ff17fa\") " pod="opendatahub/postgres-68c4fbbd6f-txz52"
May 21 15:41:03.366019 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:03.365869    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jfxq2\" (UniqueName: \"kubernetes.io/projected/7300bd52-f735-4048-9ac2-292559ff17fa-kube-api-access-jfxq2\") pod \"postgres-68c4fbbd6f-txz52\" (UID: \"7300bd52-f735-4048-9ac2-292559ff17fa\") " pod="opendatahub/postgres-68c4fbbd6f-txz52"
May 21 15:41:03.366305 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:03.366247    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7300bd52-f735-4048-9ac2-292559ff17fa-data\") pod \"postgres-68c4fbbd6f-txz52\" (UID: \"7300bd52-f735-4048-9ac2-292559ff17fa\") " pod="opendatahub/postgres-68c4fbbd6f-txz52"
May 21 15:41:03.374763 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:03.374738    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfxq2\" (UniqueName: \"kubernetes.io/projected/7300bd52-f735-4048-9ac2-292559ff17fa-kube-api-access-jfxq2\") pod \"postgres-68c4fbbd6f-txz52\" (UID: \"7300bd52-f735-4048-9ac2-292559ff17fa\") " pod="opendatahub/postgres-68c4fbbd6f-txz52"
May 21 15:41:03.517293 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:03.517176    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-txz52"
May 21 15:41:03.645534 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:03.645501    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-txz52"]
May 21 15:41:03.648752 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:41:03.648718    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7300bd52_f735_4048_9ac2_292559ff17fa.slice/crio-5c9c71c8ecdad56e4fbe04982e4a8d6b27e58b78488c7228a210bc2b51607f1b WatchSource:0}: Error finding container 5c9c71c8ecdad56e4fbe04982e4a8d6b27e58b78488c7228a210bc2b51607f1b: Status 404 returned error can't find the container with id 5c9c71c8ecdad56e4fbe04982e4a8d6b27e58b78488c7228a210bc2b51607f1b
May 21 15:41:04.581690 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:04.581653    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-txz52" event={"ID":"7300bd52-f735-4048-9ac2-292559ff17fa","Type":"ContainerStarted","Data":"5c9c71c8ecdad56e4fbe04982e4a8d6b27e58b78488c7228a210bc2b51607f1b"}
May 21 15:41:50.423353 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:50.423327    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 21 15:41:50.752598 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:50.752498    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-txz52" event={"ID":"7300bd52-f735-4048-9ac2-292559ff17fa","Type":"ContainerStarted","Data":"c257f7fd7dce1e08b2ef388470adb7afed049275196169e10fac223d7759cf63"}
May 21 15:41:50.752827 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:50.752680    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-txz52"
May 21 15:41:50.777105 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:50.777045    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-txz52" podStartSLOduration=1.008123661 podStartE2EDuration="47.777028478s" podCreationTimestamp="2026-05-21 15:41:03 +0000 UTC" firstStartedPulling="2026-05-21 15:41:03.649970548 +0000 UTC m=+524.370133064" lastFinishedPulling="2026-05-21 15:41:50.418875362 +0000 UTC m=+571.139037881" observedRunningTime="2026-05-21 15:41:50.774818711 +0000 UTC m=+571.494981250" watchObservedRunningTime="2026-05-21 15:41:50.777028478 +0000 UTC m=+571.497191017"
May 21 15:41:56.785902 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:56.785816    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-txz52"
May 21 15:41:57.337135 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:57.337098    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-jthxq"]
May 21 15:41:57.343703 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:57.343683    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-jthxq"
May 21 15:41:57.347199 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:57.347012    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-x86r2\""
May 21 15:41:57.347199 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:57.347050    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 15:41:57.347542 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:57.347519    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 15:41:57.348209 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:57.348189    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-jthxq"]
May 21 15:41:57.476766 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:57.476727    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dftqj\" (UniqueName: \"kubernetes.io/projected/5124e6b7-249e-4f58-8685-89c4648d7f2f-kube-api-access-dftqj\") pod \"authorino-8b475cf9f-jthxq\" (UID: \"5124e6b7-249e-4f58-8685-89c4648d7f2f\") " pod="kuadrant-system/authorino-8b475cf9f-jthxq"
May 21 15:41:57.575690 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:57.575653    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-jthxq"]
May 21 15:41:57.575939 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:41:57.575919    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-dftqj], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-jthxq" podUID="5124e6b7-249e-4f58-8685-89c4648d7f2f"
May 21 15:41:57.577917 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:57.577901    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dftqj\" (UniqueName: \"kubernetes.io/projected/5124e6b7-249e-4f58-8685-89c4648d7f2f-kube-api-access-dftqj\") pod \"authorino-8b475cf9f-jthxq\" (UID: \"5124e6b7-249e-4f58-8685-89c4648d7f2f\") " pod="kuadrant-system/authorino-8b475cf9f-jthxq"
May 21 15:41:57.588455 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:57.588393    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dftqj\" (UniqueName: \"kubernetes.io/projected/5124e6b7-249e-4f58-8685-89c4648d7f2f-kube-api-access-dftqj\") pod \"authorino-8b475cf9f-jthxq\" (UID: \"5124e6b7-249e-4f58-8685-89c4648d7f2f\") " pod="kuadrant-system/authorino-8b475cf9f-jthxq"
May 21 15:41:57.623695 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:57.623664    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8475d47b59-r84x5"]
May 21 15:41:57.627289 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:57.627247    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8475d47b59-r84x5"
May 21 15:41:57.637719 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:57.637695    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8475d47b59-r84x5"]
May 21 15:41:57.679318 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:57.679247    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pxkn\" (UniqueName: \"kubernetes.io/projected/088d868d-bbe1-4155-aed0-8e284403c6d5-kube-api-access-5pxkn\") pod \"authorino-8475d47b59-r84x5\" (UID: \"088d868d-bbe1-4155-aed0-8e284403c6d5\") " pod="kuadrant-system/authorino-8475d47b59-r84x5"
May 21 15:41:57.778899 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:57.778869    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-jthxq"
May 21 15:41:57.780158 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:57.780130    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5pxkn\" (UniqueName: \"kubernetes.io/projected/088d868d-bbe1-4155-aed0-8e284403c6d5-kube-api-access-5pxkn\") pod \"authorino-8475d47b59-r84x5\" (UID: \"088d868d-bbe1-4155-aed0-8e284403c6d5\") " pod="kuadrant-system/authorino-8475d47b59-r84x5"
May 21 15:41:57.789769 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:57.789748    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pxkn\" (UniqueName: \"kubernetes.io/projected/088d868d-bbe1-4155-aed0-8e284403c6d5-kube-api-access-5pxkn\") pod \"authorino-8475d47b59-r84x5\" (UID: \"088d868d-bbe1-4155-aed0-8e284403c6d5\") " pod="kuadrant-system/authorino-8475d47b59-r84x5"
May 21 15:41:57.796539 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:57.796521    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-jthxq"
May 21 15:41:57.880912 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:57.880834    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dftqj\" (UniqueName: \"kubernetes.io/projected/5124e6b7-249e-4f58-8685-89c4648d7f2f-kube-api-access-dftqj\") pod \"5124e6b7-249e-4f58-8685-89c4648d7f2f\" (UID: \"5124e6b7-249e-4f58-8685-89c4648d7f2f\") "
May 21 15:41:57.882789 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:57.882757    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5124e6b7-249e-4f58-8685-89c4648d7f2f-kube-api-access-dftqj" (OuterVolumeSpecName: "kube-api-access-dftqj") pod "5124e6b7-249e-4f58-8685-89c4648d7f2f" (UID: "5124e6b7-249e-4f58-8685-89c4648d7f2f"). InnerVolumeSpecName "kube-api-access-dftqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:41:57.937070 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:57.937036    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8475d47b59-r84x5"
May 21 15:41:57.982691 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:57.982460    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dftqj\" (UniqueName: \"kubernetes.io/projected/5124e6b7-249e-4f58-8685-89c4648d7f2f-kube-api-access-dftqj\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:41:58.075330 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:58.075281    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8475d47b59-r84x5"]
May 21 15:41:58.078352 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:41:58.078321    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod088d868d_bbe1_4155_aed0_8e284403c6d5.slice/crio-e6f4b5c78b9197079dd5f936222ea13ac905b9ceeb3c7818118b7dff56ef573b WatchSource:0}: Error finding container e6f4b5c78b9197079dd5f936222ea13ac905b9ceeb3c7818118b7dff56ef573b: Status 404 returned error can't find the container with id e6f4b5c78b9197079dd5f936222ea13ac905b9ceeb3c7818118b7dff56ef573b
May 21 15:41:58.469203 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:58.469178    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8475d47b59-r84x5"]
May 21 15:41:58.516409 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:58.516372    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-78d57bbb75-29jnd"]
May 21 15:41:58.520015 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:58.519991    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78d57bbb75-29jnd"
May 21 15:41:58.522807 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:58.522785    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 21 15:41:58.536756 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:58.536733    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78d57bbb75-29jnd"]
May 21 15:41:58.588003 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:58.587964    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-262kw\" (UniqueName: \"kubernetes.io/projected/ee1717ea-f2a6-4929-93f0-413c2108e9af-kube-api-access-262kw\") pod \"authorino-78d57bbb75-29jnd\" (UID: \"ee1717ea-f2a6-4929-93f0-413c2108e9af\") " pod="kuadrant-system/authorino-78d57bbb75-29jnd"
May 21 15:41:58.588171 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:58.588118    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ee1717ea-f2a6-4929-93f0-413c2108e9af-tls-cert\") pod \"authorino-78d57bbb75-29jnd\" (UID: \"ee1717ea-f2a6-4929-93f0-413c2108e9af\") " pod="kuadrant-system/authorino-78d57bbb75-29jnd"
May 21 15:41:58.688976 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:58.688937    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-262kw\" (UniqueName: \"kubernetes.io/projected/ee1717ea-f2a6-4929-93f0-413c2108e9af-kube-api-access-262kw\") pod \"authorino-78d57bbb75-29jnd\" (UID: \"ee1717ea-f2a6-4929-93f0-413c2108e9af\") " pod="kuadrant-system/authorino-78d57bbb75-29jnd"
May 21 15:41:58.689186 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:58.689035    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ee1717ea-f2a6-4929-93f0-413c2108e9af-tls-cert\") pod \"authorino-78d57bbb75-29jnd\" (UID: \"ee1717ea-f2a6-4929-93f0-413c2108e9af\") " pod="kuadrant-system/authorino-78d57bbb75-29jnd"
May 21 15:41:58.691491 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:58.691465    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ee1717ea-f2a6-4929-93f0-413c2108e9af-tls-cert\") pod \"authorino-78d57bbb75-29jnd\" (UID: \"ee1717ea-f2a6-4929-93f0-413c2108e9af\") " pod="kuadrant-system/authorino-78d57bbb75-29jnd"
May 21 15:41:58.703306 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:58.703238    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-262kw\" (UniqueName: \"kubernetes.io/projected/ee1717ea-f2a6-4929-93f0-413c2108e9af-kube-api-access-262kw\") pod \"authorino-78d57bbb75-29jnd\" (UID: \"ee1717ea-f2a6-4929-93f0-413c2108e9af\") " pod="kuadrant-system/authorino-78d57bbb75-29jnd"
May 21 15:41:58.783204 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:58.783175    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-jthxq"
May 21 15:41:58.783204 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:58.783186    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8475d47b59-r84x5" event={"ID":"088d868d-bbe1-4155-aed0-8e284403c6d5","Type":"ContainerStarted","Data":"4fd89960c062beaa926beb4524dd950c5102a1008ddb17eae27ff9e7facc1d78"}
May 21 15:41:58.783462 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:58.783226    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8475d47b59-r84x5" event={"ID":"088d868d-bbe1-4155-aed0-8e284403c6d5","Type":"ContainerStarted","Data":"e6f4b5c78b9197079dd5f936222ea13ac905b9ceeb3c7818118b7dff56ef573b"}
May 21 15:41:58.783462 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:58.783228    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8475d47b59-r84x5" podUID="088d868d-bbe1-4155-aed0-8e284403c6d5" containerName="authorino" containerID="cri-o://4fd89960c062beaa926beb4524dd950c5102a1008ddb17eae27ff9e7facc1d78" gracePeriod=30
May 21 15:41:58.804161 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:58.804120    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8475d47b59-r84x5" podStartSLOduration=1.438978065 podStartE2EDuration="1.804106699s" podCreationTimestamp="2026-05-21 15:41:57 +0000 UTC" firstStartedPulling="2026-05-21 15:41:58.079512685 +0000 UTC m=+578.799675204" lastFinishedPulling="2026-05-21 15:41:58.444641321 +0000 UTC m=+579.164803838" observedRunningTime="2026-05-21 15:41:58.803554974 +0000 UTC m=+579.523717512" watchObservedRunningTime="2026-05-21 15:41:58.804106699 +0000 UTC m=+579.524269236"
May 21 15:41:58.829750 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:58.829725    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78d57bbb75-29jnd"
May 21 15:41:58.849391 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:58.849365    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-jthxq"]
May 21 15:41:58.859849 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:58.855047    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-jthxq"]
May 21 15:41:58.969232 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:58.969205    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78d57bbb75-29jnd"]
May 21 15:41:58.971791 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:41:58.971763    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee1717ea_f2a6_4929_93f0_413c2108e9af.slice/crio-a3d67cc8191854cbbe0dfb3875cfe3a04752a23bba547c3a6338f790e5bc5368 WatchSource:0}: Error finding container a3d67cc8191854cbbe0dfb3875cfe3a04752a23bba547c3a6338f790e5bc5368: Status 404 returned error can't find the container with id a3d67cc8191854cbbe0dfb3875cfe3a04752a23bba547c3a6338f790e5bc5368
May 21 15:41:59.019736 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:59.019713    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8475d47b59-r84x5"
May 21 15:41:59.091830 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:59.091791    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pxkn\" (UniqueName: \"kubernetes.io/projected/088d868d-bbe1-4155-aed0-8e284403c6d5-kube-api-access-5pxkn\") pod \"088d868d-bbe1-4155-aed0-8e284403c6d5\" (UID: \"088d868d-bbe1-4155-aed0-8e284403c6d5\") "
May 21 15:41:59.093807 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:59.093785    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/088d868d-bbe1-4155-aed0-8e284403c6d5-kube-api-access-5pxkn" (OuterVolumeSpecName: "kube-api-access-5pxkn") pod "088d868d-bbe1-4155-aed0-8e284403c6d5" (UID: "088d868d-bbe1-4155-aed0-8e284403c6d5"). InnerVolumeSpecName "kube-api-access-5pxkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:41:59.192708 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:59.192669    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pxkn\" (UniqueName: \"kubernetes.io/projected/088d868d-bbe1-4155-aed0-8e284403c6d5-kube-api-access-5pxkn\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:41:59.788404 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:59.788348    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78d57bbb75-29jnd" event={"ID":"ee1717ea-f2a6-4929-93f0-413c2108e9af","Type":"ContainerStarted","Data":"a15329df10235b5769fb224e702b462dfdb00e5691d9c7842f6cf7eb1b9da9d9"}
May 21 15:41:59.788404 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:59.788401    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78d57bbb75-29jnd" event={"ID":"ee1717ea-f2a6-4929-93f0-413c2108e9af","Type":"ContainerStarted","Data":"a3d67cc8191854cbbe0dfb3875cfe3a04752a23bba547c3a6338f790e5bc5368"}
May 21 15:41:59.789413 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:59.789386    2552 generic.go:358] "Generic (PLEG): container finished" podID="088d868d-bbe1-4155-aed0-8e284403c6d5" containerID="4fd89960c062beaa926beb4524dd950c5102a1008ddb17eae27ff9e7facc1d78" exitCode=0
May 21 15:41:59.789544 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:59.789421    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8475d47b59-r84x5"
May 21 15:41:59.789544 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:59.789467    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8475d47b59-r84x5" event={"ID":"088d868d-bbe1-4155-aed0-8e284403c6d5","Type":"ContainerDied","Data":"4fd89960c062beaa926beb4524dd950c5102a1008ddb17eae27ff9e7facc1d78"}
May 21 15:41:59.789544 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:59.789506    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8475d47b59-r84x5" event={"ID":"088d868d-bbe1-4155-aed0-8e284403c6d5","Type":"ContainerDied","Data":"e6f4b5c78b9197079dd5f936222ea13ac905b9ceeb3c7818118b7dff56ef573b"}
May 21 15:41:59.789544 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:59.789527    2552 scope.go:117] "RemoveContainer" containerID="4fd89960c062beaa926beb4524dd950c5102a1008ddb17eae27ff9e7facc1d78"
May 21 15:41:59.798067 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:59.798052    2552 scope.go:117] "RemoveContainer" containerID="4fd89960c062beaa926beb4524dd950c5102a1008ddb17eae27ff9e7facc1d78"
May 21 15:41:59.798314 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:41:59.798294    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fd89960c062beaa926beb4524dd950c5102a1008ddb17eae27ff9e7facc1d78\": container with ID starting with 4fd89960c062beaa926beb4524dd950c5102a1008ddb17eae27ff9e7facc1d78 not found: ID does not exist" containerID="4fd89960c062beaa926beb4524dd950c5102a1008ddb17eae27ff9e7facc1d78"
May 21 15:41:59.798425 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:59.798319    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fd89960c062beaa926beb4524dd950c5102a1008ddb17eae27ff9e7facc1d78"} err="failed to get container status \"4fd89960c062beaa926beb4524dd950c5102a1008ddb17eae27ff9e7facc1d78\": rpc error: code = NotFound desc = could not find container \"4fd89960c062beaa926beb4524dd950c5102a1008ddb17eae27ff9e7facc1d78\": container with ID starting with 4fd89960c062beaa926beb4524dd950c5102a1008ddb17eae27ff9e7facc1d78 not found: ID does not exist"
May 21 15:41:59.804810 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:59.804775    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-78d57bbb75-29jnd" podStartSLOduration=1.474133595 podStartE2EDuration="1.804763404s" podCreationTimestamp="2026-05-21 15:41:58 +0000 UTC" firstStartedPulling="2026-05-21 15:41:58.973209789 +0000 UTC m=+579.693372305" lastFinishedPulling="2026-05-21 15:41:59.303839598 +0000 UTC m=+580.024002114" observedRunningTime="2026-05-21 15:41:59.80322541 +0000 UTC m=+580.523387949" watchObservedRunningTime="2026-05-21 15:41:59.804763404 +0000 UTC m=+580.524925984"
May 21 15:41:59.823952 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:59.823922    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8475d47b59-r84x5"]
May 21 15:41:59.827868 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:59.827839    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8475d47b59-r84x5"]
May 21 15:41:59.846907 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:59.846833    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="088d868d-bbe1-4155-aed0-8e284403c6d5" path="/var/lib/kubelet/pods/088d868d-bbe1-4155-aed0-8e284403c6d5/volumes"
May 21 15:41:59.847253 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:41:59.847235    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5124e6b7-249e-4f58-8685-89c4648d7f2f" path="/var/lib/kubelet/pods/5124e6b7-249e-4f58-8685-89c4648d7f2f/volumes"
May 21 15:42:02.862573 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:02.862539    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-654b944745-d2fbk"]
May 21 15:42:02.862949 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:02.862921    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="088d868d-bbe1-4155-aed0-8e284403c6d5" containerName="authorino"
May 21 15:42:02.862949 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:02.862935    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="088d868d-bbe1-4155-aed0-8e284403c6d5" containerName="authorino"
May 21 15:42:02.863038 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:02.862991    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="088d868d-bbe1-4155-aed0-8e284403c6d5" containerName="authorino"
May 21 15:42:03.002494 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.002464    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-654b944745-d2fbk"]
May 21 15:42:03.002494 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.002497    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55bbdf5647-q6njj"]
May 21 15:42:03.002754 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.002683    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-654b944745-d2fbk"
May 21 15:42:03.006748 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.006730    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lk5sf\""
May 21 15:42:03.007283 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.007240    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 21 15:42:03.013846 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.013821    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55bbdf5647-q6njj"]
May 21 15:42:03.013958 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.013941    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55bbdf5647-q6njj"
May 21 15:42:03.118793 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.118705    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55bbdf5647-q6njj"]
May 21 15:42:03.119015 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:42:03.118993    2552 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-d6m7t], unattached volumes=[], failed to process volumes=[]: context canceled" pod="opendatahub/maas-controller-55bbdf5647-q6njj" podUID="f37bf035-4bb1-47a3-a8da-0f689ccff3a5"
May 21 15:42:03.128333 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.128296    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6bz4\" (UniqueName: \"kubernetes.io/projected/c6fb695d-ed8b-41c8-a3f1-50bb06ad19b7-kube-api-access-s6bz4\") pod \"maas-controller-654b944745-d2fbk\" (UID: \"c6fb695d-ed8b-41c8-a3f1-50bb06ad19b7\") " pod="opendatahub/maas-controller-654b944745-d2fbk"
May 21 15:42:03.128474 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.128345    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6m7t\" (UniqueName: \"kubernetes.io/projected/f37bf035-4bb1-47a3-a8da-0f689ccff3a5-kube-api-access-d6m7t\") pod \"maas-controller-55bbdf5647-q6njj\" (UID: \"f37bf035-4bb1-47a3-a8da-0f689ccff3a5\") " pod="opendatahub/maas-controller-55bbdf5647-q6njj"
May 21 15:42:03.162464 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.162434    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7487c659f8-kw9kk"]
May 21 15:42:03.172700 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.172672    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7487c659f8-kw9kk"
May 21 15:42:03.188453 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.188423    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7487c659f8-kw9kk"]
May 21 15:42:03.229253 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.229217    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s6bz4\" (UniqueName: \"kubernetes.io/projected/c6fb695d-ed8b-41c8-a3f1-50bb06ad19b7-kube-api-access-s6bz4\") pod \"maas-controller-654b944745-d2fbk\" (UID: \"c6fb695d-ed8b-41c8-a3f1-50bb06ad19b7\") " pod="opendatahub/maas-controller-654b944745-d2fbk"
May 21 15:42:03.229253 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.229272    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d6m7t\" (UniqueName: \"kubernetes.io/projected/f37bf035-4bb1-47a3-a8da-0f689ccff3a5-kube-api-access-d6m7t\") pod \"maas-controller-55bbdf5647-q6njj\" (UID: \"f37bf035-4bb1-47a3-a8da-0f689ccff3a5\") " pod="opendatahub/maas-controller-55bbdf5647-q6njj"
May 21 15:42:03.245020 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.244993    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6m7t\" (UniqueName: \"kubernetes.io/projected/f37bf035-4bb1-47a3-a8da-0f689ccff3a5-kube-api-access-d6m7t\") pod \"maas-controller-55bbdf5647-q6njj\" (UID: \"f37bf035-4bb1-47a3-a8da-0f689ccff3a5\") " pod="opendatahub/maas-controller-55bbdf5647-q6njj"
May 21 15:42:03.245170 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.245106    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6bz4\" (UniqueName: \"kubernetes.io/projected/c6fb695d-ed8b-41c8-a3f1-50bb06ad19b7-kube-api-access-s6bz4\") pod \"maas-controller-654b944745-d2fbk\" (UID: \"c6fb695d-ed8b-41c8-a3f1-50bb06ad19b7\") " pod="opendatahub/maas-controller-654b944745-d2fbk"
May 21 15:42:03.314714 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.314677    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-654b944745-d2fbk"
May 21 15:42:03.330847 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.330810    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skqb9\" (UniqueName: \"kubernetes.io/projected/d9c13943-cbea-4031-b9e5-751a761cddba-kube-api-access-skqb9\") pod \"maas-controller-7487c659f8-kw9kk\" (UID: \"d9c13943-cbea-4031-b9e5-751a761cddba\") " pod="opendatahub/maas-controller-7487c659f8-kw9kk"
May 21 15:42:03.432303 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.432273    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-skqb9\" (UniqueName: \"kubernetes.io/projected/d9c13943-cbea-4031-b9e5-751a761cddba-kube-api-access-skqb9\") pod \"maas-controller-7487c659f8-kw9kk\" (UID: \"d9c13943-cbea-4031-b9e5-751a761cddba\") " pod="opendatahub/maas-controller-7487c659f8-kw9kk"
May 21 15:42:03.441837 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.441812    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skqb9\" (UniqueName: \"kubernetes.io/projected/d9c13943-cbea-4031-b9e5-751a761cddba-kube-api-access-skqb9\") pod \"maas-controller-7487c659f8-kw9kk\" (UID: \"d9c13943-cbea-4031-b9e5-751a761cddba\") " pod="opendatahub/maas-controller-7487c659f8-kw9kk"
May 21 15:42:03.449896 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.449870    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-654b944745-d2fbk"]
May 21 15:42:03.453400 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:42:03.453371    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6fb695d_ed8b_41c8_a3f1_50bb06ad19b7.slice/crio-4891c900298d02a9b06497f0cd2f33a46e951ba7b32053f3d3d30610c13b5984 WatchSource:0}: Error finding container 4891c900298d02a9b06497f0cd2f33a46e951ba7b32053f3d3d30610c13b5984: Status 404 returned error can't find the container with id 4891c900298d02a9b06497f0cd2f33a46e951ba7b32053f3d3d30610c13b5984
May 21 15:42:03.482493 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.482466    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7487c659f8-kw9kk"
May 21 15:42:03.611645 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.611622    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7487c659f8-kw9kk"]
May 21 15:42:03.614033 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:42:03.614002    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9c13943_cbea_4031_b9e5_751a761cddba.slice/crio-a63f70d8ca3e0200e8ba96fcc6615d2756fe7b84988f121fd60de20b7eb34d5c WatchSource:0}: Error finding container a63f70d8ca3e0200e8ba96fcc6615d2756fe7b84988f121fd60de20b7eb34d5c: Status 404 returned error can't find the container with id a63f70d8ca3e0200e8ba96fcc6615d2756fe7b84988f121fd60de20b7eb34d5c
May 21 15:42:03.805848 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.805806    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-654b944745-d2fbk" event={"ID":"c6fb695d-ed8b-41c8-a3f1-50bb06ad19b7","Type":"ContainerStarted","Data":"4891c900298d02a9b06497f0cd2f33a46e951ba7b32053f3d3d30610c13b5984"}
May 21 15:42:03.806888 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.806866    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7487c659f8-kw9kk" event={"ID":"d9c13943-cbea-4031-b9e5-751a761cddba","Type":"ContainerStarted","Data":"a63f70d8ca3e0200e8ba96fcc6615d2756fe7b84988f121fd60de20b7eb34d5c"}
May 21 15:42:03.806888 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.806882    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55bbdf5647-q6njj"
May 21 15:42:03.812007 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.811989    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55bbdf5647-q6njj"
May 21 15:42:03.936896 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.936862    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6m7t\" (UniqueName: \"kubernetes.io/projected/f37bf035-4bb1-47a3-a8da-0f689ccff3a5-kube-api-access-d6m7t\") pod \"f37bf035-4bb1-47a3-a8da-0f689ccff3a5\" (UID: \"f37bf035-4bb1-47a3-a8da-0f689ccff3a5\") "
May 21 15:42:03.938977 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:03.938941    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f37bf035-4bb1-47a3-a8da-0f689ccff3a5-kube-api-access-d6m7t" (OuterVolumeSpecName: "kube-api-access-d6m7t") pod "f37bf035-4bb1-47a3-a8da-0f689ccff3a5" (UID: "f37bf035-4bb1-47a3-a8da-0f689ccff3a5"). InnerVolumeSpecName "kube-api-access-d6m7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:42:04.038503 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:04.038421    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6m7t\" (UniqueName: \"kubernetes.io/projected/f37bf035-4bb1-47a3-a8da-0f689ccff3a5-kube-api-access-d6m7t\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:42:04.811772 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:04.811718    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55bbdf5647-q6njj"
May 21 15:42:04.845618 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:04.845565    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55bbdf5647-q6njj"]
May 21 15:42:04.848657 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:04.848624    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55bbdf5647-q6njj"]
May 21 15:42:05.847280 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:05.847231    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f37bf035-4bb1-47a3-a8da-0f689ccff3a5" path="/var/lib/kubelet/pods/f37bf035-4bb1-47a3-a8da-0f689ccff3a5/volumes"
May 21 15:42:06.822729 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:06.822627    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-654b944745-d2fbk" event={"ID":"c6fb695d-ed8b-41c8-a3f1-50bb06ad19b7","Type":"ContainerStarted","Data":"b3ecd08b83a1f79826955bec52b35c370dad2ef7115d41966ed41bec1326baf4"}
May 21 15:42:06.822898 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:06.822807    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-654b944745-d2fbk"
May 21 15:42:06.824456 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:06.824428    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7487c659f8-kw9kk" event={"ID":"d9c13943-cbea-4031-b9e5-751a761cddba","Type":"ContainerStarted","Data":"ac721009993b0e2165900697d3284588d41aeb3abc006e0cf846254936509399"}
May 21 15:42:06.824603 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:06.824571    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7487c659f8-kw9kk"
May 21 15:42:06.842085 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:06.842037    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-654b944745-d2fbk" podStartSLOduration=1.792490439 podStartE2EDuration="4.842026132s" podCreationTimestamp="2026-05-21 15:42:02 +0000 UTC" firstStartedPulling="2026-05-21 15:42:03.454744203 +0000 UTC m=+584.174906723" lastFinishedPulling="2026-05-21 15:42:06.504279897 +0000 UTC m=+587.224442416" observedRunningTime="2026-05-21 15:42:06.840938598 +0000 UTC m=+587.561101163" watchObservedRunningTime="2026-05-21 15:42:06.842026132 +0000 UTC m=+587.562188669"
May 21 15:42:06.863120 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:06.863071    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7487c659f8-kw9kk" podStartSLOduration=0.973150576 podStartE2EDuration="3.863058278s" podCreationTimestamp="2026-05-21 15:42:03 +0000 UTC" firstStartedPulling="2026-05-21 15:42:03.615465621 +0000 UTC m=+584.335628151" lastFinishedPulling="2026-05-21 15:42:06.505373337 +0000 UTC m=+587.225535853" observedRunningTime="2026-05-21 15:42:06.861532092 +0000 UTC m=+587.581694631" watchObservedRunningTime="2026-05-21 15:42:06.863058278 +0000 UTC m=+587.583220815"
May 21 15:42:17.833417 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:17.833383    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-654b944745-d2fbk"
May 21 15:42:17.833905 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:17.833529    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7487c659f8-kw9kk"
May 21 15:42:17.891292 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:17.891249    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-654b944745-d2fbk"]
May 21 15:42:17.891517 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:17.891495    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-654b944745-d2fbk" podUID="c6fb695d-ed8b-41c8-a3f1-50bb06ad19b7" containerName="manager" containerID="cri-o://b3ecd08b83a1f79826955bec52b35c370dad2ef7115d41966ed41bec1326baf4" gracePeriod=30
May 21 15:42:18.063506 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:18.063465    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-78bbf8f7d6-ck7cf"]
May 21 15:42:18.066303 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:18.066281    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78bbf8f7d6-ck7cf"
May 21 15:42:18.070667 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:18.070642    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfkkf\" (UniqueName: \"kubernetes.io/projected/261b0cc0-5c7d-48f7-a75b-b2c0c6914d3e-kube-api-access-vfkkf\") pod \"maas-controller-78bbf8f7d6-ck7cf\" (UID: \"261b0cc0-5c7d-48f7-a75b-b2c0c6914d3e\") " pod="opendatahub/maas-controller-78bbf8f7d6-ck7cf"
May 21 15:42:18.075643 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:18.075596    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78bbf8f7d6-ck7cf"]
May 21 15:42:18.132848 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:18.132824    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-654b944745-d2fbk"
May 21 15:42:18.171493 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:18.171463    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6bz4\" (UniqueName: \"kubernetes.io/projected/c6fb695d-ed8b-41c8-a3f1-50bb06ad19b7-kube-api-access-s6bz4\") pod \"c6fb695d-ed8b-41c8-a3f1-50bb06ad19b7\" (UID: \"c6fb695d-ed8b-41c8-a3f1-50bb06ad19b7\") "
May 21 15:42:18.171650 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:18.171634    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfkkf\" (UniqueName: \"kubernetes.io/projected/261b0cc0-5c7d-48f7-a75b-b2c0c6914d3e-kube-api-access-vfkkf\") pod \"maas-controller-78bbf8f7d6-ck7cf\" (UID: \"261b0cc0-5c7d-48f7-a75b-b2c0c6914d3e\") " pod="opendatahub/maas-controller-78bbf8f7d6-ck7cf"
May 21 15:42:18.173626 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:18.173602    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6fb695d-ed8b-41c8-a3f1-50bb06ad19b7-kube-api-access-s6bz4" (OuterVolumeSpecName: "kube-api-access-s6bz4") pod "c6fb695d-ed8b-41c8-a3f1-50bb06ad19b7" (UID: "c6fb695d-ed8b-41c8-a3f1-50bb06ad19b7"). InnerVolumeSpecName "kube-api-access-s6bz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:42:18.179919 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:18.179895    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfkkf\" (UniqueName: \"kubernetes.io/projected/261b0cc0-5c7d-48f7-a75b-b2c0c6914d3e-kube-api-access-vfkkf\") pod \"maas-controller-78bbf8f7d6-ck7cf\" (UID: \"261b0cc0-5c7d-48f7-a75b-b2c0c6914d3e\") " pod="opendatahub/maas-controller-78bbf8f7d6-ck7cf"
May 21 15:42:18.272862 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:18.272821    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6bz4\" (UniqueName: \"kubernetes.io/projected/c6fb695d-ed8b-41c8-a3f1-50bb06ad19b7-kube-api-access-s6bz4\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:42:18.381580 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:18.381482    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78bbf8f7d6-ck7cf"
May 21 15:42:18.512444 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:18.512198    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78bbf8f7d6-ck7cf"]
May 21 15:42:18.514874 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:42:18.514844    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod261b0cc0_5c7d_48f7_a75b_b2c0c6914d3e.slice/crio-2e28b8ff6e178128114c5d7d1a6a2c882fe0ce6a4e113abb816aa3d9dff6cba3 WatchSource:0}: Error finding container 2e28b8ff6e178128114c5d7d1a6a2c882fe0ce6a4e113abb816aa3d9dff6cba3: Status 404 returned error can't find the container with id 2e28b8ff6e178128114c5d7d1a6a2c882fe0ce6a4e113abb816aa3d9dff6cba3
May 21 15:42:18.864810 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:18.864769    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78bbf8f7d6-ck7cf" event={"ID":"261b0cc0-5c7d-48f7-a75b-b2c0c6914d3e","Type":"ContainerStarted","Data":"2e28b8ff6e178128114c5d7d1a6a2c882fe0ce6a4e113abb816aa3d9dff6cba3"}
May 21 15:42:18.865883 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:18.865861    2552 generic.go:358] "Generic (PLEG): container finished" podID="c6fb695d-ed8b-41c8-a3f1-50bb06ad19b7" containerID="b3ecd08b83a1f79826955bec52b35c370dad2ef7115d41966ed41bec1326baf4" exitCode=0
May 21 15:42:18.865972 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:18.865891    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-654b944745-d2fbk" event={"ID":"c6fb695d-ed8b-41c8-a3f1-50bb06ad19b7","Type":"ContainerDied","Data":"b3ecd08b83a1f79826955bec52b35c370dad2ef7115d41966ed41bec1326baf4"}
May 21 15:42:18.865972 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:18.865912    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-654b944745-d2fbk" event={"ID":"c6fb695d-ed8b-41c8-a3f1-50bb06ad19b7","Type":"ContainerDied","Data":"4891c900298d02a9b06497f0cd2f33a46e951ba7b32053f3d3d30610c13b5984"}
May 21 15:42:18.865972 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:18.865921    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-654b944745-d2fbk"
May 21 15:42:18.865972 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:18.865928    2552 scope.go:117] "RemoveContainer" containerID="b3ecd08b83a1f79826955bec52b35c370dad2ef7115d41966ed41bec1326baf4"
May 21 15:42:18.874216 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:18.874199    2552 scope.go:117] "RemoveContainer" containerID="b3ecd08b83a1f79826955bec52b35c370dad2ef7115d41966ed41bec1326baf4"
May 21 15:42:18.874490 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:42:18.874473    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3ecd08b83a1f79826955bec52b35c370dad2ef7115d41966ed41bec1326baf4\": container with ID starting with b3ecd08b83a1f79826955bec52b35c370dad2ef7115d41966ed41bec1326baf4 not found: ID does not exist" containerID="b3ecd08b83a1f79826955bec52b35c370dad2ef7115d41966ed41bec1326baf4"
May 21 15:42:18.874541 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:18.874498    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3ecd08b83a1f79826955bec52b35c370dad2ef7115d41966ed41bec1326baf4"} err="failed to get container status \"b3ecd08b83a1f79826955bec52b35c370dad2ef7115d41966ed41bec1326baf4\": rpc error: code = NotFound desc = could not find container \"b3ecd08b83a1f79826955bec52b35c370dad2ef7115d41966ed41bec1326baf4\": container with ID starting with b3ecd08b83a1f79826955bec52b35c370dad2ef7115d41966ed41bec1326baf4 not found: ID does not exist"
May 21 15:42:18.887173 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:18.887148    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-654b944745-d2fbk"]
May 21 15:42:18.893479 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:18.893456    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-654b944745-d2fbk"]
May 21 15:42:19.846828 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:19.846785    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6fb695d-ed8b-41c8-a3f1-50bb06ad19b7" path="/var/lib/kubelet/pods/c6fb695d-ed8b-41c8-a3f1-50bb06ad19b7/volumes"
May 21 15:42:19.870723 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:19.870691    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78bbf8f7d6-ck7cf" event={"ID":"261b0cc0-5c7d-48f7-a75b-b2c0c6914d3e","Type":"ContainerStarted","Data":"b7191994f578957a8bdf16ca6810de5e4ba8a16935c68e5578cb8ceaffa53555"}
May 21 15:42:19.871098 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:19.870770    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-78bbf8f7d6-ck7cf"
May 21 15:42:19.889088 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:19.889034    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-78bbf8f7d6-ck7cf" podStartSLOduration=1.3482052869999999 podStartE2EDuration="1.889017404s" podCreationTimestamp="2026-05-21 15:42:18 +0000 UTC" firstStartedPulling="2026-05-21 15:42:18.516154239 +0000 UTC m=+599.236316755" lastFinishedPulling="2026-05-21 15:42:19.056966356 +0000 UTC m=+599.777128872" observedRunningTime="2026-05-21 15:42:19.887814034 +0000 UTC m=+600.607976572" watchObservedRunningTime="2026-05-21 15:42:19.889017404 +0000 UTC m=+600.609179942"
May 21 15:42:30.880390 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:30.880347    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-78bbf8f7d6-ck7cf"
May 21 15:42:30.921315 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:30.921279    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7487c659f8-kw9kk"]
May 21 15:42:30.921544 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:30.921508    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7487c659f8-kw9kk" podUID="d9c13943-cbea-4031-b9e5-751a761cddba" containerName="manager" containerID="cri-o://ac721009993b0e2165900697d3284588d41aeb3abc006e0cf846254936509399" gracePeriod=30
May 21 15:42:31.165714 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:31.165690    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7487c659f8-kw9kk"
May 21 15:42:31.290615 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:31.290574    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skqb9\" (UniqueName: \"kubernetes.io/projected/d9c13943-cbea-4031-b9e5-751a761cddba-kube-api-access-skqb9\") pod \"d9c13943-cbea-4031-b9e5-751a761cddba\" (UID: \"d9c13943-cbea-4031-b9e5-751a761cddba\") "
May 21 15:42:31.292970 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:31.292936    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9c13943-cbea-4031-b9e5-751a761cddba-kube-api-access-skqb9" (OuterVolumeSpecName: "kube-api-access-skqb9") pod "d9c13943-cbea-4031-b9e5-751a761cddba" (UID: "d9c13943-cbea-4031-b9e5-751a761cddba"). InnerVolumeSpecName "kube-api-access-skqb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:42:31.391509 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:31.391475    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skqb9\" (UniqueName: \"kubernetes.io/projected/d9c13943-cbea-4031-b9e5-751a761cddba-kube-api-access-skqb9\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:42:31.914492 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:31.914458    2552 generic.go:358] "Generic (PLEG): container finished" podID="d9c13943-cbea-4031-b9e5-751a761cddba" containerID="ac721009993b0e2165900697d3284588d41aeb3abc006e0cf846254936509399" exitCode=0
May 21 15:42:31.914894 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:31.914524    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7487c659f8-kw9kk"
May 21 15:42:31.914894 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:31.914537    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7487c659f8-kw9kk" event={"ID":"d9c13943-cbea-4031-b9e5-751a761cddba","Type":"ContainerDied","Data":"ac721009993b0e2165900697d3284588d41aeb3abc006e0cf846254936509399"}
May 21 15:42:31.914894 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:31.914575    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7487c659f8-kw9kk" event={"ID":"d9c13943-cbea-4031-b9e5-751a761cddba","Type":"ContainerDied","Data":"a63f70d8ca3e0200e8ba96fcc6615d2756fe7b84988f121fd60de20b7eb34d5c"}
May 21 15:42:31.914894 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:31.914591    2552 scope.go:117] "RemoveContainer" containerID="ac721009993b0e2165900697d3284588d41aeb3abc006e0cf846254936509399"
May 21 15:42:31.922888 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:31.922702    2552 scope.go:117] "RemoveContainer" containerID="ac721009993b0e2165900697d3284588d41aeb3abc006e0cf846254936509399"
May 21 15:42:31.922972 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:42:31.922954    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac721009993b0e2165900697d3284588d41aeb3abc006e0cf846254936509399\": container with ID starting with ac721009993b0e2165900697d3284588d41aeb3abc006e0cf846254936509399 not found: ID does not exist" containerID="ac721009993b0e2165900697d3284588d41aeb3abc006e0cf846254936509399"
May 21 15:42:31.923011 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:31.922980    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac721009993b0e2165900697d3284588d41aeb3abc006e0cf846254936509399"} err="failed to get container status \"ac721009993b0e2165900697d3284588d41aeb3abc006e0cf846254936509399\": rpc error: code = NotFound desc = could not find container \"ac721009993b0e2165900697d3284588d41aeb3abc006e0cf846254936509399\": container with ID starting with ac721009993b0e2165900697d3284588d41aeb3abc006e0cf846254936509399 not found: ID does not exist"
May 21 15:42:31.932183 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:31.932161    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7487c659f8-kw9kk"]
May 21 15:42:31.937819 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:31.937797    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7487c659f8-kw9kk"]
May 21 15:42:33.846477 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:33.846446    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9c13943-cbea-4031-b9e5-751a761cddba" path="/var/lib/kubelet/pods/d9c13943-cbea-4031-b9e5-751a761cddba/volumes"
May 21 15:42:51.089273 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:51.089224    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6f8c5878d5-rlkvg"]
May 21 15:42:51.089710 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:51.089601    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9c13943-cbea-4031-b9e5-751a761cddba" containerName="manager"
May 21 15:42:51.089710 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:51.089613    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9c13943-cbea-4031-b9e5-751a761cddba" containerName="manager"
May 21 15:42:51.089710 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:51.089638    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6fb695d-ed8b-41c8-a3f1-50bb06ad19b7" containerName="manager"
May 21 15:42:51.089710 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:51.089643    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6fb695d-ed8b-41c8-a3f1-50bb06ad19b7" containerName="manager"
May 21 15:42:51.089710 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:51.089697    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="d9c13943-cbea-4031-b9e5-751a761cddba" containerName="manager"
May 21 15:42:51.089710 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:51.089706    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="c6fb695d-ed8b-41c8-a3f1-50bb06ad19b7" containerName="manager"
May 21 15:42:51.093787 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:51.093769    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6f8c5878d5-rlkvg"
May 21 15:42:51.096854 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:51.096833    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 21 15:42:51.096988 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:51.096840    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-dkkqx\""
May 21 15:42:51.104931 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:51.104906    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6f8c5878d5-rlkvg"]
May 21 15:42:51.181134 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:51.181103    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e8a3d65-a9fb-4606-953a-26832b378e58-maas-api-tls\") pod \"maas-api-6f8c5878d5-rlkvg\" (UID: \"8e8a3d65-a9fb-4606-953a-26832b378e58\") " pod="opendatahub/maas-api-6f8c5878d5-rlkvg"
May 21 15:42:51.181328 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:51.181153    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk9pc\" (UniqueName: \"kubernetes.io/projected/8e8a3d65-a9fb-4606-953a-26832b378e58-kube-api-access-wk9pc\") pod \"maas-api-6f8c5878d5-rlkvg\" (UID: \"8e8a3d65-a9fb-4606-953a-26832b378e58\") " pod="opendatahub/maas-api-6f8c5878d5-rlkvg"
May 21 15:42:51.281635 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:51.281603    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e8a3d65-a9fb-4606-953a-26832b378e58-maas-api-tls\") pod \"maas-api-6f8c5878d5-rlkvg\" (UID: \"8e8a3d65-a9fb-4606-953a-26832b378e58\") " pod="opendatahub/maas-api-6f8c5878d5-rlkvg"
May 21 15:42:51.281823 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:51.281662    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wk9pc\" (UniqueName: \"kubernetes.io/projected/8e8a3d65-a9fb-4606-953a-26832b378e58-kube-api-access-wk9pc\") pod \"maas-api-6f8c5878d5-rlkvg\" (UID: \"8e8a3d65-a9fb-4606-953a-26832b378e58\") " pod="opendatahub/maas-api-6f8c5878d5-rlkvg"
May 21 15:42:51.281823 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:42:51.281761    2552 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
May 21 15:42:51.281941 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:42:51.281852    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e8a3d65-a9fb-4606-953a-26832b378e58-maas-api-tls podName:8e8a3d65-a9fb-4606-953a-26832b378e58 nodeName:}" failed. No retries permitted until 2026-05-21 15:42:51.781829691 +0000 UTC m=+632.501992218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8e8a3d65-a9fb-4606-953a-26832b378e58-maas-api-tls") pod "maas-api-6f8c5878d5-rlkvg" (UID: "8e8a3d65-a9fb-4606-953a-26832b378e58") : secret "maas-api-serving-cert" not found
May 21 15:42:51.296161 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:51.296136    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk9pc\" (UniqueName: \"kubernetes.io/projected/8e8a3d65-a9fb-4606-953a-26832b378e58-kube-api-access-wk9pc\") pod \"maas-api-6f8c5878d5-rlkvg\" (UID: \"8e8a3d65-a9fb-4606-953a-26832b378e58\") " pod="opendatahub/maas-api-6f8c5878d5-rlkvg"
May 21 15:42:51.787153 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:51.787116    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e8a3d65-a9fb-4606-953a-26832b378e58-maas-api-tls\") pod \"maas-api-6f8c5878d5-rlkvg\" (UID: \"8e8a3d65-a9fb-4606-953a-26832b378e58\") " pod="opendatahub/maas-api-6f8c5878d5-rlkvg"
May 21 15:42:51.789496 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:51.789471    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e8a3d65-a9fb-4606-953a-26832b378e58-maas-api-tls\") pod \"maas-api-6f8c5878d5-rlkvg\" (UID: \"8e8a3d65-a9fb-4606-953a-26832b378e58\") " pod="opendatahub/maas-api-6f8c5878d5-rlkvg"
May 21 15:42:52.005029 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:52.004995    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6f8c5878d5-rlkvg"
May 21 15:42:52.154402 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:42:52.154371    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e8a3d65_a9fb_4606_953a_26832b378e58.slice/crio-e5675b013481568ad488ce38a89fda8bb90cea0692e089d5281d9e6718915cd5 WatchSource:0}: Error finding container e5675b013481568ad488ce38a89fda8bb90cea0692e089d5281d9e6718915cd5: Status 404 returned error can't find the container with id e5675b013481568ad488ce38a89fda8bb90cea0692e089d5281d9e6718915cd5
May 21 15:42:52.156022 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:52.155935    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6f8c5878d5-rlkvg"]
May 21 15:42:52.999455 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:52.999395    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6f8c5878d5-rlkvg" event={"ID":"8e8a3d65-a9fb-4606-953a-26832b378e58","Type":"ContainerStarted","Data":"e5675b013481568ad488ce38a89fda8bb90cea0692e089d5281d9e6718915cd5"}
May 21 15:42:54.005566 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:54.005471    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6f8c5878d5-rlkvg" event={"ID":"8e8a3d65-a9fb-4606-953a-26832b378e58","Type":"ContainerStarted","Data":"84789f762965b15079cbd58c094cd0b76ad3e00b2ecee1a98a850a93178706c3"}
May 21 15:42:54.005990 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:54.005616    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6f8c5878d5-rlkvg"
May 21 15:42:54.024431 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:42:54.024383    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-6f8c5878d5-rlkvg" podStartSLOduration=1.444920233 podStartE2EDuration="3.024360927s" podCreationTimestamp="2026-05-21 15:42:51 +0000 UTC" firstStartedPulling="2026-05-21 15:42:52.155637113 +0000 UTC m=+632.875799630" lastFinishedPulling="2026-05-21 15:42:53.735077804 +0000 UTC m=+634.455240324" observedRunningTime="2026-05-21 15:42:54.022435709 +0000 UTC m=+634.742598248" watchObservedRunningTime="2026-05-21 15:42:54.024360927 +0000 UTC m=+634.744523464"
May 21 15:43:00.014741 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:00.014713    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6f8c5878d5-rlkvg"
May 21 15:43:14.150442 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.150405    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv"]
May 21 15:43:14.153037 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.153014    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv"
May 21 15:43:14.157208 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.157186    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-n6hht\""
May 21 15:43:14.157343 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.157222    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 21 15:43:14.158247 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.158232    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 21 15:43:14.158341 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.158293    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 21 15:43:14.165241 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.165218    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv"]
May 21 15:43:14.200614 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.200586    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/357e1729-bcee-48d8-9a06-58764683c7d8-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv\" (UID: \"357e1729-bcee-48d8-9a06-58764683c7d8\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv"
May 21 15:43:14.200781 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.200620    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdfb8\" (UniqueName: \"kubernetes.io/projected/357e1729-bcee-48d8-9a06-58764683c7d8-kube-api-access-kdfb8\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv\" (UID: \"357e1729-bcee-48d8-9a06-58764683c7d8\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv"
May 21 15:43:14.200781 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.200667    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/357e1729-bcee-48d8-9a06-58764683c7d8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv\" (UID: \"357e1729-bcee-48d8-9a06-58764683c7d8\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv"
May 21 15:43:14.200899 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.200779    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/357e1729-bcee-48d8-9a06-58764683c7d8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv\" (UID: \"357e1729-bcee-48d8-9a06-58764683c7d8\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv"
May 21 15:43:14.200899 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.200838    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/357e1729-bcee-48d8-9a06-58764683c7d8-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv\" (UID: \"357e1729-bcee-48d8-9a06-58764683c7d8\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv"
May 21 15:43:14.200899 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.200890    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/357e1729-bcee-48d8-9a06-58764683c7d8-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv\" (UID: \"357e1729-bcee-48d8-9a06-58764683c7d8\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv"
May 21 15:43:14.302382 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.302344    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/357e1729-bcee-48d8-9a06-58764683c7d8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv\" (UID: \"357e1729-bcee-48d8-9a06-58764683c7d8\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv"
May 21 15:43:14.302582 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.302395    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/357e1729-bcee-48d8-9a06-58764683c7d8-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv\" (UID: \"357e1729-bcee-48d8-9a06-58764683c7d8\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv"
May 21 15:43:14.302582 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.302425    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/357e1729-bcee-48d8-9a06-58764683c7d8-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv\" (UID: \"357e1729-bcee-48d8-9a06-58764683c7d8\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv"
May 21 15:43:14.302582 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.302463    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/357e1729-bcee-48d8-9a06-58764683c7d8-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv\" (UID: \"357e1729-bcee-48d8-9a06-58764683c7d8\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv"
May 21 15:43:14.302582 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.302480    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kdfb8\" (UniqueName: \"kubernetes.io/projected/357e1729-bcee-48d8-9a06-58764683c7d8-kube-api-access-kdfb8\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv\" (UID: \"357e1729-bcee-48d8-9a06-58764683c7d8\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv"
May 21 15:43:14.302582 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.302519    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/357e1729-bcee-48d8-9a06-58764683c7d8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv\" (UID: \"357e1729-bcee-48d8-9a06-58764683c7d8\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv"
May 21 15:43:14.302852 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.302830    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/357e1729-bcee-48d8-9a06-58764683c7d8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv\" (UID: \"357e1729-bcee-48d8-9a06-58764683c7d8\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv"
May 21 15:43:14.302903 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.302866    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/357e1729-bcee-48d8-9a06-58764683c7d8-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv\" (UID: \"357e1729-bcee-48d8-9a06-58764683c7d8\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv"
May 21 15:43:14.302939 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.302901    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/357e1729-bcee-48d8-9a06-58764683c7d8-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv\" (UID: \"357e1729-bcee-48d8-9a06-58764683c7d8\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv"
May 21 15:43:14.304714 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.304693    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/357e1729-bcee-48d8-9a06-58764683c7d8-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv\" (UID: \"357e1729-bcee-48d8-9a06-58764683c7d8\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv"
May 21 15:43:14.305024 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.305008    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/357e1729-bcee-48d8-9a06-58764683c7d8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv\" (UID: \"357e1729-bcee-48d8-9a06-58764683c7d8\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv"
May 21 15:43:14.312135 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.312109    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdfb8\" (UniqueName: \"kubernetes.io/projected/357e1729-bcee-48d8-9a06-58764683c7d8-kube-api-access-kdfb8\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv\" (UID: \"357e1729-bcee-48d8-9a06-58764683c7d8\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv"
May 21 15:43:14.463711 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.463668    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv"
May 21 15:43:14.599139 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.599106    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv"]
May 21 15:43:14.601749 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:43:14.601713    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod357e1729_bcee_48d8_9a06_58764683c7d8.slice/crio-e83ec4d6edea164e9ec8d748238594b8af1e4fd09958c69185d186c4f7c9cdc4 WatchSource:0}: Error finding container e83ec4d6edea164e9ec8d748238594b8af1e4fd09958c69185d186c4f7c9cdc4: Status 404 returned error can't find the container with id e83ec4d6edea164e9ec8d748238594b8af1e4fd09958c69185d186c4f7c9cdc4
May 21 15:43:14.603404 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:14.603388    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 15:43:15.078622 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:15.078587    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv" event={"ID":"357e1729-bcee-48d8-9a06-58764683c7d8","Type":"ContainerStarted","Data":"e83ec4d6edea164e9ec8d748238594b8af1e4fd09958c69185d186c4f7c9cdc4"}
May 21 15:43:22.104140 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:22.104035    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv" event={"ID":"357e1729-bcee-48d8-9a06-58764683c7d8","Type":"ContainerStarted","Data":"13e12388e184ede2a4978c7deb4befdb2bc65d41ccf7691aba349fb5cf9b66dc"}
May 21 15:43:28.126354 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:28.126317    2552 generic.go:358] "Generic (PLEG): container finished" podID="357e1729-bcee-48d8-9a06-58764683c7d8" containerID="13e12388e184ede2a4978c7deb4befdb2bc65d41ccf7691aba349fb5cf9b66dc" exitCode=0
May 21 15:43:28.126764 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:28.126390    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv" event={"ID":"357e1729-bcee-48d8-9a06-58764683c7d8","Type":"ContainerDied","Data":"13e12388e184ede2a4978c7deb4befdb2bc65d41ccf7691aba349fb5cf9b66dc"}
May 21 15:43:30.136152 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:30.136112    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv" event={"ID":"357e1729-bcee-48d8-9a06-58764683c7d8","Type":"ContainerStarted","Data":"cdf867cfb9d0ef91d244fa96ddd190ff071bc69a5045aaca2819a986237536f1"}
May 21 15:43:30.136648 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:30.136405    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv"
May 21 15:43:30.156185 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:30.156134    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv" podStartSLOduration=1.590035573 podStartE2EDuration="16.156122318s" podCreationTimestamp="2026-05-21 15:43:14 +0000 UTC" firstStartedPulling="2026-05-21 15:43:14.603524124 +0000 UTC m=+655.323686640" lastFinishedPulling="2026-05-21 15:43:29.169610866 +0000 UTC m=+669.889773385" observedRunningTime="2026-05-21 15:43:30.154707063 +0000 UTC m=+670.874869602" watchObservedRunningTime="2026-05-21 15:43:30.156122318 +0000 UTC m=+670.876284855"
May 21 15:43:41.153646 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:41.153613    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv"
May 21 15:43:42.233873 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:42.233840    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz"]
May 21 15:43:42.237168 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:42.237151    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz"
May 21 15:43:42.239660 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:42.239642    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
May 21 15:43:42.246358 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:42.246334    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz"]
May 21 15:43:42.263510 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:42.263481    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/02570bea-9a77-4c6e-8c6f-812c69e4b1ac-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz\" (UID: \"02570bea-9a77-4c6e-8c6f-812c69e4b1ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz"
May 21 15:43:42.263633 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:42.263520    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfpl8\" (UniqueName: \"kubernetes.io/projected/02570bea-9a77-4c6e-8c6f-812c69e4b1ac-kube-api-access-rfpl8\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz\" (UID: \"02570bea-9a77-4c6e-8c6f-812c69e4b1ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz"
May 21 15:43:42.263633 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:42.263550    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02570bea-9a77-4c6e-8c6f-812c69e4b1ac-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz\" (UID: \"02570bea-9a77-4c6e-8c6f-812c69e4b1ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz"
May 21 15:43:42.263633 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:42.263579    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02570bea-9a77-4c6e-8c6f-812c69e4b1ac-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz\" (UID: \"02570bea-9a77-4c6e-8c6f-812c69e4b1ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz"
May 21 15:43:42.263633 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:42.263616    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02570bea-9a77-4c6e-8c6f-812c69e4b1ac-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz\" (UID: \"02570bea-9a77-4c6e-8c6f-812c69e4b1ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz"
May 21 15:43:42.263770 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:42.263639    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02570bea-9a77-4c6e-8c6f-812c69e4b1ac-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz\" (UID: \"02570bea-9a77-4c6e-8c6f-812c69e4b1ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz"
May 21 15:43:42.364273 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:42.364232    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/02570bea-9a77-4c6e-8c6f-812c69e4b1ac-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz\" (UID: \"02570bea-9a77-4c6e-8c6f-812c69e4b1ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz"
May 21 15:43:42.364478 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:42.364325    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rfpl8\" (UniqueName: \"kubernetes.io/projected/02570bea-9a77-4c6e-8c6f-812c69e4b1ac-kube-api-access-rfpl8\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz\" (UID: \"02570bea-9a77-4c6e-8c6f-812c69e4b1ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz"
May 21 15:43:42.364478 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:42.364371    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02570bea-9a77-4c6e-8c6f-812c69e4b1ac-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz\" (UID: \"02570bea-9a77-4c6e-8c6f-812c69e4b1ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz"
May 21 15:43:42.364478 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:42.364431    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02570bea-9a77-4c6e-8c6f-812c69e4b1ac-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz\" (UID: \"02570bea-9a77-4c6e-8c6f-812c69e4b1ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz"
May 21 15:43:42.364651 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:42.364499    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02570bea-9a77-4c6e-8c6f-812c69e4b1ac-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz\" (UID: \"02570bea-9a77-4c6e-8c6f-812c69e4b1ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz"
May 21 15:43:42.364651 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:42.364537    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02570bea-9a77-4c6e-8c6f-812c69e4b1ac-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz\" (UID: \"02570bea-9a77-4c6e-8c6f-812c69e4b1ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz"
May 21 15:43:42.364651 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:42.364621    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/02570bea-9a77-4c6e-8c6f-812c69e4b1ac-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz\" (UID: \"02570bea-9a77-4c6e-8c6f-812c69e4b1ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz"
May 21 15:43:42.364874 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:42.364851    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02570bea-9a77-4c6e-8c6f-812c69e4b1ac-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz\" (UID: \"02570bea-9a77-4c6e-8c6f-812c69e4b1ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz"
May 21 15:43:42.364941 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:42.364919    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02570bea-9a77-4c6e-8c6f-812c69e4b1ac-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz\" (UID: \"02570bea-9a77-4c6e-8c6f-812c69e4b1ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz"
May 21 15:43:42.366663 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:42.366641    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02570bea-9a77-4c6e-8c6f-812c69e4b1ac-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz\" (UID: \"02570bea-9a77-4c6e-8c6f-812c69e4b1ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz"
May 21 15:43:42.367037 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:42.367017    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02570bea-9a77-4c6e-8c6f-812c69e4b1ac-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz\" (UID: \"02570bea-9a77-4c6e-8c6f-812c69e4b1ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz"
May 21 15:43:42.373336 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:42.373310    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfpl8\" (UniqueName: \"kubernetes.io/projected/02570bea-9a77-4c6e-8c6f-812c69e4b1ac-kube-api-access-rfpl8\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz\" (UID: \"02570bea-9a77-4c6e-8c6f-812c69e4b1ac\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz"
May 21 15:43:42.548378 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:42.548286    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz"
May 21 15:43:42.684669 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:42.684637    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz"]
May 21 15:43:42.687904 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:43:42.687876    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02570bea_9a77_4c6e_8c6f_812c69e4b1ac.slice/crio-160f85ee449eb5be903039a0e00a0a26f548a66ff335f1cefdad0473eb16b60f WatchSource:0}: Error finding container 160f85ee449eb5be903039a0e00a0a26f548a66ff335f1cefdad0473eb16b60f: Status 404 returned error can't find the container with id 160f85ee449eb5be903039a0e00a0a26f548a66ff335f1cefdad0473eb16b60f
May 21 15:43:43.199253 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:43.199203    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz" event={"ID":"02570bea-9a77-4c6e-8c6f-812c69e4b1ac","Type":"ContainerStarted","Data":"f4deec5299bd537d1557fe1280d4b8e0cc46c2fb4946f6f8bc0efcd763153b6b"}
May 21 15:43:43.199253 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:43.199273    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz" event={"ID":"02570bea-9a77-4c6e-8c6f-812c69e4b1ac","Type":"ContainerStarted","Data":"160f85ee449eb5be903039a0e00a0a26f548a66ff335f1cefdad0473eb16b60f"}
May 21 15:43:48.219111 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:48.219074    2552 generic.go:358] "Generic (PLEG): container finished" podID="02570bea-9a77-4c6e-8c6f-812c69e4b1ac" containerID="f4deec5299bd537d1557fe1280d4b8e0cc46c2fb4946f6f8bc0efcd763153b6b" exitCode=0
May 21 15:43:48.219499 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:48.219149    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz" event={"ID":"02570bea-9a77-4c6e-8c6f-812c69e4b1ac","Type":"ContainerDied","Data":"f4deec5299bd537d1557fe1280d4b8e0cc46c2fb4946f6f8bc0efcd763153b6b"}
May 21 15:43:49.224439 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:49.224408    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz" event={"ID":"02570bea-9a77-4c6e-8c6f-812c69e4b1ac","Type":"ContainerStarted","Data":"8a0d7f30d96a2215e096251afad492176af2f11792a8439cac5d16e6783a6529"}
May 21 15:43:49.224844 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:49.224628    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz"
May 21 15:43:49.246022 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:49.245975    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz" podStartSLOduration=6.9754568710000004 podStartE2EDuration="7.245959938s" podCreationTimestamp="2026-05-21 15:43:42 +0000 UTC" firstStartedPulling="2026-05-21 15:43:48.219861743 +0000 UTC m=+688.940024262" lastFinishedPulling="2026-05-21 15:43:48.490364812 +0000 UTC m=+689.210527329" observedRunningTime="2026-05-21 15:43:49.244806073 +0000 UTC m=+689.964968611" watchObservedRunningTime="2026-05-21 15:43:49.245959938 +0000 UTC m=+689.966122455"
May 21 15:43:59.642348 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:59.642310    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp"]
May 21 15:43:59.663181 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:59.663138    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp"]
May 21 15:43:59.663385 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:59.663323    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp"
May 21 15:43:59.666309 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:59.666286    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
May 21 15:43:59.716930 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:59.716879    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea59f124-8f2b-44be-9142-959dcaab75b2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp\" (UID: \"ea59f124-8f2b-44be-9142-959dcaab75b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp"
May 21 15:43:59.717113 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:59.716985    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea59f124-8f2b-44be-9142-959dcaab75b2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp\" (UID: \"ea59f124-8f2b-44be-9142-959dcaab75b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp"
May 21 15:43:59.717113 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:59.717084    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8bnw\" (UniqueName: \"kubernetes.io/projected/ea59f124-8f2b-44be-9142-959dcaab75b2-kube-api-access-n8bnw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp\" (UID: \"ea59f124-8f2b-44be-9142-959dcaab75b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp"
May 21 15:43:59.717235 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:59.717142    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea59f124-8f2b-44be-9142-959dcaab75b2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp\" (UID: \"ea59f124-8f2b-44be-9142-959dcaab75b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp"
May 21 15:43:59.717235 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:59.717227    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ea59f124-8f2b-44be-9142-959dcaab75b2-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp\" (UID: \"ea59f124-8f2b-44be-9142-959dcaab75b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp"
May 21 15:43:59.717383 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:59.717301    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea59f124-8f2b-44be-9142-959dcaab75b2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp\" (UID: \"ea59f124-8f2b-44be-9142-959dcaab75b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp"
May 21 15:43:59.818348 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:59.818310    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n8bnw\" (UniqueName: \"kubernetes.io/projected/ea59f124-8f2b-44be-9142-959dcaab75b2-kube-api-access-n8bnw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp\" (UID: \"ea59f124-8f2b-44be-9142-959dcaab75b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp"
May 21 15:43:59.818520 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:59.818362    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea59f124-8f2b-44be-9142-959dcaab75b2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp\" (UID: \"ea59f124-8f2b-44be-9142-959dcaab75b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp"
May 21 15:43:59.818520 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:59.818434    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ea59f124-8f2b-44be-9142-959dcaab75b2-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp\" (UID: \"ea59f124-8f2b-44be-9142-959dcaab75b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp"
May 21 15:43:59.818520 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:59.818476    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea59f124-8f2b-44be-9142-959dcaab75b2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp\" (UID: \"ea59f124-8f2b-44be-9142-959dcaab75b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp"
May 21 15:43:59.818520 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:59.818513    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea59f124-8f2b-44be-9142-959dcaab75b2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp\" (UID: \"ea59f124-8f2b-44be-9142-959dcaab75b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp"
May 21 15:43:59.818718 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:59.818569    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea59f124-8f2b-44be-9142-959dcaab75b2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp\" (UID: \"ea59f124-8f2b-44be-9142-959dcaab75b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp"
May 21 15:43:59.818835 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:59.818808    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea59f124-8f2b-44be-9142-959dcaab75b2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp\" (UID: \"ea59f124-8f2b-44be-9142-959dcaab75b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp"
May 21 15:43:59.818925 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:59.818832    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ea59f124-8f2b-44be-9142-959dcaab75b2-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp\" (UID: \"ea59f124-8f2b-44be-9142-959dcaab75b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp"
May 21 15:43:59.819063 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:59.819046    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea59f124-8f2b-44be-9142-959dcaab75b2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp\" (UID: \"ea59f124-8f2b-44be-9142-959dcaab75b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp"
May 21 15:43:59.821316 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:59.821293    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea59f124-8f2b-44be-9142-959dcaab75b2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp\" (UID: \"ea59f124-8f2b-44be-9142-959dcaab75b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp"
May 21 15:43:59.821546 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:59.821526    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea59f124-8f2b-44be-9142-959dcaab75b2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp\" (UID: \"ea59f124-8f2b-44be-9142-959dcaab75b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp"
May 21 15:43:59.828093 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:59.828065    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8bnw\" (UniqueName: \"kubernetes.io/projected/ea59f124-8f2b-44be-9142-959dcaab75b2-kube-api-access-n8bnw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp\" (UID: \"ea59f124-8f2b-44be-9142-959dcaab75b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp"
May 21 15:43:59.976555 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:43:59.976513    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp"
May 21 15:44:00.110845 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:00.110813    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp"]
May 21 15:44:00.113557 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:44:00.113528    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea59f124_8f2b_44be_9142_959dcaab75b2.slice/crio-f7945bec6473ce155da9dd8082581b4d914c37e5e640d848a98de9021bd44270 WatchSource:0}: Error finding container f7945bec6473ce155da9dd8082581b4d914c37e5e640d848a98de9021bd44270: Status 404 returned error can't find the container with id f7945bec6473ce155da9dd8082581b4d914c37e5e640d848a98de9021bd44270
May 21 15:44:00.241140 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:00.241055    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz"
May 21 15:44:00.264869 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:00.264828    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp" event={"ID":"ea59f124-8f2b-44be-9142-959dcaab75b2","Type":"ContainerStarted","Data":"a7577bcefe5e9d6c2105bf1608c2cd92e10fe0f549b8c686f59d74f097d58a81"}
May 21 15:44:00.264869 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:00.264869    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp" event={"ID":"ea59f124-8f2b-44be-9142-959dcaab75b2","Type":"ContainerStarted","Data":"f7945bec6473ce155da9dd8082581b4d914c37e5e640d848a98de9021bd44270"}
May 21 15:44:06.289598 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:06.289558    2552 generic.go:358] "Generic (PLEG): container finished" podID="ea59f124-8f2b-44be-9142-959dcaab75b2" containerID="a7577bcefe5e9d6c2105bf1608c2cd92e10fe0f549b8c686f59d74f097d58a81" exitCode=0
May 21 15:44:06.289968 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:06.289636    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp" event={"ID":"ea59f124-8f2b-44be-9142-959dcaab75b2","Type":"ContainerDied","Data":"a7577bcefe5e9d6c2105bf1608c2cd92e10fe0f549b8c686f59d74f097d58a81"}
May 21 15:44:07.295568 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:07.295531    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp" event={"ID":"ea59f124-8f2b-44be-9142-959dcaab75b2","Type":"ContainerStarted","Data":"8e27a67f16a08970ce286afbf6a929c02864a8063b8022d743b8eca4792ebb77"}
May 21 15:44:07.296043 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:07.295766    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp"
May 21 15:44:07.316516 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:07.316467    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp" podStartSLOduration=8.046140998 podStartE2EDuration="8.316453313s" podCreationTimestamp="2026-05-21 15:43:59 +0000 UTC" firstStartedPulling="2026-05-21 15:44:06.290253357 +0000 UTC m=+707.010415874" lastFinishedPulling="2026-05-21 15:44:06.56056567 +0000 UTC m=+707.280728189" observedRunningTime="2026-05-21 15:44:07.315449917 +0000 UTC m=+708.035612458" watchObservedRunningTime="2026-05-21 15:44:07.316453313 +0000 UTC m=+708.036615850"
May 21 15:44:18.312878 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:18.312850    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp"
May 21 15:44:45.900492 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:45.900454    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78d57bbb75-29jnd"]
May 21 15:44:45.901005 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:45.900713    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-78d57bbb75-29jnd" podUID="ee1717ea-f2a6-4929-93f0-413c2108e9af" containerName="authorino" containerID="cri-o://a15329df10235b5769fb224e702b462dfdb00e5691d9c7842f6cf7eb1b9da9d9" gracePeriod=30
May 21 15:44:46.146604 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:46.146576    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78d57bbb75-29jnd"
May 21 15:44:46.255965 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:46.255932    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-262kw\" (UniqueName: \"kubernetes.io/projected/ee1717ea-f2a6-4929-93f0-413c2108e9af-kube-api-access-262kw\") pod \"ee1717ea-f2a6-4929-93f0-413c2108e9af\" (UID: \"ee1717ea-f2a6-4929-93f0-413c2108e9af\") "
May 21 15:44:46.256168 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:46.256046    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ee1717ea-f2a6-4929-93f0-413c2108e9af-tls-cert\") pod \"ee1717ea-f2a6-4929-93f0-413c2108e9af\" (UID: \"ee1717ea-f2a6-4929-93f0-413c2108e9af\") "
May 21 15:44:46.258065 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:46.258033    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee1717ea-f2a6-4929-93f0-413c2108e9af-kube-api-access-262kw" (OuterVolumeSpecName: "kube-api-access-262kw") pod "ee1717ea-f2a6-4929-93f0-413c2108e9af" (UID: "ee1717ea-f2a6-4929-93f0-413c2108e9af"). InnerVolumeSpecName "kube-api-access-262kw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:44:46.266303 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:46.266276    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee1717ea-f2a6-4929-93f0-413c2108e9af-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ee1717ea-f2a6-4929-93f0-413c2108e9af" (UID: "ee1717ea-f2a6-4929-93f0-413c2108e9af"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:44:46.357619 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:46.357586    2552 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ee1717ea-f2a6-4929-93f0-413c2108e9af-tls-cert\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:44:46.357619 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:46.357618    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-262kw\" (UniqueName: \"kubernetes.io/projected/ee1717ea-f2a6-4929-93f0-413c2108e9af-kube-api-access-262kw\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:44:46.429792 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:46.429757    2552 generic.go:358] "Generic (PLEG): container finished" podID="ee1717ea-f2a6-4929-93f0-413c2108e9af" containerID="a15329df10235b5769fb224e702b462dfdb00e5691d9c7842f6cf7eb1b9da9d9" exitCode=0
May 21 15:44:46.429964 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:46.429808    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78d57bbb75-29jnd"
May 21 15:44:46.429964 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:46.429851    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78d57bbb75-29jnd" event={"ID":"ee1717ea-f2a6-4929-93f0-413c2108e9af","Type":"ContainerDied","Data":"a15329df10235b5769fb224e702b462dfdb00e5691d9c7842f6cf7eb1b9da9d9"}
May 21 15:44:46.429964 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:46.429893    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78d57bbb75-29jnd" event={"ID":"ee1717ea-f2a6-4929-93f0-413c2108e9af","Type":"ContainerDied","Data":"a3d67cc8191854cbbe0dfb3875cfe3a04752a23bba547c3a6338f790e5bc5368"}
May 21 15:44:46.429964 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:46.429909    2552 scope.go:117] "RemoveContainer" containerID="a15329df10235b5769fb224e702b462dfdb00e5691d9c7842f6cf7eb1b9da9d9"
May 21 15:44:46.439194 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:46.439170    2552 scope.go:117] "RemoveContainer" containerID="a15329df10235b5769fb224e702b462dfdb00e5691d9c7842f6cf7eb1b9da9d9"
May 21 15:44:46.439501 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:44:46.439465    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a15329df10235b5769fb224e702b462dfdb00e5691d9c7842f6cf7eb1b9da9d9\": container with ID starting with a15329df10235b5769fb224e702b462dfdb00e5691d9c7842f6cf7eb1b9da9d9 not found: ID does not exist" containerID="a15329df10235b5769fb224e702b462dfdb00e5691d9c7842f6cf7eb1b9da9d9"
May 21 15:44:46.439575 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:46.439508    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a15329df10235b5769fb224e702b462dfdb00e5691d9c7842f6cf7eb1b9da9d9"} err="failed to get container status \"a15329df10235b5769fb224e702b462dfdb00e5691d9c7842f6cf7eb1b9da9d9\": rpc error: code = NotFound desc = could not find container \"a15329df10235b5769fb224e702b462dfdb00e5691d9c7842f6cf7eb1b9da9d9\": container with ID starting with a15329df10235b5769fb224e702b462dfdb00e5691d9c7842f6cf7eb1b9da9d9 not found: ID does not exist"
May 21 15:44:46.452698 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:46.452672    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78d57bbb75-29jnd"]
May 21 15:44:46.459197 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:46.459171    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-78d57bbb75-29jnd"]
May 21 15:44:47.845852 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:44:47.845818    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee1717ea-f2a6-4929-93f0-413c2108e9af" path="/var/lib/kubelet/pods/ee1717ea-f2a6-4929-93f0-413c2108e9af/volumes"
May 21 15:46:07.455586 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:07.455543    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78bbf8f7d6-ck7cf"]
May 21 15:46:07.456106 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:07.455859    2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-78bbf8f7d6-ck7cf" podUID="261b0cc0-5c7d-48f7-a75b-b2c0c6914d3e" containerName="manager" containerID="cri-o://b7191994f578957a8bdf16ca6810de5e4ba8a16935c68e5578cb8ceaffa53555" gracePeriod=30
May 21 15:46:07.702229 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:07.702204    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78bbf8f7d6-ck7cf"
May 21 15:46:07.714228 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:07.714163    2552 generic.go:358] "Generic (PLEG): container finished" podID="261b0cc0-5c7d-48f7-a75b-b2c0c6914d3e" containerID="b7191994f578957a8bdf16ca6810de5e4ba8a16935c68e5578cb8ceaffa53555" exitCode=0
May 21 15:46:07.714228 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:07.714220    2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78bbf8f7d6-ck7cf"
May 21 15:46:07.714389 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:07.714244    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78bbf8f7d6-ck7cf" event={"ID":"261b0cc0-5c7d-48f7-a75b-b2c0c6914d3e","Type":"ContainerDied","Data":"b7191994f578957a8bdf16ca6810de5e4ba8a16935c68e5578cb8ceaffa53555"}
May 21 15:46:07.714389 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:07.714295    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78bbf8f7d6-ck7cf" event={"ID":"261b0cc0-5c7d-48f7-a75b-b2c0c6914d3e","Type":"ContainerDied","Data":"2e28b8ff6e178128114c5d7d1a6a2c882fe0ce6a4e113abb816aa3d9dff6cba3"}
May 21 15:46:07.714389 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:07.714313    2552 scope.go:117] "RemoveContainer" containerID="b7191994f578957a8bdf16ca6810de5e4ba8a16935c68e5578cb8ceaffa53555"
May 21 15:46:07.722440 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:07.722425    2552 scope.go:117] "RemoveContainer" containerID="b7191994f578957a8bdf16ca6810de5e4ba8a16935c68e5578cb8ceaffa53555"
May 21 15:46:07.722706 ip-10-0-132-73 kubenswrapper[2552]: E0521 15:46:07.722686    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7191994f578957a8bdf16ca6810de5e4ba8a16935c68e5578cb8ceaffa53555\": container with ID starting with b7191994f578957a8bdf16ca6810de5e4ba8a16935c68e5578cb8ceaffa53555 not found: ID does not exist" containerID="b7191994f578957a8bdf16ca6810de5e4ba8a16935c68e5578cb8ceaffa53555"
May 21 15:46:07.722795 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:07.722714    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7191994f578957a8bdf16ca6810de5e4ba8a16935c68e5578cb8ceaffa53555"} err="failed to get container status \"b7191994f578957a8bdf16ca6810de5e4ba8a16935c68e5578cb8ceaffa53555\": rpc error: code = NotFound desc = could not find container \"b7191994f578957a8bdf16ca6810de5e4ba8a16935c68e5578cb8ceaffa53555\": container with ID starting with b7191994f578957a8bdf16ca6810de5e4ba8a16935c68e5578cb8ceaffa53555 not found: ID does not exist"
May 21 15:46:07.830108 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:07.830065    2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfkkf\" (UniqueName: \"kubernetes.io/projected/261b0cc0-5c7d-48f7-a75b-b2c0c6914d3e-kube-api-access-vfkkf\") pod \"261b0cc0-5c7d-48f7-a75b-b2c0c6914d3e\" (UID: \"261b0cc0-5c7d-48f7-a75b-b2c0c6914d3e\") "
May 21 15:46:07.832184 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:07.832156    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/261b0cc0-5c7d-48f7-a75b-b2c0c6914d3e-kube-api-access-vfkkf" (OuterVolumeSpecName: "kube-api-access-vfkkf") pod "261b0cc0-5c7d-48f7-a75b-b2c0c6914d3e" (UID: "261b0cc0-5c7d-48f7-a75b-b2c0c6914d3e"). InnerVolumeSpecName "kube-api-access-vfkkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:46:07.931067 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:07.931024    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfkkf\" (UniqueName: \"kubernetes.io/projected/261b0cc0-5c7d-48f7-a75b-b2c0c6914d3e-kube-api-access-vfkkf\") on node \"ip-10-0-132-73.ec2.internal\" DevicePath \"\""
May 21 15:46:08.030160 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:08.030075    2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78bbf8f7d6-ck7cf"]
May 21 15:46:08.034882 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:08.034851    2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-78bbf8f7d6-ck7cf"]
May 21 15:46:08.745964 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:08.745932    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-78bbf8f7d6-6nx6k"]
May 21 15:46:08.746518 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:08.746501    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="261b0cc0-5c7d-48f7-a75b-b2c0c6914d3e" containerName="manager"
May 21 15:46:08.746593 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:08.746521    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="261b0cc0-5c7d-48f7-a75b-b2c0c6914d3e" containerName="manager"
May 21 15:46:08.746593 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:08.746562    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee1717ea-f2a6-4929-93f0-413c2108e9af" containerName="authorino"
May 21 15:46:08.746593 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:08.746571    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee1717ea-f2a6-4929-93f0-413c2108e9af" containerName="authorino"
May 21 15:46:08.746744 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:08.746655    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="261b0cc0-5c7d-48f7-a75b-b2c0c6914d3e" containerName="manager"
May 21 15:46:08.746744 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:08.746676    2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee1717ea-f2a6-4929-93f0-413c2108e9af" containerName="authorino"
May 21 15:46:08.750452 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:08.750430    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78bbf8f7d6-6nx6k"
May 21 15:46:08.752944 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:08.752919    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lk5sf\""
May 21 15:46:08.757315 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:08.757292    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78bbf8f7d6-6nx6k"]
May 21 15:46:08.838499 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:08.838459    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42s7w\" (UniqueName: \"kubernetes.io/projected/c482a8d3-b120-40c0-bec0-96d119330abd-kube-api-access-42s7w\") pod \"maas-controller-78bbf8f7d6-6nx6k\" (UID: \"c482a8d3-b120-40c0-bec0-96d119330abd\") " pod="opendatahub/maas-controller-78bbf8f7d6-6nx6k"
May 21 15:46:08.939222 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:08.939189    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-42s7w\" (UniqueName: \"kubernetes.io/projected/c482a8d3-b120-40c0-bec0-96d119330abd-kube-api-access-42s7w\") pod \"maas-controller-78bbf8f7d6-6nx6k\" (UID: \"c482a8d3-b120-40c0-bec0-96d119330abd\") " pod="opendatahub/maas-controller-78bbf8f7d6-6nx6k"
May 21 15:46:08.948517 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:08.948489    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42s7w\" (UniqueName: \"kubernetes.io/projected/c482a8d3-b120-40c0-bec0-96d119330abd-kube-api-access-42s7w\") pod \"maas-controller-78bbf8f7d6-6nx6k\" (UID: \"c482a8d3-b120-40c0-bec0-96d119330abd\") " pod="opendatahub/maas-controller-78bbf8f7d6-6nx6k"
May 21 15:46:09.062643 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:09.062528    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78bbf8f7d6-6nx6k"
May 21 15:46:09.195151 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:09.195124    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78bbf8f7d6-6nx6k"]
May 21 15:46:09.197878 ip-10-0-132-73 kubenswrapper[2552]: W0521 15:46:09.197837    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc482a8d3_b120_40c0_bec0_96d119330abd.slice/crio-027dad7483d428fa933e6e55fcbb630bc0be4965f41511df929aaf3fc523913f WatchSource:0}: Error finding container 027dad7483d428fa933e6e55fcbb630bc0be4965f41511df929aaf3fc523913f: Status 404 returned error can't find the container with id 027dad7483d428fa933e6e55fcbb630bc0be4965f41511df929aaf3fc523913f
May 21 15:46:09.723693 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:09.723646    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78bbf8f7d6-6nx6k" event={"ID":"c482a8d3-b120-40c0-bec0-96d119330abd","Type":"ContainerStarted","Data":"63f9bbd3f1ff2eb4086a519a29d5f7a1b186b057960444357cd0255bbf4521f4"}
May 21 15:46:09.723693 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:09.723697    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78bbf8f7d6-6nx6k" event={"ID":"c482a8d3-b120-40c0-bec0-96d119330abd","Type":"ContainerStarted","Data":"027dad7483d428fa933e6e55fcbb630bc0be4965f41511df929aaf3fc523913f"}
May 21 15:46:09.723906 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:09.723768    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-78bbf8f7d6-6nx6k"
May 21 15:46:09.741810 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:09.741761    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-78bbf8f7d6-6nx6k" podStartSLOduration=1.304756577 podStartE2EDuration="1.741747483s" podCreationTimestamp="2026-05-21 15:46:08 +0000 UTC" firstStartedPulling="2026-05-21 15:46:09.199186364 +0000 UTC m=+829.919348883" lastFinishedPulling="2026-05-21 15:46:09.636177273 +0000 UTC m=+830.356339789" observedRunningTime="2026-05-21 15:46:09.739650105 +0000 UTC m=+830.459812644" watchObservedRunningTime="2026-05-21 15:46:09.741747483 +0000 UTC m=+830.461910020"
May 21 15:46:09.847557 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:09.847524    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="261b0cc0-5c7d-48f7-a75b-b2c0c6914d3e" path="/var/lib/kubelet/pods/261b0cc0-5c7d-48f7-a75b-b2c0c6914d3e/volumes"
May 21 15:46:20.732990 ip-10-0-132-73 kubenswrapper[2552]: I0521 15:46:20.732960    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-78bbf8f7d6-6nx6k"
May 21 16:07:18.760838 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:18.760804    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6f8c5878d5-rlkvg_8e8a3d65-a9fb-4606-953a-26832b378e58/maas-api/0.log"
May 21 16:07:18.875773 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:18.875738    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-78bbf8f7d6-6nx6k_c482a8d3-b120-40c0-bec0-96d119330abd/manager/0.log"
May 21 16:07:19.222738 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:19.222702    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5544b565-k5zb7_25647832-639e-4fd2-97c1-cc9398c366e6/manager/0.log"
May 21 16:07:19.445507 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:19.445474    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-txz52_7300bd52-f735-4048-9ac2-292559ff17fa/postgres/0.log"
May 21 16:07:22.052864 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:22.052808    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bc586767c-995lg_d6d4a708-8b03-4097-8d47-786cd77399f3/kube-auth-proxy/0.log"
May 21 16:07:22.277201 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:22.277167    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7df95f575-kl2tj_1621ed22-6820-4cf0-8007-f8de8431d5d0/istio-proxy/0.log"
May 21 16:07:22.851619 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:22.851589    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv_357e1729-bcee-48d8-9a06-58764683c7d8/storage-initializer/0.log"
May 21 16:07:22.858790 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:22.858767    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-4sckv_357e1729-bcee-48d8-9a06-58764683c7d8/main/0.log"
May 21 16:07:22.966651 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:22.966616    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz_02570bea-9a77-4c6e-8c6f-812c69e4b1ac/storage-initializer/0.log"
May 21 16:07:22.974783 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:22.974754    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-d94pz_02570bea-9a77-4c6e-8c6f-812c69e4b1ac/main/0.log"
May 21 16:07:23.193496 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:23.193465    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp_ea59f124-8f2b-44be-9142-959dcaab75b2/storage-initializer/0.log"
May 21 16:07:23.200489 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:23.200456    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsjccp_ea59f124-8f2b-44be-9142-959dcaab75b2/main/0.log"
May 21 16:07:27.259757 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:27.259722    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p2kzh/must-gather-hznr2"]
May 21 16:07:27.263454 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:27.263433    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2kzh/must-gather-hznr2"
May 21 16:07:27.266502 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:27.266479    2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p2kzh\"/\"default-dockercfg-8bcrl\""
May 21 16:07:27.266985 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:27.266965    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p2kzh\"/\"openshift-service-ca.crt\""
May 21 16:07:27.267083 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:27.267001    2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p2kzh\"/\"kube-root-ca.crt\""
May 21 16:07:27.282150 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:27.282126    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2kzh/must-gather-hznr2"]
May 21 16:07:27.366726 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:27.366684    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/673e519f-82f8-4a5e-9db7-b6b8fef9a2a2-must-gather-output\") pod \"must-gather-hznr2\" (UID: \"673e519f-82f8-4a5e-9db7-b6b8fef9a2a2\") " pod="openshift-must-gather-p2kzh/must-gather-hznr2"
May 21 16:07:27.366726 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:27.366725    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68xtq\" (UniqueName: \"kubernetes.io/projected/673e519f-82f8-4a5e-9db7-b6b8fef9a2a2-kube-api-access-68xtq\") pod \"must-gather-hznr2\" (UID: \"673e519f-82f8-4a5e-9db7-b6b8fef9a2a2\") " pod="openshift-must-gather-p2kzh/must-gather-hznr2"
May 21 16:07:27.467553 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:27.467514    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/673e519f-82f8-4a5e-9db7-b6b8fef9a2a2-must-gather-output\") pod \"must-gather-hznr2\" (UID: \"673e519f-82f8-4a5e-9db7-b6b8fef9a2a2\") " pod="openshift-must-gather-p2kzh/must-gather-hznr2"
May 21 16:07:27.467725 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:27.467560    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-68xtq\" (UniqueName: \"kubernetes.io/projected/673e519f-82f8-4a5e-9db7-b6b8fef9a2a2-kube-api-access-68xtq\") pod \"must-gather-hznr2\" (UID: \"673e519f-82f8-4a5e-9db7-b6b8fef9a2a2\") " pod="openshift-must-gather-p2kzh/must-gather-hznr2"
May 21 16:07:27.467931 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:27.467908    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/673e519f-82f8-4a5e-9db7-b6b8fef9a2a2-must-gather-output\") pod \"must-gather-hznr2\" (UID: \"673e519f-82f8-4a5e-9db7-b6b8fef9a2a2\") " pod="openshift-must-gather-p2kzh/must-gather-hznr2"
May 21 16:07:27.475345 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:27.475323    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68xtq\" (UniqueName: \"kubernetes.io/projected/673e519f-82f8-4a5e-9db7-b6b8fef9a2a2-kube-api-access-68xtq\") pod \"must-gather-hznr2\" (UID: \"673e519f-82f8-4a5e-9db7-b6b8fef9a2a2\") " pod="openshift-must-gather-p2kzh/must-gather-hznr2"
May 21 16:07:27.589476 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:27.589386    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2kzh/must-gather-hznr2"
May 21 16:07:27.718035 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:27.718006    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2kzh/must-gather-hznr2"]
May 21 16:07:27.721252 ip-10-0-132-73 kubenswrapper[2552]: W0521 16:07:27.721221    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod673e519f_82f8_4a5e_9db7_b6b8fef9a2a2.slice/crio-6ba3033357653c645ad0ddf9ad58edd19642a0b7ac08f09a401a0ebf911123a0 WatchSource:0}: Error finding container 6ba3033357653c645ad0ddf9ad58edd19642a0b7ac08f09a401a0ebf911123a0: Status 404 returned error can't find the container with id 6ba3033357653c645ad0ddf9ad58edd19642a0b7ac08f09a401a0ebf911123a0
May 21 16:07:27.722893 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:27.722879    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 16:07:28.315527 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:28.315491    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2kzh/must-gather-hznr2" event={"ID":"673e519f-82f8-4a5e-9db7-b6b8fef9a2a2","Type":"ContainerStarted","Data":"6ba3033357653c645ad0ddf9ad58edd19642a0b7ac08f09a401a0ebf911123a0"}
May 21 16:07:29.321923 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:29.321890    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2kzh/must-gather-hznr2" event={"ID":"673e519f-82f8-4a5e-9db7-b6b8fef9a2a2","Type":"ContainerStarted","Data":"11807874675c461f5c76d700c53078f49556907977686f4a6e5e2241beaf2ee0"}
May 21 16:07:29.321923 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:29.321926    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2kzh/must-gather-hznr2" event={"ID":"673e519f-82f8-4a5e-9db7-b6b8fef9a2a2","Type":"ContainerStarted","Data":"3545277cbc49ca6b09d274053f87131f619c2568a86b45dbdbb4e40a74cc1dcc"}
May 21 16:07:29.357976 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:29.357916    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-p2kzh/must-gather-hznr2" podStartSLOduration=1.481408317 podStartE2EDuration="2.357899764s" podCreationTimestamp="2026-05-21 16:07:27 +0000 UTC" firstStartedPulling="2026-05-21 16:07:27.723002387 +0000 UTC m=+2108.443164903" lastFinishedPulling="2026-05-21 16:07:28.599493835 +0000 UTC m=+2109.319656350" observedRunningTime="2026-05-21 16:07:29.355417042 +0000 UTC m=+2110.075579580" watchObservedRunningTime="2026-05-21 16:07:29.357899764 +0000 UTC m=+2110.078062302"
May 21 16:07:30.254226 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:30.254196    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-f6cm6_9c595139-6ece-41c7-9eb2-cdb6cda3df6d/global-pull-secret-syncer/0.log"
May 21 16:07:30.389774 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:30.389744    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2pdz5_db3f5fed-a552-4838-9ad1-4eb27878ca68/konnectivity-agent/0.log"
May 21 16:07:30.476790 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:30.476755    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-73.ec2.internal_8868faa81f1fa41a44d4049608427735/haproxy/0.log"
May 21 16:07:36.754030 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:36.753944    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9e086c5b-eb09-41bb-9605-7ae2d2ad345a/alertmanager/0.log"
May 21 16:07:36.778809 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:36.778779    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9e086c5b-eb09-41bb-9605-7ae2d2ad345a/config-reloader/0.log"
May 21 16:07:36.798489 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:36.798462    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9e086c5b-eb09-41bb-9605-7ae2d2ad345a/kube-rbac-proxy-web/0.log"
May 21 16:07:36.820397 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:36.820340    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9e086c5b-eb09-41bb-9605-7ae2d2ad345a/kube-rbac-proxy/0.log"
May 21 16:07:36.840392 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:36.840335    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9e086c5b-eb09-41bb-9605-7ae2d2ad345a/kube-rbac-proxy-metric/0.log"
May 21 16:07:36.860538 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:36.860508    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9e086c5b-eb09-41bb-9605-7ae2d2ad345a/prom-label-proxy/0.log"
May 21 16:07:36.881907 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:36.881867    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9e086c5b-eb09-41bb-9605-7ae2d2ad345a/init-config-reloader/0.log"
May 21 16:07:36.920302 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:36.920247    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-2mxqr_3a9db6ef-d398-4685-b493-d4413f18216b/cluster-monitoring-operator/0.log"
May 21 16:07:37.158702 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:37.158659    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-frpqj_58380163-c364-4a3d-92a7-b256b590c38f/node-exporter/0.log"
May 21 16:07:37.179154 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:37.179121    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-frpqj_58380163-c364-4a3d-92a7-b256b590c38f/kube-rbac-proxy/0.log"
May 21 16:07:37.199440 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:37.199414    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-frpqj_58380163-c364-4a3d-92a7-b256b590c38f/init-textfile/0.log"
May 21 16:07:37.298993 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:37.298955    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-bk85s_1d030417-7063-40d7-80cd-7732da0989bb/kube-rbac-proxy-main/0.log"
May 21 16:07:37.324581 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:37.324551    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-bk85s_1d030417-7063-40d7-80cd-7732da0989bb/kube-rbac-proxy-self/0.log"
May 21 16:07:37.344400 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:37.344368    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-bk85s_1d030417-7063-40d7-80cd-7732da0989bb/openshift-state-metrics/0.log"
May 21 16:07:37.390004 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:37.389875    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57908494-bacf-436c-af62-2ab9fe92e66f/prometheus/0.log"
May 21 16:07:37.411485 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:37.411414    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57908494-bacf-436c-af62-2ab9fe92e66f/config-reloader/0.log"
May 21 16:07:37.433370 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:37.433336    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57908494-bacf-436c-af62-2ab9fe92e66f/thanos-sidecar/0.log"
May 21 16:07:37.453934 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:37.453901    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57908494-bacf-436c-af62-2ab9fe92e66f/kube-rbac-proxy-web/0.log"
May 21 16:07:37.475737 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:37.475707    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57908494-bacf-436c-af62-2ab9fe92e66f/kube-rbac-proxy/0.log"
May 21 16:07:37.495292 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:37.495243    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57908494-bacf-436c-af62-2ab9fe92e66f/kube-rbac-proxy-thanos/0.log"
May 21 16:07:37.519859 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:37.519826    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57908494-bacf-436c-af62-2ab9fe92e66f/init-config-reloader/0.log"
May 21 16:07:37.546237 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:37.546203    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-qkm4z_53841a71-2844-4102-88aa-69eb82c128db/prometheus-operator/0.log"
May 21 16:07:37.565302 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:37.565270    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-qkm4z_53841a71-2844-4102-88aa-69eb82c128db/kube-rbac-proxy/0.log"
May 21 16:07:37.683964 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:37.683892    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-687b844f85-kpgpq_76ce92de-a2a4-4185-b19f-8c6a513e115e/thanos-query/0.log"
May 21 16:07:37.704564 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:37.704519    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-687b844f85-kpgpq_76ce92de-a2a4-4185-b19f-8c6a513e115e/kube-rbac-proxy-web/0.log"
May 21 16:07:37.728690 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:37.728664    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-687b844f85-kpgpq_76ce92de-a2a4-4185-b19f-8c6a513e115e/kube-rbac-proxy/0.log"
May 21 16:07:37.761564 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:37.761538    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-687b844f85-kpgpq_76ce92de-a2a4-4185-b19f-8c6a513e115e/prom-label-proxy/0.log"
May 21 16:07:37.782909 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:37.782883    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-687b844f85-kpgpq_76ce92de-a2a4-4185-b19f-8c6a513e115e/kube-rbac-proxy-rules/0.log"
May 21 16:07:37.805094 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:37.805066    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-687b844f85-kpgpq_76ce92de-a2a4-4185-b19f-8c6a513e115e/kube-rbac-proxy-metrics/0.log"
May 21 16:07:38.868842 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:38.868805    2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p2kzh/perf-node-gather-daemonset-nx77z"]
May 21 16:07:38.876432 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:38.876400    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-nx77z"
May 21 16:07:38.881820 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:38.881782    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2kzh/perf-node-gather-daemonset-nx77z"]
May 21 16:07:39.001961 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:39.001574    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/adf93d55-acb6-465a-b5a3-5d4f3807a35b-sys\") pod \"perf-node-gather-daemonset-nx77z\" (UID: \"adf93d55-acb6-465a-b5a3-5d4f3807a35b\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-nx77z"
May 21 16:07:39.001961 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:39.001674    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/adf93d55-acb6-465a-b5a3-5d4f3807a35b-podres\") pod \"perf-node-gather-daemonset-nx77z\" (UID: \"adf93d55-acb6-465a-b5a3-5d4f3807a35b\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-nx77z"
May 21 16:07:39.001961 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:39.001705    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hjw2\" (UniqueName: \"kubernetes.io/projected/adf93d55-acb6-465a-b5a3-5d4f3807a35b-kube-api-access-4hjw2\") pod \"perf-node-gather-daemonset-nx77z\" (UID: \"adf93d55-acb6-465a-b5a3-5d4f3807a35b\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-nx77z"
May 21 16:07:39.001961 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:39.001809    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/adf93d55-acb6-465a-b5a3-5d4f3807a35b-lib-modules\") pod \"perf-node-gather-daemonset-nx77z\" (UID: \"adf93d55-acb6-465a-b5a3-5d4f3807a35b\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-nx77z"
May 21 16:07:39.001961 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:39.001851    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/adf93d55-acb6-465a-b5a3-5d4f3807a35b-proc\") pod \"perf-node-gather-daemonset-nx77z\" (UID: \"adf93d55-acb6-465a-b5a3-5d4f3807a35b\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-nx77z"
May 21 16:07:39.102359 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:39.102321    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/adf93d55-acb6-465a-b5a3-5d4f3807a35b-podres\") pod \"perf-node-gather-daemonset-nx77z\" (UID: \"adf93d55-acb6-465a-b5a3-5d4f3807a35b\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-nx77z"
May 21 16:07:39.102359 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:39.102355    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4hjw2\" (UniqueName: \"kubernetes.io/projected/adf93d55-acb6-465a-b5a3-5d4f3807a35b-kube-api-access-4hjw2\") pod \"perf-node-gather-daemonset-nx77z\" (UID: \"adf93d55-acb6-465a-b5a3-5d4f3807a35b\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-nx77z"
May 21 16:07:39.102629 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:39.102437    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/adf93d55-acb6-465a-b5a3-5d4f3807a35b-lib-modules\") pod \"perf-node-gather-daemonset-nx77z\" (UID: \"adf93d55-acb6-465a-b5a3-5d4f3807a35b\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-nx77z"
May 21 16:07:39.102629 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:39.102472    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/adf93d55-acb6-465a-b5a3-5d4f3807a35b-proc\") pod \"perf-node-gather-daemonset-nx77z\" (UID: \"adf93d55-acb6-465a-b5a3-5d4f3807a35b\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-nx77z"
May 21 16:07:39.102629 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:39.102498    2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/adf93d55-acb6-465a-b5a3-5d4f3807a35b-sys\") pod \"perf-node-gather-daemonset-nx77z\" (UID: \"adf93d55-acb6-465a-b5a3-5d4f3807a35b\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-nx77z"
May 21 16:07:39.102629 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:39.102528    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/adf93d55-acb6-465a-b5a3-5d4f3807a35b-podres\") pod \"perf-node-gather-daemonset-nx77z\" (UID: \"adf93d55-acb6-465a-b5a3-5d4f3807a35b\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-nx77z"
May 21 16:07:39.102629 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:39.102607    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/adf93d55-acb6-465a-b5a3-5d4f3807a35b-sys\") pod \"perf-node-gather-daemonset-nx77z\" (UID: \"adf93d55-acb6-465a-b5a3-5d4f3807a35b\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-nx77z"
May 21 16:07:39.102907 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:39.102646    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/adf93d55-acb6-465a-b5a3-5d4f3807a35b-lib-modules\") pod \"perf-node-gather-daemonset-nx77z\" (UID: \"adf93d55-acb6-465a-b5a3-5d4f3807a35b\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-nx77z"
May 21 16:07:39.102907 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:39.102656    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/adf93d55-acb6-465a-b5a3-5d4f3807a35b-proc\") pod \"perf-node-gather-daemonset-nx77z\" (UID: \"adf93d55-acb6-465a-b5a3-5d4f3807a35b\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-nx77z"
May 21 16:07:39.110802 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:39.110771    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hjw2\" (UniqueName: \"kubernetes.io/projected/adf93d55-acb6-465a-b5a3-5d4f3807a35b-kube-api-access-4hjw2\") pod \"perf-node-gather-daemonset-nx77z\" (UID: \"adf93d55-acb6-465a-b5a3-5d4f3807a35b\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-nx77z"
May 21 16:07:39.191544 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:39.191511    2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-nx77z"
May 21 16:07:39.364318 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:39.364236    2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2kzh/perf-node-gather-daemonset-nx77z"]
May 21 16:07:40.376612 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:40.376565    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-nx77z" event={"ID":"adf93d55-acb6-465a-b5a3-5d4f3807a35b","Type":"ContainerStarted","Data":"ead39f0b0ccd58935e5035ece8e3720284a2c22b3faf76c917682f8c43e04ca4"}
May 21 16:07:40.376612 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:40.376619    2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-nx77z" event={"ID":"adf93d55-acb6-465a-b5a3-5d4f3807a35b","Type":"ContainerStarted","Data":"d1c474b6234107c36684c89f7460233ba0ef2636c7976a2d4960fd7f48523b80"}
May 21 16:07:40.377091 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:40.376748    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-nx77z"
May 21 16:07:40.392049 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:40.391991    2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-nx77z" podStartSLOduration=2.39197464 podStartE2EDuration="2.39197464s" podCreationTimestamp="2026-05-21 16:07:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:07:40.391363699 +0000 UTC m=+2121.111526237" watchObservedRunningTime="2026-05-21 16:07:40.39197464 +0000 UTC m=+2121.112137179"
May 21 16:07:40.537250 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:40.537223    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-xzpgh_7ea046a2-e402-4da5-8256-363d4c7f6e51/volume-data-source-validator/0.log"
May 21 16:07:41.355215 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:41.355183    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-frrjc_048c373f-4ec1-416d-9720-992cc8c4a7d7/dns/0.log"
May 21 16:07:41.374570 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:41.374539    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-frrjc_048c373f-4ec1-416d-9720-992cc8c4a7d7/kube-rbac-proxy/0.log"
May 21 16:07:41.529953 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:41.529911    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l6g95_3ef54bf7-c851-42e8-ab07-955a73e57e37/dns-node-resolver/0.log"
May 21 16:07:41.994703 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:41.994671    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2475j_f35e19d1-88d3-4e8d-82de-1531dff0c058/node-ca/0.log"
May 21 16:07:43.083495 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:43.083468    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bc586767c-995lg_d6d4a708-8b03-4097-8d47-786cd77399f3/kube-auth-proxy/0.log"
May 21 16:07:43.163794 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:43.163763    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7df95f575-kl2tj_1621ed22-6820-4cf0-8007-f8de8431d5d0/istio-proxy/0.log"
May 21 16:07:43.746345 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:43.746316    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-79k9q_c5ac7608-600f-40c3-96e3-7d09db3d0aeb/serve-healthcheck-canary/0.log"
May 21 16:07:44.207820 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:44.207793    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-6r828_f3525871-7436-4b57-b837-22389075c03f/insights-operator/0.log"
May 21 16:07:44.208186 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:44.208025    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-6r828_f3525871-7436-4b57-b837-22389075c03f/insights-operator/1.log"
May 21 16:07:44.290237 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:44.290208    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wnbcd_6c868d1c-1548-47d4-9d62-540c80a091a5/kube-rbac-proxy/0.log"
May 21 16:07:44.309241 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:44.309210    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wnbcd_6c868d1c-1548-47d4-9d62-540c80a091a5/exporter/0.log"
May 21 16:07:44.327910 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:44.327884    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wnbcd_6c868d1c-1548-47d4-9d62-540c80a091a5/extractor/0.log"
May 21 16:07:46.359530 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:46.359501    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6f8c5878d5-rlkvg_8e8a3d65-a9fb-4606-953a-26832b378e58/maas-api/0.log"
May 21 16:07:46.391814 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:46.391773    2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-nx77z"
May 21 16:07:46.445417 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:46.445385    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-78bbf8f7d6-6nx6k_c482a8d3-b120-40c0-bec0-96d119330abd/manager/0.log"
May 21 16:07:46.548687 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:46.548657    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5544b565-k5zb7_25647832-639e-4fd2-97c1-cc9398c366e6/manager/0.log"
May 21 16:07:46.590842 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:46.590798    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-txz52_7300bd52-f735-4048-9ac2-292559ff17fa/postgres/0.log"
May 21 16:07:47.899300 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:47.899252    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7665979896-mj6dk_474dfac0-c187-4da6-8ed4-07cf022b14d4/manager/0.log"
May 21 16:07:52.282124 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:52.282093    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-vlbrx_99413cb0-9815-45fa-a822-c2a9e98a1666/migrator/0.log"
May 21 16:07:52.302749 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:52.302721    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-vlbrx_99413cb0-9815-45fa-a822-c2a9e98a1666/graceful-termination/0.log"
May 21 16:07:52.679041 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:52.678977    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-nsf22_3a9b516d-7367-4b03-80f2-79812b492374/kube-storage-version-migrator-operator/1.log"
May 21 16:07:52.679963 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:52.679941    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-nsf22_3a9b516d-7367-4b03-80f2-79812b492374/kube-storage-version-migrator-operator/0.log"
May 21 16:07:54.176973 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:54.176947    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t6f6l_7e482850-fd92-4d57-a98e-522e62d88ffa/kube-multus-additional-cni-plugins/0.log"
May 21 16:07:54.196902 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:54.196875    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t6f6l_7e482850-fd92-4d57-a98e-522e62d88ffa/egress-router-binary-copy/0.log"
May 21 16:07:54.219339 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:54.219312    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t6f6l_7e482850-fd92-4d57-a98e-522e62d88ffa/cni-plugins/0.log"
May 21 16:07:54.240552 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:54.240521    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t6f6l_7e482850-fd92-4d57-a98e-522e62d88ffa/bond-cni-plugin/0.log"
May 21 16:07:54.261534 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:54.261506    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t6f6l_7e482850-fd92-4d57-a98e-522e62d88ffa/routeoverride-cni/0.log"
May 21 16:07:54.281454 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:54.281433    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t6f6l_7e482850-fd92-4d57-a98e-522e62d88ffa/whereabouts-cni-bincopy/0.log"
May 21 16:07:54.302954 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:54.302927    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t6f6l_7e482850-fd92-4d57-a98e-522e62d88ffa/whereabouts-cni/0.log"
May 21 16:07:54.333158 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:54.333131    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cglf2_071a38d4-2377-4a03-b258-06c9d1751226/kube-multus/0.log"
May 21 16:07:54.501624 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:54.501550    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x7ttm_a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0/network-metrics-daemon/0.log"
May 21 16:07:54.522192 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:54.522162    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x7ttm_a8cc8955-2ba7-4f0c-8de0-cf324f3a49f0/kube-rbac-proxy/0.log"
May 21 16:07:55.398100 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:55.398062    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-479rw_51dfd7d4-035e-4e8a-9b2a-efd072576313/ovn-controller/0.log"
May 21 16:07:55.429230 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:55.429203    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-479rw_51dfd7d4-035e-4e8a-9b2a-efd072576313/ovn-acl-logging/0.log"
May 21 16:07:55.447291 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:55.447249    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-479rw_51dfd7d4-035e-4e8a-9b2a-efd072576313/kube-rbac-proxy-node/0.log"
May 21 16:07:55.468242 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:55.468218    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-479rw_51dfd7d4-035e-4e8a-9b2a-efd072576313/kube-rbac-proxy-ovn-metrics/0.log"
May 21 16:07:55.485144 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:55.485117    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-479rw_51dfd7d4-035e-4e8a-9b2a-efd072576313/northd/0.log"
May 21 16:07:55.504348 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:55.504317    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-479rw_51dfd7d4-035e-4e8a-9b2a-efd072576313/nbdb/0.log"
May 21 16:07:55.523195 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:55.523167    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-479rw_51dfd7d4-035e-4e8a-9b2a-efd072576313/sbdb/0.log"
May 21 16:07:55.631498 ip-10-0-132-73 kubenswrapper[2552]: I0521 16:07:55.631405    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-479rw_51dfd7d4-035e-4e8a-9b2a-efd072576313/ovnkube-controller/0.log"