May 21 21:21:04.072009 ip-10-0-133-99 systemd[1]: Starting Kubernetes Kubelet... May 21 21:21:04.481705 ip-10-0-133-99 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 21:21:04.481705 ip-10-0-133-99 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 21:21:04.481705 ip-10-0-133-99 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 21:21:04.481705 ip-10-0-133-99 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 21:21:04.482393 ip-10-0-133-99 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 21:21:04.482702 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.482601 2572 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 21:21:04.485480 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485464 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 21:21:04.485480 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485480 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 21:21:04.485541 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485485 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 21:21:04.485541 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485488 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 21:21:04.485541 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485491 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 21:21:04.485541 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485495 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 21:21:04.485541 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485498 2572 feature_gate.go:328] unrecognized feature gate: Example May 21 21:21:04.485541 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485501 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 21:21:04.485541 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485504 2572 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 21:21:04.485541 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485507 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 21:21:04.485541 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485510 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 21:21:04.485541 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485512 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 21:21:04.485541 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485515 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 21:21:04.485541 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485517 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 21:21:04.485541 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485520 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 21:21:04.485541 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485522 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 21:21:04.485541 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485525 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 21:21:04.485541 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485527 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 21:21:04.485541 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485530 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 21:21:04.485541 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485533 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 21:21:04.485541 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485535 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 21:21:04.485541 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485538 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 21:21:04.486050 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485547 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 21:21:04.486050 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485550 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 21:21:04.486050 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485553 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 21:21:04.486050 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485556 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 21:21:04.486050 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485559 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 21:21:04.486050 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485562 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 21:21:04.486050 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485564 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 21:21:04.486050 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485567 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 21:21:04.486050 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485569 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 21:21:04.486050 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485572 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 21:21:04.486050 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485574 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 21:21:04.486050 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485579 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 21:21:04.486050 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485582 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 21:21:04.486050 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485585 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 21:21:04.486050 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485588 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 21:21:04.486050 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485591 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 21:21:04.486050 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485594 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 21:21:04.486050 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485597 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 21:21:04.486050 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485599 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 21:21:04.486634 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485602 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 21:21:04.486634 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485605 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 21:21:04.486634 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485608 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 21:21:04.486634 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485610 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 21:21:04.486634 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485613 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 21:21:04.486634 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485615 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 21:21:04.486634 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485618 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 21:21:04.486634 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485620 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 21:21:04.486634 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485623 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 21:21:04.486634 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485626 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 21:21:04.486634 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485628 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 21:21:04.486634 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485631 2572 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 21:21:04.486634 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485633 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 21:21:04.486634 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485636 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 21:21:04.486634 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485642 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 21:21:04.486634 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485646 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 21:21:04.486634 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485649 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 21:21:04.486634 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485651 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 21:21:04.486634 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485654 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 21:21:04.487139 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485657 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 21:21:04.487139 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485660 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 21:21:04.487139 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485662 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 21:21:04.487139 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485665 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 21:21:04.487139 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485667 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 21:21:04.487139 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485670 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 21:21:04.487139 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485673 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 21:21:04.487139 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485675 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 21:21:04.487139 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485678 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 21:21:04.487139 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485680 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 21:21:04.487139 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485683 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 21:21:04.487139 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485697 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 21:21:04.487139 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485700 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 21:21:04.487139 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485703 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 21:21:04.487139 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485705 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 21:21:04.487139 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485708 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 21:21:04.487139 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485711 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 21:21:04.487139 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485714 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 21:21:04.487139 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485716 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 21:21:04.487139 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485719 2572 feature_gate.go:328] unrecognized feature gate: Example2 May 21 21:21:04.487139 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485721 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 21:21:04.487642 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485724 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 21:21:04.487642 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485726 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 21:21:04.487642 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485729 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 21:21:04.487642 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485731 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 21:21:04.487642 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.485735 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 21:21:04.487642 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486119 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 21:21:04.487642 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486125 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 21:21:04.487642 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486128 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 21:21:04.487642 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486131 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 21:21:04.487642 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486134 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 21:21:04.487642 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486137 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 21:21:04.487642 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486140 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 21:21:04.487642 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486142 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 21:21:04.487642 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486145 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 21:21:04.487642 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486148 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 21:21:04.487642 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486150 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 21:21:04.487642 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486153 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 21:21:04.487642 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486156 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 21:21:04.487642 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486159 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 21:21:04.487642 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486161 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 21:21:04.488156 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486164 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 21:21:04.488156 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486166 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 21:21:04.488156 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486169 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 21:21:04.488156 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486172 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 21:21:04.488156 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486174 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 21:21:04.488156 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486177 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 21:21:04.488156 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486180 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 21:21:04.488156 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486183 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 21:21:04.488156 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486185 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 21:21:04.488156 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486188 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 21:21:04.488156 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486191 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 21:21:04.488156 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486194 2572 feature_gate.go:328] unrecognized feature gate: Example May 21 21:21:04.488156 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486196 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 21:21:04.488156 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486199 2572 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 21:21:04.488156 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486201 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 21:21:04.488156 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486203 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 21:21:04.488156 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486206 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 21:21:04.488156 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486209 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 21:21:04.488156 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486213 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 21:21:04.488156 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486215 2572 feature_gate.go:328] unrecognized feature gate: Example2 May 21 21:21:04.488702 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486218 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 21:21:04.488702 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486221 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 21:21:04.488702 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486223 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 21:21:04.488702 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486226 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 21:21:04.488702 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486228 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 21:21:04.488702 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486231 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 21:21:04.488702 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486233 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 21:21:04.488702 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486236 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 21:21:04.488702 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486238 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 21:21:04.488702 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486241 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 21:21:04.488702 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486243 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 21:21:04.488702 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486245 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 21:21:04.488702 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486248 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 21:21:04.488702 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486250 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 21:21:04.488702 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486253 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 21:21:04.488702 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486255 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 21:21:04.488702 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486258 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 21:21:04.488702 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486260 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 21:21:04.488702 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486264 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 21:21:04.489176 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486269 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 21:21:04.489176 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486274 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 21:21:04.489176 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486277 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 21:21:04.489176 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486280 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 21:21:04.489176 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486282 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 21:21:04.489176 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486285 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 21:21:04.489176 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486287 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 21:21:04.489176 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486290 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 21:21:04.489176 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486292 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 21:21:04.489176 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486295 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 21:21:04.489176 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486297 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 21:21:04.489176 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486300 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 21:21:04.489176 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486302 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 21:21:04.489176 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486305 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 21:21:04.489176 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486308 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 21:21:04.489176 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486310 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 21:21:04.489176 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486313 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 21:21:04.489176 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486315 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 21:21:04.489176 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486319 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 21:21:04.489676 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486321 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 21:21:04.489676 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486324 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 21:21:04.489676 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486327 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 21:21:04.489676 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486329 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 21:21:04.489676 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486332 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 21:21:04.489676 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486334 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 21:21:04.489676 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486337 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 21:21:04.489676 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486339 2572 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 21:21:04.489676 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486341 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 21:21:04.489676 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486344 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 21:21:04.489676 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486346 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 21:21:04.489676 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486349 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 21:21:04.489676 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.486351 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 21:21:04.489676 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486425 2572 flags.go:64] FLAG: --address="0.0.0.0" May 21 21:21:04.489676 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486434 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 21:21:04.489676 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486447 2572 flags.go:64] FLAG: --anonymous-auth="true" May 21 21:21:04.489676 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486453 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 21:21:04.489676 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486457 2572 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 21:21:04.489676 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486460 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 21:21:04.489676 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486465 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 21:21:04.489676 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486469 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 21:21:04.490218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486473 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 21:21:04.490218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486476 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 21:21:04.490218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486480 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 21:21:04.490218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486483 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 21:21:04.490218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486486 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 21:21:04.490218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486489 2572 flags.go:64] FLAG: --cgroup-root="" May 21 21:21:04.490218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486492 2572 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 21:21:04.490218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486495 2572 flags.go:64] FLAG: --client-ca-file="" May 21 21:21:04.490218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486498 2572 flags.go:64] FLAG: --cloud-config="" May 21 21:21:04.490218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486501 2572 flags.go:64] FLAG: --cloud-provider="external" May 21 21:21:04.490218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486504 2572 flags.go:64] FLAG: --cluster-dns="[]" May 21 21:21:04.490218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486509 2572 flags.go:64] FLAG: --cluster-domain="" May 21 21:21:04.490218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486512 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 21:21:04.490218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486516 2572 flags.go:64] FLAG: --config-dir="" May 21 21:21:04.490218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486518 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 21:21:04.490218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486522 2572 flags.go:64] FLAG: --container-log-max-files="5" May 21 21:21:04.490218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486526 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 21:21:04.490218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486529 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 21:21:04.490218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486532 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 21:21:04.490218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486535 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 21:21:04.490218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486538 2572 flags.go:64] FLAG: --contention-profiling="false" May 21 21:21:04.490218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486541 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 21:21:04.490218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486544 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 21:21:04.490218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486547 2572 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 21:21:04.490218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486550 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 21:21:04.490843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486554 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 21:21:04.490843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486558 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 21:21:04.490843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486561 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 21:21:04.490843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486564 2572 flags.go:64] FLAG: --enable-load-reader="false" May 21 21:21:04.490843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486567 2572 flags.go:64] FLAG: --enable-server="true" May 21 21:21:04.490843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486570 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 21:21:04.490843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486574 2572 flags.go:64] FLAG: --event-burst="100" May 21 21:21:04.490843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486577 2572 flags.go:64] FLAG: --event-qps="50" May 21 21:21:04.490843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486579 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 21:21:04.490843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486583 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 21:21:04.490843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486586 2572 flags.go:64] FLAG: --eviction-hard="" May 21 21:21:04.490843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486589 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 21:21:04.490843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486592 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 21:21:04.490843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486595 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 21:21:04.490843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486599 2572 flags.go:64] FLAG: --eviction-soft="" May 21 21:21:04.490843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486602 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 21:21:04.490843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486604 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 21:21:04.490843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486607 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 21:21:04.490843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486610 2572 flags.go:64] FLAG: --experimental-mounter-path="" May 21 21:21:04.490843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486613 2572 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 21:21:04.490843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486616 2572 flags.go:64] FLAG: --fail-swap-on="true" May 21 21:21:04.490843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486619 2572 flags.go:64] FLAG: --feature-gates="" May 21 21:21:04.490843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486623 2572 flags.go:64] FLAG: --file-check-frequency="20s" May 21 21:21:04.490843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486626 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 21:21:04.490843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486629 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 21:21:04.491478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486632 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 21:21:04.491478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486635 2572 flags.go:64] FLAG: --healthz-port="10248" May 21 21:21:04.491478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486638 2572 flags.go:64] FLAG: --help="false" May 21 21:21:04.491478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486642 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-133-99.ec2.internal" May 21 21:21:04.491478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486646 2572 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 21:21:04.491478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486649 2572 flags.go:64] FLAG: --http-check-frequency="20s" May 21 21:21:04.491478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486652 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 21:21:04.491478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486656 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 21:21:04.491478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486659 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 21:21:04.491478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486662 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 21:21:04.491478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486665 2572 flags.go:64] FLAG: --image-service-endpoint="" May 21 21:21:04.491478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486668 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 21:21:04.491478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486671 2572 flags.go:64] FLAG: --kube-api-burst="100" May 21 21:21:04.491478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486674 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 21:21:04.491478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486677 2572 flags.go:64] FLAG: --kube-api-qps="50" May 21 21:21:04.491478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486680 2572 flags.go:64] FLAG: --kube-reserved="" May 21 21:21:04.491478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486683 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 21:21:04.491478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486701 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 21:21:04.491478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486704 2572 flags.go:64] FLAG: --kubelet-cgroups="" May 21 21:21:04.491478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486707 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 21:21:04.491478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486710 2572 flags.go:64] FLAG: --lock-file="" May 21 21:21:04.491478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486713 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 21:21:04.491478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486716 2572 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 21:21:04.491478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486719 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 21:21:04.492075 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486725 2572 flags.go:64] FLAG: --log-json-split-stream="false" May 21 21:21:04.492075 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486728 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 21:21:04.492075 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486731 2572 flags.go:64] FLAG: --log-text-split-stream="false" May 21 21:21:04.492075 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486734 2572 flags.go:64] FLAG: --logging-format="text" May 21 21:21:04.492075 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486736 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 21:21:04.492075 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486740 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 21:21:04.492075 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486742 2572 flags.go:64] FLAG: --manifest-url="" May 21 21:21:04.492075 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486745 2572 flags.go:64] FLAG: --manifest-url-header="" May 21 21:21:04.492075 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486750 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 21:21:04.492075 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486752 2572 flags.go:64] FLAG: --max-open-files="1000000" May 21 21:21:04.492075 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486757 2572 flags.go:64] FLAG: --max-pods="110" May 21 21:21:04.492075 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486760 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 21:21:04.492075 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486763 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 21:21:04.492075 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486766 2572 flags.go:64] FLAG: --memory-manager-policy="None" May 21 21:21:04.492075 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486770 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 21:21:04.492075 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486773 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 21:21:04.492075 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486775 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 21:21:04.492075 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486778 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 21:21:04.492075 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486789 2572 flags.go:64] FLAG: --node-status-max-images="50" May 21 21:21:04.492075 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486792 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 21:21:04.492075 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486796 2572 flags.go:64] FLAG: --oom-score-adj="-999" May 21 21:21:04.492075 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486799 2572 flags.go:64] FLAG: --pod-cidr="" May 21 21:21:04.492075 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486802 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486807 2572 flags.go:64] FLAG: --pod-manifest-path="" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486810 2572 flags.go:64] FLAG: --pod-max-pids="-1" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486814 2572 flags.go:64] FLAG: --pods-per-core="0" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486817 2572 flags.go:64] FLAG: --port="10250" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486820 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486823 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0366223ca964655fb" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486826 2572 flags.go:64] FLAG: --qos-reserved="" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486829 2572 flags.go:64] FLAG: --read-only-port="10255" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486832 2572 flags.go:64] FLAG: --register-node="true" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486835 2572 flags.go:64] FLAG: --register-schedulable="true" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486837 2572 flags.go:64] FLAG: --register-with-taints="" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486841 2572 flags.go:64] FLAG: --registry-burst="10" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486844 2572 flags.go:64] FLAG: --registry-qps="5" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486847 2572 flags.go:64] FLAG: --reserved-cpus="" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486850 2572 flags.go:64] FLAG: --reserved-memory="" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486853 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486856 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486859 2572 flags.go:64] FLAG: --rotate-certificates="false" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486862 2572 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486865 2572 flags.go:64] FLAG: --runonce="false" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486868 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486871 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486874 2572 flags.go:64] FLAG: --seccomp-default="false" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486877 2572 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486880 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 21:21:04.492622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486883 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 21:21:04.493267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486886 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 21:21:04.493267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486889 2572 flags.go:64] FLAG: --storage-driver-password="root" May 21 21:21:04.493267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486893 2572 flags.go:64] FLAG: --storage-driver-secure="false" May 21 21:21:04.493267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486896 2572 flags.go:64] FLAG: --storage-driver-table="stats" May 21 21:21:04.493267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486899 2572 flags.go:64] FLAG: --storage-driver-user="root" May 21 21:21:04.493267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486902 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 21:21:04.493267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486905 2572 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 21:21:04.493267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486907 2572 flags.go:64] FLAG: --system-cgroups="" May 21 21:21:04.493267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486910 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 21:21:04.493267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486915 2572 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 21:21:04.493267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486918 2572 flags.go:64] FLAG: --tls-cert-file="" May 21 21:21:04.493267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486921 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 21:21:04.493267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486926 2572 flags.go:64] FLAG: --tls-min-version="" May 21 21:21:04.493267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486929 2572 flags.go:64] FLAG: --tls-private-key-file="" May 21 21:21:04.493267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486932 2572 flags.go:64] FLAG: --topology-manager-policy="none" May 21 21:21:04.493267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486935 2572 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 21:21:04.493267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486938 2572 flags.go:64] FLAG: --topology-manager-scope="container" May 21 21:21:04.493267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486941 2572 flags.go:64] FLAG: --v="2" May 21 21:21:04.493267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486945 2572 flags.go:64] FLAG: --version="false" May 21 21:21:04.493267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486949 2572 flags.go:64] FLAG: --vmodule="" May 21 21:21:04.493267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486953 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 21:21:04.493267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.486956 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 21:21:04.493267 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487045 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 21:21:04.493267 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487050 2572 feature_gate.go:328] unrecognized feature gate: Example May 21 21:21:04.493854 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487053 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 21:21:04.493854 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487056 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 21:21:04.493854 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487059 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 21:21:04.493854 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487061 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 21:21:04.493854 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487064 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 21:21:04.493854 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487067 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 21:21:04.493854 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487070 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 21:21:04.493854 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487073 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 21:21:04.493854 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487075 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 21:21:04.493854 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487078 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 21:21:04.493854 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487080 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 21:21:04.493854 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487084 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 21:21:04.493854 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487087 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 21:21:04.493854 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487090 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 21:21:04.493854 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487092 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 21:21:04.493854 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487095 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 21:21:04.493854 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487097 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 21:21:04.493854 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487100 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 21:21:04.493854 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487103 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 21:21:04.493854 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487105 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 21:21:04.494365 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487108 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 21:21:04.494365 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487113 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 21:21:04.494365 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487116 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 21:21:04.494365 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487118 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 21:21:04.494365 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487121 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 21:21:04.494365 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487124 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 21:21:04.494365 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487126 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 21:21:04.494365 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487129 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 21:21:04.494365 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487132 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 21:21:04.494365 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487134 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 21:21:04.494365 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487137 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 21:21:04.494365 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487140 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 21:21:04.494365 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487143 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 21:21:04.494365 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487146 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 21:21:04.494365 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487148 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 21:21:04.494365 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487151 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 21:21:04.494365 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487154 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 21:21:04.494365 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487157 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 21:21:04.494365 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487159 2572 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 21:21:04.494365 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487162 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 21:21:04.494868 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487164 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 21:21:04.494868 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487167 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 21:21:04.494868 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487170 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 21:21:04.494868 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487172 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 21:21:04.494868 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487175 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 21:21:04.494868 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487178 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 21:21:04.494868 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487180 2572 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 21:21:04.494868 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487183 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 21:21:04.494868 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487186 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 21:21:04.494868 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487188 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 21:21:04.494868 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487191 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 21:21:04.494868 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487193 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 21:21:04.494868 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487196 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 21:21:04.494868 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487203 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 21:21:04.494868 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487206 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 21:21:04.494868 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487209 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 21:21:04.494868 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487211 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 21:21:04.494868 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487214 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 21:21:04.494868 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487218 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 21:21:04.495350 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487221 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 21:21:04.495350 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487224 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 21:21:04.495350 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487227 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 21:21:04.495350 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487229 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 21:21:04.495350 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487232 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 21:21:04.495350 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487235 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 21:21:04.495350 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487238 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 21:21:04.495350 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487241 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 21:21:04.495350 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487243 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 21:21:04.495350 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487246 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 21:21:04.495350 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487251 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 21:21:04.495350 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487255 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 21:21:04.495350 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487258 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 21:21:04.495350 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487261 2572 feature_gate.go:328] unrecognized feature gate: Example2 May 21 21:21:04.495350 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487264 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 21:21:04.495350 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487266 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 21:21:04.495350 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487269 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 21:21:04.495350 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487271 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 21:21:04.495350 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487274 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 21:21:04.495889 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487277 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 21:21:04.495889 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487279 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 21:21:04.495889 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487282 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 21:21:04.495889 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487284 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 21:21:04.495889 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487287 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 21:21:04.495889 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.487290 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 21:21:04.495889 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.487993 2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 21:21:04.495889 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.494327 2572 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 21:21:04.495889 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.494343 2572 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 21:21:04.495889 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494392 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 21:21:04.495889 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494398 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 21:21:04.495889 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494402 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 21:21:04.495889 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494405 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 21:21:04.495889 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494408 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 21:21:04.495889 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494411 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 21:21:04.496268 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494414 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 21:21:04.496268 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494417 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 21:21:04.496268 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494420 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 21:21:04.496268 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494422 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 21:21:04.496268 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494425 2572 feature_gate.go:328] unrecognized feature gate: Example May 21 21:21:04.496268 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494429 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 21:21:04.496268 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494434 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 21:21:04.496268 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494437 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 21:21:04.496268 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494439 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 21:21:04.496268 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494442 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 21:21:04.496268 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494446 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 21:21:04.496268 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494448 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 21:21:04.496268 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494451 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 21:21:04.496268 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494454 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 21:21:04.496268 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494456 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 21:21:04.496268 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494459 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 21:21:04.496268 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494465 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 21:21:04.496268 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494468 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 21:21:04.496268 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494470 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 21:21:04.496749 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494474 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 21:21:04.496749 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494478 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 21:21:04.496749 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494481 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 21:21:04.496749 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494484 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 21:21:04.496749 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494486 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 21:21:04.496749 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494489 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 21:21:04.496749 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494492 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 21:21:04.496749 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494496 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 21:21:04.496749 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494498 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 21:21:04.496749 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494501 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 21:21:04.496749 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494503 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 21:21:04.496749 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494506 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 21:21:04.496749 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494509 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 21:21:04.496749 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494511 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 21:21:04.496749 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494514 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 21:21:04.496749 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494517 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 21:21:04.496749 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494519 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 21:21:04.496749 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494522 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 21:21:04.496749 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494524 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 21:21:04.497213 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494528 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 21:21:04.497213 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494530 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 21:21:04.497213 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494533 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 21:21:04.497213 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494535 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 21:21:04.497213 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494538 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 21:21:04.497213 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494541 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 21:21:04.497213 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494543 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 21:21:04.497213 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494546 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 21:21:04.497213 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494549 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 21:21:04.497213 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494551 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 21:21:04.497213 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494554 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 21:21:04.497213 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494558 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 21:21:04.497213 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494561 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 21:21:04.497213 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494564 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 21:21:04.497213 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494566 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 21:21:04.497213 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494569 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 21:21:04.497213 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494571 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 21:21:04.497213 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494574 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 21:21:04.497213 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494577 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 21:21:04.497213 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494579 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 21:21:04.497708 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494582 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 21:21:04.497708 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494585 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 21:21:04.497708 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494587 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 21:21:04.497708 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494590 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 21:21:04.497708 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494592 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 21:21:04.497708 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494595 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 21:21:04.497708 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494597 2572 feature_gate.go:328] unrecognized feature gate: Example2 May 21 21:21:04.497708 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494600 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 21:21:04.497708 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494602 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 21:21:04.497708 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494605 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 21:21:04.497708 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494608 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 21:21:04.497708 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494610 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 21:21:04.497708 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494613 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 21:21:04.497708 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494616 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 21:21:04.497708 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494618 2572 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 21:21:04.497708 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494621 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 21:21:04.497708 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494623 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 21:21:04.497708 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494626 2572 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 21:21:04.497708 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494628 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 21:21:04.497708 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494631 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 21:21:04.498208 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494633 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 21:21:04.498208 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494636 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 21:21:04.498208 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.494641 2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 21:21:04.498208 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494750 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 21:21:04.498208 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494756 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 21:21:04.498208 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494760 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 21:21:04.498208 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494762 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 21:21:04.498208 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494766 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 21:21:04.498208 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494769 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 21:21:04.498208 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494772 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 21:21:04.498208 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494775 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 21:21:04.498208 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494779 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 21:21:04.498208 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494783 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 21:21:04.498208 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494786 2572 feature_gate.go:328] unrecognized feature gate: Example2 May 21 21:21:04.498208 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494789 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 21:21:04.498632 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494792 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 21:21:04.498632 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494795 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 21:21:04.498632 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494797 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 21:21:04.498632 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494800 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 21:21:04.498632 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494803 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 21:21:04.498632 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494806 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 21:21:04.498632 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494808 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 21:21:04.498632 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494811 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 21:21:04.498632 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494813 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 21:21:04.498632 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494816 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 21:21:04.498632 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494818 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 21:21:04.498632 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494821 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 21:21:04.498632 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494823 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 21:21:04.498632 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494826 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 21:21:04.498632 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494828 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 21:21:04.498632 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494831 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 21:21:04.498632 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494834 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 21:21:04.498632 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494837 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 21:21:04.498632 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494839 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 21:21:04.498632 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494842 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 21:21:04.499116 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494845 2572 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 21:21:04.499116 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494848 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 21:21:04.499116 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494850 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 21:21:04.499116 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494853 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 21:21:04.499116 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494855 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 21:21:04.499116 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494858 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 21:21:04.499116 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494861 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 21:21:04.499116 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494863 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 21:21:04.499116 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494866 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 21:21:04.499116 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494868 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 21:21:04.499116 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494871 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 21:21:04.499116 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494874 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 21:21:04.499116 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494877 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 21:21:04.499116 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494879 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 21:21:04.499116 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494882 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 21:21:04.499116 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494885 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 21:21:04.499116 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494887 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 21:21:04.499116 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494889 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 21:21:04.499116 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494892 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 21:21:04.499116 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494895 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 21:21:04.499606 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494897 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 21:21:04.499606 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494900 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 21:21:04.499606 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494902 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 21:21:04.499606 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494905 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 21:21:04.499606 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494907 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 21:21:04.499606 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494909 2572 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 21:21:04.499606 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494912 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 21:21:04.499606 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494914 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 21:21:04.499606 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494917 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 21:21:04.499606 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494919 2572 feature_gate.go:328] unrecognized feature gate: Example May 21 21:21:04.499606 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494922 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 21:21:04.499606 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494924 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 21:21:04.499606 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494927 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 21:21:04.499606 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494930 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 21:21:04.499606 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494932 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 21:21:04.499606 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494935 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 21:21:04.499606 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494938 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 21:21:04.499606 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494940 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 21:21:04.499606 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494943 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 21:21:04.499606 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494945 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 21:21:04.500128 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494948 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 21:21:04.500128 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494951 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 21:21:04.500128 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494953 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 21:21:04.500128 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494956 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 21:21:04.500128 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494958 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 21:21:04.500128 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494961 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 21:21:04.500128 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494963 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 21:21:04.500128 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494965 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 21:21:04.500128 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494968 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 21:21:04.500128 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494971 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 21:21:04.500128 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494973 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 21:21:04.500128 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494976 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 21:21:04.500128 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494978 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 21:21:04.500128 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:04.494980 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 21:21:04.500128 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.494985 2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 21:21:04.500494 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.495089 2572 server.go:962] "Client rotation is on, will bootstrap in background" May 21 21:21:04.500494 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.497375 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 21:21:04.500494 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.498273 2572 server.go:1019] "Starting client certificate rotation" May 21 21:21:04.500494 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.498377 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 21:21:04.500494 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.499139 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 21:21:04.518832 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.518806 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 21:21:04.523503 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.523479 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 21:21:04.535346 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.535325 2572 log.go:25] "Validated CRI v1 runtime API" May 21 21:21:04.542921 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.542900 2572 log.go:25] "Validated CRI v1 image API" May 21 21:21:04.545362 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.545346 2572 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 21:21:04.550115 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.550095 2572 fs.go:135] Filesystem UUIDs: map[492fa281-79e5-4724-9f7a-e185cec7a548:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 aa955b88-a8ac-4a0c-bf52-c0d4167b64d2:/dev/nvme0n1p4] May 21 21:21:04.550185 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.550114 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 21:21:04.555090 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.555065 2572 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 21:21:04.555180 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.554332 2572 manager.go:217] Machine: {Timestamp:2026-05-21 21:21:04.553842596 +0000 UTC m=+0.375440008 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103388 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e1ca9222cf8384cd05d2885f175a0 SystemUUID:ec2e1ca9-222c-f838-4cd0-5d2885f175a0 BootID:93630d2e-946d-4278-b987-b76c2583957f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b0:a8:ad:d1:ad Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b0:a8:ad:d1:ad Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:9b:a4:de:a8:d0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 21:21:04.557054 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.557044 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 21:21:04.557144 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.557132 2572 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 21:21:04.559404 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.559381 2572 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 21:21:04.559541 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.559407 2572 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-99.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 21:21:04.559584 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.559551 2572 topology_manager.go:138] "Creating topology manager with none policy" May 21 21:21:04.559584 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.559560 2572 container_manager_linux.go:306] "Creating device plugin manager" May 21 21:21:04.559584 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.559567 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 21:21:04.560879 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.560868 2572 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 21:21:04.562956 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.562945 2572 state_mem.go:36] "Initialized new in-memory state store" May 21 21:21:04.563062 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.563053 2572 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 21:21:04.565851 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.565842 2572 kubelet.go:491] "Attempting to sync node with API server" May 21 21:21:04.565890 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.565860 2572 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 21:21:04.565890 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.565872 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 21:21:04.565890 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.565884 2572 kubelet.go:397] "Adding apiserver pod source" May 21 21:21:04.566001 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.565893 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 21:21:04.567156 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.567144 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 21:21:04.567198 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.567163 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 21:21:04.570409 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.570392 2572 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 21:21:04.573343 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.573326 2572 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 21:21:04.574424 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.574407 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 21:21:04.574424 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.574427 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 21:21:04.574542 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.574437 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 21:21:04.574542 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.574446 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 21:21:04.574542 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.574455 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 21:21:04.574542 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.574461 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 21:21:04.574542 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.574467 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 21:21:04.574542 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.574473 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 21:21:04.574542 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.574480 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 21:21:04.574542 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.574486 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 21:21:04.574542 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.574507 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 21:21:04.575025 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.575015 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 21:21:04.576098 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.576087 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 21:21:04.576098 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.576099 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 21:21:04.577898 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:04.577871 2572 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 21:21:04.577985 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:04.577967 2572 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-99.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 21:21:04.578087 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.578064 2572 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-99.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 21:21:04.579863 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.579846 2572 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 21:21:04.579946 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.579888 2572 server.go:1295] "Started kubelet" May 21 21:21:04.580029 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.579986 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 21:21:04.580298 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.579977 2572 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 21:21:04.580374 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.580314 2572 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 21:21:04.580656 ip-10-0-133-99 systemd[1]: Started Kubernetes Kubelet. May 21 21:21:04.582120 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.582105 2572 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 21:21:04.582872 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.582856 2572 server.go:317] "Adding debug handlers to kubelet server" May 21 21:21:04.589932 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:04.589914 2572 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 21:21:04.593228 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.593211 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c8flp" May 21 21:21:04.594257 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:04.593171 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-99.ec2.internal.18b1b179d3287a27 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-99.ec2.internal,UID:ip-10-0-133-99.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-99.ec2.internal,},FirstTimestamp:2026-05-21 21:21:04.579861031 +0000 UTC m=+0.401458442,LastTimestamp:2026-05-21 21:21:04.579861031 +0000 UTC m=+0.401458442,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-99.ec2.internal,}" May 21 21:21:04.596334 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.596312 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 21:21:04.597129 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.597116 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 21:21:04.597275 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.597258 2572 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 21:21:04.597382 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.597355 2572 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 21:21:04.597475 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.597304 2572 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 21:21:04.597537 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.597514 2572 reconstruct.go:97] "Volume reconstruction finished" May 21 21:21:04.597537 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.597525 2572 reconciler.go:26] "Reconciler: start to sync state" May 21 21:21:04.598176 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:04.598158 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-99.ec2.internal\" not found" May 21 21:21:04.598486 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.598472 2572 factory.go:55] Registering systemd factory May 21 21:21:04.598547 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.598492 2572 factory.go:223] Registration of the systemd container factory successfully May 21 21:21:04.598718 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.598704 2572 factory.go:153] Registering CRI-O factory May 21 21:21:04.598759 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.598722 2572 factory.go:223] Registration of the crio container factory successfully May 21 21:21:04.598797 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.598773 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 21:21:04.598797 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.598791 2572 factory.go:103] Registering Raw factory May 21 21:21:04.598861 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.598807 2572 manager.go:1196] Started watching for new ooms in manager May 21 21:21:04.599250 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.599237 2572 manager.go:319] Starting recovery of all containers May 21 21:21:04.600867 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.600839 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c8flp" May 21 21:21:04.609439 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.609293 2572 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 21:21:04.609538 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.609455 2572 manager.go:324] Recovery completed May 21 21:21:04.614207 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:04.614188 2572 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-99.ec2.internal\" not found" node="ip-10-0-133-99.ec2.internal" May 21 21:21:04.615016 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.615003 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 21:21:04.616664 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.616650 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasSufficientMemory" May 21 21:21:04.616734 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.616678 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasNoDiskPressure" May 21 21:21:04.616734 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.616723 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasSufficientPID" May 21 21:21:04.617185 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.617170 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 21:21:04.617185 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.617181 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 21:21:04.617273 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.617197 2572 state_mem.go:36] "Initialized new in-memory state store" May 21 21:21:04.619577 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.619566 2572 policy_none.go:49] "None policy: Start" May 21 21:21:04.619616 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.619582 2572 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 21:21:04.619616 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.619592 2572 state_mem.go:35] "Initializing new in-memory state store" May 21 21:21:04.661284 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.661265 2572 manager.go:341] "Starting Device Plugin manager" May 21 21:21:04.673167 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:04.661318 2572 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 21:21:04.673167 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.661333 2572 server.go:85] "Starting device plugin registration server" May 21 21:21:04.673167 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.661580 2572 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 21:21:04.673167 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.661595 2572 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 21:21:04.673167 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.661674 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 21:21:04.673167 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.661771 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 21:21:04.673167 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.661779 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 21:21:04.673167 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:04.662389 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 21:21:04.673167 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:04.662438 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-99.ec2.internal\" not found" May 21 21:21:04.737504 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.737452 2572 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 21:21:04.738551 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.738532 2572 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 21:21:04.738623 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.738562 2572 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 21:21:04.738623 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.738584 2572 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 21:21:04.738623 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.738595 2572 kubelet.go:2451] "Starting kubelet main sync loop" May 21 21:21:04.738740 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:04.738640 2572 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 21:21:04.742072 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.742049 2572 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 21:21:04.762155 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.762137 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 21:21:04.763921 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.763907 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasSufficientMemory" May 21 21:21:04.763990 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.763934 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasNoDiskPressure" May 21 21:21:04.763990 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.763944 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasSufficientPID" May 21 21:21:04.763990 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.763968 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-99.ec2.internal" May 21 21:21:04.774100 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.774081 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-99.ec2.internal" May 21 21:21:04.774175 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:04.774101 2572 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-99.ec2.internal\": node \"ip-10-0-133-99.ec2.internal\" not found" May 21 21:21:04.821281 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:04.821248 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-99.ec2.internal\" not found" May 21 21:21:04.839462 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.839426 2572 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-99.ec2.internal"] May 21 21:21:04.839525 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.839508 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 21:21:04.840838 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.840821 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasSufficientMemory" May 21 21:21:04.840955 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.840851 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasNoDiskPressure" May 21 21:21:04.840955 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.840861 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasSufficientPID" May 21 21:21:04.842016 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.842001 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 21:21:04.842159 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.842146 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" May 21 21:21:04.842193 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.842177 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 21:21:04.842767 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.842752 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasSufficientMemory" May 21 21:21:04.842812 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.842755 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasSufficientMemory" May 21 21:21:04.842812 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.842781 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasNoDiskPressure" May 21 21:21:04.842812 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.842794 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasSufficientPID" May 21 21:21:04.842812 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.842797 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasNoDiskPressure" May 21 21:21:04.842812 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.842807 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasSufficientPID" May 21 21:21:04.843903 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.843890 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-99.ec2.internal" May 21 21:21:04.843957 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.843913 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 21:21:04.844566 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.844543 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasSufficientMemory" May 21 21:21:04.844566 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.844561 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasNoDiskPressure" May 21 21:21:04.844658 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.844570 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasSufficientPID" May 21 21:21:04.874299 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:04.874281 2572 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-99.ec2.internal\" not found" node="ip-10-0-133-99.ec2.internal" May 21 21:21:04.878641 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:04.878625 2572 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-99.ec2.internal\" not found" node="ip-10-0-133-99.ec2.internal" May 21 21:21:04.899282 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.899267 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1bcfa917a54ac6563779f94fbfd3a99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal\" (UID: \"b1bcfa917a54ac6563779f94fbfd3a99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" May 21 21:21:04.899356 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.899289 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1bcfa917a54ac6563779f94fbfd3a99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal\" (UID: \"b1bcfa917a54ac6563779f94fbfd3a99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" May 21 21:21:04.899356 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.899306 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f60ea2db76896f8a68dfa4cecb6168b4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-99.ec2.internal\" (UID: \"f60ea2db76896f8a68dfa4cecb6168b4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-99.ec2.internal" May 21 21:21:04.921530 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:04.921511 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-99.ec2.internal\" not found" May 21 21:21:04.999833 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.999744 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1bcfa917a54ac6563779f94fbfd3a99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal\" (UID: \"b1bcfa917a54ac6563779f94fbfd3a99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" May 21 21:21:04.999833 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.999791 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1bcfa917a54ac6563779f94fbfd3a99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal\" (UID: \"b1bcfa917a54ac6563779f94fbfd3a99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" May 21 21:21:04.999833 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.999822 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1bcfa917a54ac6563779f94fbfd3a99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal\" (UID: \"b1bcfa917a54ac6563779f94fbfd3a99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" May 21 21:21:04.999833 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.999837 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1bcfa917a54ac6563779f94fbfd3a99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal\" (UID: \"b1bcfa917a54ac6563779f94fbfd3a99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" May 21 21:21:05.000049 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.999891 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f60ea2db76896f8a68dfa4cecb6168b4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-99.ec2.internal\" (UID: \"f60ea2db76896f8a68dfa4cecb6168b4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-99.ec2.internal" May 21 21:21:05.000049 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:04.999919 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f60ea2db76896f8a68dfa4cecb6168b4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-99.ec2.internal\" (UID: \"f60ea2db76896f8a68dfa4cecb6168b4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-99.ec2.internal" May 21 21:21:05.021985 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:05.021961 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-99.ec2.internal\" not found" May 21 21:21:05.122597 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:05.122571 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-99.ec2.internal\" not found" May 21 21:21:05.177764 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.177735 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" May 21 21:21:05.182509 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.182492 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-99.ec2.internal" May 21 21:21:05.223021 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:05.222997 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-99.ec2.internal\" not found" May 21 21:21:05.323527 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:05.323452 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-99.ec2.internal\" not found" May 21 21:21:05.423980 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:05.423948 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-99.ec2.internal\" not found" May 21 21:21:05.498184 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.498151 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 21:21:05.498715 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.498310 2572 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 21:21:05.498715 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.498318 2572 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 21:21:05.524587 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:05.524560 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-99.ec2.internal\" not found" May 21 21:21:05.542882 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.542857 2572 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 21:21:05.566860 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.566838 2572 apiserver.go:52] "Watching apiserver" May 21 21:21:05.575174 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.575120 2572 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 21:21:05.577474 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.577442 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-lrz84","openshift-image-registry/node-ca-r8qsv","openshift-multus/multus-dxvcp","openshift-network-diagnostics/network-check-target-wmgw6","openshift-ovn-kubernetes/ovnkube-node-cs2zq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn","openshift-cluster-node-tuning-operator/tuned-8wxpk","openshift-dns/node-resolver-rzckq","openshift-multus/multus-additional-cni-plugins-c2csm","openshift-multus/network-metrics-daemon-f84fj","openshift-network-operator/iptables-alerter-km4hl"] May 21 21:21:05.578861 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.578842 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lrz84" May 21 21:21:05.579938 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.579917 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dxvcp" May 21 21:21:05.581131 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.581113 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 21:21:05.581229 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.581149 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n8n94\"" May 21 21:21:05.581229 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.581168 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.581229 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.581152 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 21:21:05.582317 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.582298 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 21:21:05.582430 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.582323 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 21:21:05.582490 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.582464 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" May 21 21:21:05.582490 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.582480 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 21:21:05.584466 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.583008 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rzc8h\"" May 21 21:21:05.584466 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.583183 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 21:21:05.584466 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.584078 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 21:21:05.584466 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.584155 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 21:21:05.584466 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.584386 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 21:21:05.584751 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.584508 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 21:21:05.585398 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.585383 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 21:21:05.585730 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.585711 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rzckq" May 21 21:21:05.585838 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.585796 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 21:21:05.585934 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.585713 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4xzfr\"" May 21 21:21:05.586081 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.586065 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 21:21:05.586599 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.586583 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 21:21:05.586753 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.586740 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6v8cd\"" May 21 21:21:05.586897 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.586882 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 21:21:05.587026 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.587012 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:05.587106 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:05.587088 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f84fj" podUID="36b197d1-1cdf-47d2-9c86-c8b3e1dbe565" May 21 21:21:05.587879 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.587866 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 21:21:05.587935 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.587921 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4qhs9\"" May 21 21:21:05.588164 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.588150 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 21:21:05.588257 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.588243 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r8qsv" May 21 21:21:05.589423 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.589410 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:05.589479 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:05.589454 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmgw6" podUID="00cfcf38-19fe-4241-b6dc-3d464c44f2d1" May 21 21:21:05.590232 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.590220 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 21:21:05.590485 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.590468 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.590559 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.590541 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 21:21:05.590622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.590591 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 21:21:05.590673 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.590633 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m5gns\"" May 21 21:21:05.591619 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.591604 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.592682 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.592655 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-km4hl" May 21 21:21:05.592682 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.592678 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 21:21:05.592840 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.592725 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 21:21:05.592840 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.592779 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m5sh6\"" May 21 21:21:05.593428 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.593414 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-h9vjt\"" May 21 21:21:05.593653 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.593638 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 21:21:05.593782 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.593767 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 21:21:05.594861 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.594844 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 21:21:05.594950 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.594919 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5rfxv\"" May 21 21:21:05.595002 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.594981 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 21:21:05.595194 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.595178 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 21:21:05.596587 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.596574 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 21:21:05.597991 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.597976 2572 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-99.ec2.internal" May 21 21:21:05.598709 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.598674 2572 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 21:21:05.602763 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.602747 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-node-log\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.602845 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.602775 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-host-cni-netd\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.602845 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.602803 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d31096e-e77f-4f67-a945-72f8f000b896-cni-binary-copy\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.602925 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.602846 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-host-var-lib-cni-multus\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.602925 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.602870 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1-sys-fs\") pod \"aws-ebs-csi-driver-node-trckn\" (UID: \"ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" May 21 21:21:05.602925 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.602885 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9262dc43-0cc0-4446-a8d4-570955a0442e-serviceca\") pod \"node-ca-r8qsv\" (UID: \"9262dc43-0cc0-4446-a8d4-570955a0442e\") " pod="openshift-image-registry/node-ca-r8qsv" May 21 21:21:05.602925 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.602919 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl9mp\" (UniqueName: \"kubernetes.io/projected/6e5c7f2a-57a0-4291-974b-4414efc916e1-kube-api-access-zl9mp\") pod \"multus-additional-cni-plugins-c2csm\" (UID: \"6e5c7f2a-57a0-4291-974b-4414efc916e1\") " pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.603073 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.602942 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2739574e-acb3-4fca-8dfd-03ec5801a1e1-agent-certs\") pod \"konnectivity-agent-lrz84\" (UID: \"2739574e-acb3-4fca-8dfd-03ec5801a1e1\") " pod="kube-system/konnectivity-agent-lrz84" May 21 21:21:05.603073 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.602959 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-host-var-lib-kubelet\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.603073 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.602981 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxhr6\" (UniqueName: \"kubernetes.io/projected/ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1-kube-api-access-nxhr6\") pod \"aws-ebs-csi-driver-node-trckn\" (UID: \"ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" May 21 21:21:05.603073 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603003 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-etc-modprobe-d\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.603073 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603032 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-etc-sysctl-conf\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.603073 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603061 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6e5c7f2a-57a0-4291-974b-4414efc916e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c2csm\" (UID: \"6e5c7f2a-57a0-4291-974b-4414efc916e1\") " pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.603342 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603103 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6e5c7f2a-57a0-4291-974b-4414efc916e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c2csm\" (UID: \"6e5c7f2a-57a0-4291-974b-4414efc916e1\") " pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.603342 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603129 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jplr\" (UniqueName: \"kubernetes.io/projected/64964f5a-350d-4d54-87ca-b1a3151533b0-kube-api-access-9jplr\") pod \"iptables-alerter-km4hl\" (UID: \"64964f5a-350d-4d54-87ca-b1a3151533b0\") " pod="openshift-network-operator/iptables-alerter-km4hl" May 21 21:21:05.603342 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603152 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-host-cni-bin\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.603342 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603176 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-hostroot\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.603342 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603220 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-run\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.603342 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603256 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-sys\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.603342 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603287 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-multus-socket-dir-parent\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.603342 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603310 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-host-slash\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.603342 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603336 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c8ddeadf-53c9-4198-8334-76cbdd1832c2-ovnkube-script-lib\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.603663 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603358 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-tmp\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.603663 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603386 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/64964f5a-350d-4d54-87ca-b1a3151533b0-iptables-alerter-script\") pod \"iptables-alerter-km4hl\" (UID: \"64964f5a-350d-4d54-87ca-b1a3151533b0\") " pod="openshift-network-operator/iptables-alerter-km4hl" May 21 21:21:05.603663 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603417 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3d5474a2-32a3-4370-8e73-79b7ecbf4fd6-hosts-file\") pod \"node-resolver-rzckq\" (UID: \"3d5474a2-32a3-4370-8e73-79b7ecbf4fd6\") " pod="openshift-dns/node-resolver-rzckq" May 21 21:21:05.603663 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603455 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e5c7f2a-57a0-4291-974b-4414efc916e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-c2csm\" (UID: \"6e5c7f2a-57a0-4291-974b-4414efc916e1\") " pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.603663 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603477 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/64964f5a-350d-4d54-87ca-b1a3151533b0-host-slash\") pod \"iptables-alerter-km4hl\" (UID: \"64964f5a-350d-4d54-87ca-b1a3151533b0\") " pod="openshift-network-operator/iptables-alerter-km4hl" May 21 21:21:05.603663 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603495 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-host-run-ovn-kubernetes\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.603663 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603509 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs\") pod \"network-metrics-daemon-f84fj\" (UID: \"36b197d1-1cdf-47d2-9c86-c8b3e1dbe565\") " pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:05.603663 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603537 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c8ddeadf-53c9-4198-8334-76cbdd1832c2-ovn-node-metrics-cert\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.603663 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603555 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-etc-tuned\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.603663 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603569 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8dbg\" (UniqueName: \"kubernetes.io/projected/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-kube-api-access-z8dbg\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.603663 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603557 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 21:16:04 +0000 UTC" deadline="2028-01-02 05:15:45.919188387 +0000 UTC" May 21 21:21:05.603663 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603587 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e5c7f2a-57a0-4291-974b-4414efc916e1-system-cni-dir\") pod \"multus-additional-cni-plugins-c2csm\" (UID: \"6e5c7f2a-57a0-4291-974b-4414efc916e1\") " pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.603663 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603593 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14167h54m40.315598448s" May 21 21:21:05.603663 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603604 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-etc-openvswitch\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.603663 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603628 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-log-socket\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.603663 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603643 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9262dc43-0cc0-4446-a8d4-570955a0442e-host\") pod \"node-ca-r8qsv\" (UID: \"9262dc43-0cc0-4446-a8d4-570955a0442e\") " pod="openshift-image-registry/node-ca-r8qsv" May 21 21:21:05.603663 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603656 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-etc-sysctl-d\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.604373 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603670 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2739574e-acb3-4fca-8dfd-03ec5801a1e1-konnectivity-ca\") pod \"konnectivity-agent-lrz84\" (UID: \"2739574e-acb3-4fca-8dfd-03ec5801a1e1\") " pod="kube-system/konnectivity-agent-lrz84" May 21 21:21:05.604373 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603708 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-host-run-k8s-cni-cncf-io\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.604373 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603725 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxpdg\" (UniqueName: \"kubernetes.io/projected/8d31096e-e77f-4f67-a945-72f8f000b896-kube-api-access-bxpdg\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.604373 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603740 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cgcg\" (UniqueName: \"kubernetes.io/projected/c8ddeadf-53c9-4198-8334-76cbdd1832c2-kube-api-access-6cgcg\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.604373 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603754 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-os-release\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.604373 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603796 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-host-run-netns\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.604373 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603822 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-trckn\" (UID: \"ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" May 21 21:21:05.604373 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603849 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-var-lib-kubelet\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.604373 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603873 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e5c7f2a-57a0-4291-974b-4414efc916e1-cnibin\") pod \"multus-additional-cni-plugins-c2csm\" (UID: \"6e5c7f2a-57a0-4291-974b-4414efc916e1\") " pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.604373 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603898 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-multus-cni-dir\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.604373 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603934 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-run-openvswitch\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.604373 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603965 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.604373 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.603987 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-etc-kubernetes\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.604373 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604005 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54x9v\" (UniqueName: \"kubernetes.io/projected/9262dc43-0cc0-4446-a8d4-570955a0442e-kube-api-access-54x9v\") pod \"node-ca-r8qsv\" (UID: \"9262dc43-0cc0-4446-a8d4-570955a0442e\") " pod="openshift-image-registry/node-ca-r8qsv" May 21 21:21:05.604373 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604021 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-host-var-lib-cni-bin\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.604373 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604040 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-host-run-netns\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.605001 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604061 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-run-systemd\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.605001 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604077 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j425p\" (UniqueName: \"kubernetes.io/projected/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-kube-api-access-j425p\") pod \"network-metrics-daemon-f84fj\" (UID: \"36b197d1-1cdf-47d2-9c86-c8b3e1dbe565\") " pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:05.605001 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604091 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1-device-dir\") pod \"aws-ebs-csi-driver-node-trckn\" (UID: \"ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" May 21 21:21:05.605001 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604104 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-etc-kubernetes\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.605001 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604125 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e5c7f2a-57a0-4291-974b-4414efc916e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c2csm\" (UID: \"6e5c7f2a-57a0-4291-974b-4414efc916e1\") " pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.605001 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604154 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-systemd-units\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.605001 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604175 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-trckn\" (UID: \"ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" May 21 21:21:05.605001 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604191 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-etc-systemd\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.605001 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604211 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-host-run-multus-certs\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.605001 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604239 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d5474a2-32a3-4370-8e73-79b7ecbf4fd6-tmp-dir\") pod \"node-resolver-rzckq\" (UID: \"3d5474a2-32a3-4370-8e73-79b7ecbf4fd6\") " pod="openshift-dns/node-resolver-rzckq" May 21 21:21:05.605001 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604253 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsg2v\" (UniqueName: \"kubernetes.io/projected/00cfcf38-19fe-4241-b6dc-3d464c44f2d1-kube-api-access-rsg2v\") pod \"network-check-target-wmgw6\" (UID: \"00cfcf38-19fe-4241-b6dc-3d464c44f2d1\") " pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:05.605001 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604306 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-etc-sysconfig\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.605001 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604347 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-lib-modules\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.605001 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604369 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-host\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.605001 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604390 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-system-cni-dir\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.605001 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604412 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-multus-conf-dir\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.605426 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604434 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8d31096e-e77f-4f67-a945-72f8f000b896-multus-daemon-config\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.605426 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604458 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e5c7f2a-57a0-4291-974b-4414efc916e1-os-release\") pod \"multus-additional-cni-plugins-c2csm\" (UID: \"6e5c7f2a-57a0-4291-974b-4414efc916e1\") " pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.605426 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604480 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-run-ovn\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.605426 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604508 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn8k5\" (UniqueName: \"kubernetes.io/projected/3d5474a2-32a3-4370-8e73-79b7ecbf4fd6-kube-api-access-sn8k5\") pod \"node-resolver-rzckq\" (UID: \"3d5474a2-32a3-4370-8e73-79b7ecbf4fd6\") " pod="openshift-dns/node-resolver-rzckq" May 21 21:21:05.605426 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604533 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1-socket-dir\") pod \"aws-ebs-csi-driver-node-trckn\" (UID: \"ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" May 21 21:21:05.605426 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604559 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-host-kubelet\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.605426 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604582 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c8ddeadf-53c9-4198-8334-76cbdd1832c2-ovnkube-config\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.605426 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604606 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c8ddeadf-53c9-4198-8334-76cbdd1832c2-env-overrides\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.605426 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604629 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1-registration-dir\") pod \"aws-ebs-csi-driver-node-trckn\" (UID: \"ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" May 21 21:21:05.605426 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604664 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-cnibin\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.605426 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.604705 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-var-lib-openvswitch\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.605783 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.605585 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-99.ec2.internal"] May 21 21:21:05.606419 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.606406 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 21:21:05.606473 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.606453 2572 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" May 21 21:21:05.609589 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.609567 2572 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 21:21:05.618838 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.618648 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 21:21:05.618998 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.618980 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal"] May 21 21:21:05.683583 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.683555 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dxn7b" May 21 21:21:05.691752 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.691734 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dxn7b" May 21 21:21:05.705213 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705192 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-etc-tuned\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.705309 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705219 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z8dbg\" (UniqueName: \"kubernetes.io/projected/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-kube-api-access-z8dbg\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.705309 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705236 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e5c7f2a-57a0-4291-974b-4414efc916e1-system-cni-dir\") pod \"multus-additional-cni-plugins-c2csm\" (UID: \"6e5c7f2a-57a0-4291-974b-4414efc916e1\") " pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.705309 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705251 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-etc-openvswitch\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.705309 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705267 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-log-socket\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.705513 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705311 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-log-socket\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.705513 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705321 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e5c7f2a-57a0-4291-974b-4414efc916e1-system-cni-dir\") pod \"multus-additional-cni-plugins-c2csm\" (UID: \"6e5c7f2a-57a0-4291-974b-4414efc916e1\") " pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.705513 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705336 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-etc-openvswitch\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.705513 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705407 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9262dc43-0cc0-4446-a8d4-570955a0442e-host\") pod \"node-ca-r8qsv\" (UID: \"9262dc43-0cc0-4446-a8d4-570955a0442e\") " pod="openshift-image-registry/node-ca-r8qsv" May 21 21:21:05.705513 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705430 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-etc-sysctl-d\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.705513 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705456 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9262dc43-0cc0-4446-a8d4-570955a0442e-host\") pod \"node-ca-r8qsv\" (UID: \"9262dc43-0cc0-4446-a8d4-570955a0442e\") " pod="openshift-image-registry/node-ca-r8qsv" May 21 21:21:05.705513 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705455 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2739574e-acb3-4fca-8dfd-03ec5801a1e1-konnectivity-ca\") pod \"konnectivity-agent-lrz84\" (UID: \"2739574e-acb3-4fca-8dfd-03ec5801a1e1\") " pod="kube-system/konnectivity-agent-lrz84" May 21 21:21:05.705513 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705499 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-host-run-k8s-cni-cncf-io\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.705924 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705522 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bxpdg\" (UniqueName: \"kubernetes.io/projected/8d31096e-e77f-4f67-a945-72f8f000b896-kube-api-access-bxpdg\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.705924 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705548 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6cgcg\" (UniqueName: \"kubernetes.io/projected/c8ddeadf-53c9-4198-8334-76cbdd1832c2-kube-api-access-6cgcg\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.705924 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705561 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 21:21:05.705924 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705571 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-os-release\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.705924 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705572 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-etc-sysctl-d\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.705924 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705577 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-host-run-k8s-cni-cncf-io\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.705924 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705606 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-host-run-netns\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.705924 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705632 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-trckn\" (UID: \"ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" May 21 21:21:05.705924 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705652 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-var-lib-kubelet\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.705924 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705653 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-os-release\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.705924 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705668 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e5c7f2a-57a0-4291-974b-4414efc916e1-cnibin\") pod \"multus-additional-cni-plugins-c2csm\" (UID: \"6e5c7f2a-57a0-4291-974b-4414efc916e1\") " pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.705924 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705708 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-multus-cni-dir\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.705924 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705734 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-run-openvswitch\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.705924 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705737 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-var-lib-kubelet\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.705924 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705758 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-trckn\" (UID: \"ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" May 21 21:21:05.705924 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705759 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.705924 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705781 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-host-run-netns\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.705924 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705800 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.706643 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705835 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-etc-kubernetes\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.706643 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705853 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54x9v\" (UniqueName: \"kubernetes.io/projected/9262dc43-0cc0-4446-a8d4-570955a0442e-kube-api-access-54x9v\") pod \"node-ca-r8qsv\" (UID: \"9262dc43-0cc0-4446-a8d4-570955a0442e\") " pod="openshift-image-registry/node-ca-r8qsv" May 21 21:21:05.706643 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705867 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e5c7f2a-57a0-4291-974b-4414efc916e1-cnibin\") pod \"multus-additional-cni-plugins-c2csm\" (UID: \"6e5c7f2a-57a0-4291-974b-4414efc916e1\") " pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.706643 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705881 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-multus-cni-dir\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.706643 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705870 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-host-var-lib-cni-bin\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.706643 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705910 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-host-var-lib-cni-bin\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.706643 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705918 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-run-openvswitch\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.706643 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705941 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-host-run-netns\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.706643 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.705968 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-run-systemd\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.706643 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706000 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j425p\" (UniqueName: \"kubernetes.io/projected/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-kube-api-access-j425p\") pod \"network-metrics-daemon-f84fj\" (UID: \"36b197d1-1cdf-47d2-9c86-c8b3e1dbe565\") " pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:05.706643 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706004 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-host-run-netns\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.706643 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706044 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1-device-dir\") pod \"aws-ebs-csi-driver-node-trckn\" (UID: \"ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" May 21 21:21:05.706643 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706049 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-run-systemd\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.706643 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706003 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2739574e-acb3-4fca-8dfd-03ec5801a1e1-konnectivity-ca\") pod \"konnectivity-agent-lrz84\" (UID: \"2739574e-acb3-4fca-8dfd-03ec5801a1e1\") " pod="kube-system/konnectivity-agent-lrz84" May 21 21:21:05.706643 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706075 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-etc-kubernetes\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.706643 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706101 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e5c7f2a-57a0-4291-974b-4414efc916e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c2csm\" (UID: \"6e5c7f2a-57a0-4291-974b-4414efc916e1\") " pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.706643 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706118 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-etc-kubernetes\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.706643 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706127 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-systemd-units\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.707476 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706136 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1-device-dir\") pod \"aws-ebs-csi-driver-node-trckn\" (UID: \"ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" May 21 21:21:05.707476 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706158 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-trckn\" (UID: \"ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" May 21 21:21:05.707476 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706183 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-systemd-units\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.707476 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706205 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-etc-kubernetes\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.707476 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706216 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-etc-systemd\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.707476 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706241 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-trckn\" (UID: \"ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" May 21 21:21:05.707476 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706244 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-host-run-multus-certs\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.707476 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706262 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-etc-systemd\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.707476 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706261 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e5c7f2a-57a0-4291-974b-4414efc916e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c2csm\" (UID: \"6e5c7f2a-57a0-4291-974b-4414efc916e1\") " pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.707476 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706308 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-host-run-multus-certs\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.707476 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706312 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d5474a2-32a3-4370-8e73-79b7ecbf4fd6-tmp-dir\") pod \"node-resolver-rzckq\" (UID: \"3d5474a2-32a3-4370-8e73-79b7ecbf4fd6\") " pod="openshift-dns/node-resolver-rzckq" May 21 21:21:05.707476 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706339 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rsg2v\" (UniqueName: \"kubernetes.io/projected/00cfcf38-19fe-4241-b6dc-3d464c44f2d1-kube-api-access-rsg2v\") pod \"network-check-target-wmgw6\" (UID: \"00cfcf38-19fe-4241-b6dc-3d464c44f2d1\") " pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:05.707476 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706378 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-etc-sysconfig\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.707476 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706414 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-lib-modules\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.707476 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706436 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-host\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.707476 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706460 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-system-cni-dir\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.707476 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706485 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-multus-conf-dir\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.707476 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706504 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-host\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.708328 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706508 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8d31096e-e77f-4f67-a945-72f8f000b896-multus-daemon-config\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.708328 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706551 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e5c7f2a-57a0-4291-974b-4414efc916e1-os-release\") pod \"multus-additional-cni-plugins-c2csm\" (UID: \"6e5c7f2a-57a0-4291-974b-4414efc916e1\") " pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.708328 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706514 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-lib-modules\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.708328 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706570 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d5474a2-32a3-4370-8e73-79b7ecbf4fd6-tmp-dir\") pod \"node-resolver-rzckq\" (UID: \"3d5474a2-32a3-4370-8e73-79b7ecbf4fd6\") " pod="openshift-dns/node-resolver-rzckq" May 21 21:21:05.708328 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706578 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-etc-sysconfig\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.708328 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706578 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-run-ovn\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.708328 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706614 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sn8k5\" (UniqueName: \"kubernetes.io/projected/3d5474a2-32a3-4370-8e73-79b7ecbf4fd6-kube-api-access-sn8k5\") pod \"node-resolver-rzckq\" (UID: \"3d5474a2-32a3-4370-8e73-79b7ecbf4fd6\") " pod="openshift-dns/node-resolver-rzckq" May 21 21:21:05.708328 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706631 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e5c7f2a-57a0-4291-974b-4414efc916e1-os-release\") pod \"multus-additional-cni-plugins-c2csm\" (UID: \"6e5c7f2a-57a0-4291-974b-4414efc916e1\") " pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.708328 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706634 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-run-ovn\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.708328 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706640 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1-socket-dir\") pod \"aws-ebs-csi-driver-node-trckn\" (UID: \"ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" May 21 21:21:05.708328 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706623 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-system-cni-dir\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.708328 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706677 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-host-kubelet\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.708328 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706716 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c8ddeadf-53c9-4198-8334-76cbdd1832c2-ovnkube-config\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.708328 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706732 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c8ddeadf-53c9-4198-8334-76cbdd1832c2-env-overrides\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.708328 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706738 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-multus-conf-dir\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.708328 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706747 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1-registration-dir\") pod \"aws-ebs-csi-driver-node-trckn\" (UID: \"ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" May 21 21:21:05.708328 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706792 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-cnibin\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.708328 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706821 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-var-lib-openvswitch\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.709145 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706825 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1-registration-dir\") pod \"aws-ebs-csi-driver-node-trckn\" (UID: \"ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" May 21 21:21:05.709145 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706861 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-var-lib-openvswitch\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.709145 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706876 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-cnibin\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.709145 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706890 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-node-log\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.709145 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706914 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-host-kubelet\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.709145 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706925 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1-socket-dir\") pod \"aws-ebs-csi-driver-node-trckn\" (UID: \"ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" May 21 21:21:05.709145 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706969 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-host-cni-netd\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.709145 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.706993 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-host-cni-netd\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.709145 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707030 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d31096e-e77f-4f67-a945-72f8f000b896-cni-binary-copy\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.709145 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707059 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-host-var-lib-cni-multus\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.709145 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707086 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8d31096e-e77f-4f67-a945-72f8f000b896-multus-daemon-config\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.709145 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707081 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1-sys-fs\") pod \"aws-ebs-csi-driver-node-trckn\" (UID: \"ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" May 21 21:21:05.709145 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707033 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-node-log\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.709145 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707140 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9262dc43-0cc0-4446-a8d4-570955a0442e-serviceca\") pod \"node-ca-r8qsv\" (UID: \"9262dc43-0cc0-4446-a8d4-570955a0442e\") " pod="openshift-image-registry/node-ca-r8qsv" May 21 21:21:05.709145 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707154 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-host-var-lib-cni-multus\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.709145 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707166 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zl9mp\" (UniqueName: \"kubernetes.io/projected/6e5c7f2a-57a0-4291-974b-4414efc916e1-kube-api-access-zl9mp\") pod \"multus-additional-cni-plugins-c2csm\" (UID: \"6e5c7f2a-57a0-4291-974b-4414efc916e1\") " pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.709145 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707192 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2739574e-acb3-4fca-8dfd-03ec5801a1e1-agent-certs\") pod \"konnectivity-agent-lrz84\" (UID: \"2739574e-acb3-4fca-8dfd-03ec5801a1e1\") " pod="kube-system/konnectivity-agent-lrz84" May 21 21:21:05.709145 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707211 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c8ddeadf-53c9-4198-8334-76cbdd1832c2-env-overrides\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.709968 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707217 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-host-var-lib-kubelet\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.709968 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707167 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1-sys-fs\") pod \"aws-ebs-csi-driver-node-trckn\" (UID: \"ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" May 21 21:21:05.709968 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707243 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nxhr6\" (UniqueName: \"kubernetes.io/projected/ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1-kube-api-access-nxhr6\") pod \"aws-ebs-csi-driver-node-trckn\" (UID: \"ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" May 21 21:21:05.709968 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707270 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-etc-modprobe-d\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.709968 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707283 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c8ddeadf-53c9-4198-8334-76cbdd1832c2-ovnkube-config\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.709968 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707292 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-etc-sysctl-conf\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.709968 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707318 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6e5c7f2a-57a0-4291-974b-4414efc916e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c2csm\" (UID: \"6e5c7f2a-57a0-4291-974b-4414efc916e1\") " pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.709968 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707349 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6e5c7f2a-57a0-4291-974b-4414efc916e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c2csm\" (UID: \"6e5c7f2a-57a0-4291-974b-4414efc916e1\") " pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.709968 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707374 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9jplr\" (UniqueName: \"kubernetes.io/projected/64964f5a-350d-4d54-87ca-b1a3151533b0-kube-api-access-9jplr\") pod \"iptables-alerter-km4hl\" (UID: \"64964f5a-350d-4d54-87ca-b1a3151533b0\") " pod="openshift-network-operator/iptables-alerter-km4hl" May 21 21:21:05.709968 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707420 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-host-cni-bin\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.709968 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707448 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-hostroot\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.709968 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707462 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-host-var-lib-kubelet\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.709968 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707472 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-run\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.709968 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707484 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d31096e-e77f-4f67-a945-72f8f000b896-cni-binary-copy\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.709968 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707515 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-sys\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.709968 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707547 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-multus-socket-dir-parent\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.709968 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707566 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-etc-modprobe-d\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.710664 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707571 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9262dc43-0cc0-4446-a8d4-570955a0442e-serviceca\") pod \"node-ca-r8qsv\" (UID: \"9262dc43-0cc0-4446-a8d4-570955a0442e\") " pod="openshift-image-registry/node-ca-r8qsv" May 21 21:21:05.710664 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707576 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-host-slash\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.710664 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707621 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c8ddeadf-53c9-4198-8334-76cbdd1832c2-ovnkube-script-lib\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.710664 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707626 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-run\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.710664 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707641 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-sys\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.710664 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707646 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-multus-socket-dir-parent\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.710664 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707652 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-tmp\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.710664 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707592 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-etc-sysctl-conf\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.710664 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707674 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-host-cni-bin\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.710664 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707679 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/64964f5a-350d-4d54-87ca-b1a3151533b0-iptables-alerter-script\") pod \"iptables-alerter-km4hl\" (UID: \"64964f5a-350d-4d54-87ca-b1a3151533b0\") " pod="openshift-network-operator/iptables-alerter-km4hl" May 21 21:21:05.710664 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707714 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-host-slash\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.710664 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707735 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3d5474a2-32a3-4370-8e73-79b7ecbf4fd6-hosts-file\") pod \"node-resolver-rzckq\" (UID: \"3d5474a2-32a3-4370-8e73-79b7ecbf4fd6\") " pod="openshift-dns/node-resolver-rzckq" May 21 21:21:05.710664 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707770 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e5c7f2a-57a0-4291-974b-4414efc916e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-c2csm\" (UID: \"6e5c7f2a-57a0-4291-974b-4414efc916e1\") " pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.710664 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707794 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/64964f5a-350d-4d54-87ca-b1a3151533b0-host-slash\") pod \"iptables-alerter-km4hl\" (UID: \"64964f5a-350d-4d54-87ca-b1a3151533b0\") " pod="openshift-network-operator/iptables-alerter-km4hl" May 21 21:21:05.710664 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707793 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3d5474a2-32a3-4370-8e73-79b7ecbf4fd6-hosts-file\") pod \"node-resolver-rzckq\" (UID: \"3d5474a2-32a3-4370-8e73-79b7ecbf4fd6\") " pod="openshift-dns/node-resolver-rzckq" May 21 21:21:05.710664 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707719 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8d31096e-e77f-4f67-a945-72f8f000b896-hostroot\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.710664 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707862 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/64964f5a-350d-4d54-87ca-b1a3151533b0-host-slash\") pod \"iptables-alerter-km4hl\" (UID: \"64964f5a-350d-4d54-87ca-b1a3151533b0\") " pod="openshift-network-operator/iptables-alerter-km4hl" May 21 21:21:05.710664 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707889 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-host-run-ovn-kubernetes\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.711429 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707919 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs\") pod \"network-metrics-daemon-f84fj\" (UID: \"36b197d1-1cdf-47d2-9c86-c8b3e1dbe565\") " pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:05.711429 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.707955 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c8ddeadf-53c9-4198-8334-76cbdd1832c2-ovn-node-metrics-cert\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.711429 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.708197 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c8ddeadf-53c9-4198-8334-76cbdd1832c2-ovnkube-script-lib\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.711429 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.708254 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8ddeadf-53c9-4198-8334-76cbdd1832c2-host-run-ovn-kubernetes\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.711429 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.708271 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6e5c7f2a-57a0-4291-974b-4414efc916e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c2csm\" (UID: \"6e5c7f2a-57a0-4291-974b-4414efc916e1\") " pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.711429 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:05.708609 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 21:21:05.711429 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:05.708728 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs podName:36b197d1-1cdf-47d2-9c86-c8b3e1dbe565 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:06.208666921 +0000 UTC m=+2.030264343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs") pod "network-metrics-daemon-f84fj" (UID: "36b197d1-1cdf-47d2-9c86-c8b3e1dbe565") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 21:21:05.711429 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.709151 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e5c7f2a-57a0-4291-974b-4414efc916e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-c2csm\" (UID: \"6e5c7f2a-57a0-4291-974b-4414efc916e1\") " pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.711429 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.709183 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/64964f5a-350d-4d54-87ca-b1a3151533b0-iptables-alerter-script\") pod \"iptables-alerter-km4hl\" (UID: \"64964f5a-350d-4d54-87ca-b1a3151533b0\") " pod="openshift-network-operator/iptables-alerter-km4hl" May 21 21:21:05.711429 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.709250 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6e5c7f2a-57a0-4291-974b-4414efc916e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c2csm\" (UID: \"6e5c7f2a-57a0-4291-974b-4414efc916e1\") " pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.711429 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.709417 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-etc-tuned\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.711429 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.710135 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-tmp\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.711429 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.710465 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c8ddeadf-53c9-4198-8334-76cbdd1832c2-ovn-node-metrics-cert\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.711429 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.710847 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2739574e-acb3-4fca-8dfd-03ec5801a1e1-agent-certs\") pod \"konnectivity-agent-lrz84\" (UID: \"2739574e-acb3-4fca-8dfd-03ec5801a1e1\") " pod="kube-system/konnectivity-agent-lrz84" May 21 21:21:05.713321 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:05.713283 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 21:21:05.713321 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:05.713307 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 21:21:05.713321 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:05.713320 2572 projected.go:194] Error preparing data for projected volume kube-api-access-rsg2v for pod openshift-network-diagnostics/network-check-target-wmgw6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 21:21:05.713587 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:05.713385 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00cfcf38-19fe-4241-b6dc-3d464c44f2d1-kube-api-access-rsg2v podName:00cfcf38-19fe-4241-b6dc-3d464c44f2d1 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:06.213367094 +0000 UTC m=+2.034964525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rsg2v" (UniqueName: "kubernetes.io/projected/00cfcf38-19fe-4241-b6dc-3d464c44f2d1-kube-api-access-rsg2v") pod "network-check-target-wmgw6" (UID: "00cfcf38-19fe-4241-b6dc-3d464c44f2d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 21:21:05.715377 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.715351 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cgcg\" (UniqueName: \"kubernetes.io/projected/c8ddeadf-53c9-4198-8334-76cbdd1832c2-kube-api-access-6cgcg\") pod \"ovnkube-node-cs2zq\" (UID: \"c8ddeadf-53c9-4198-8334-76cbdd1832c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.715805 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.715787 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j425p\" (UniqueName: \"kubernetes.io/projected/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-kube-api-access-j425p\") pod \"network-metrics-daemon-f84fj\" (UID: \"36b197d1-1cdf-47d2-9c86-c8b3e1dbe565\") " pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:05.715905 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.715787 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8dbg\" (UniqueName: \"kubernetes.io/projected/26b55d22-fe60-4588-96cb-9cd68b9bbd2a-kube-api-access-z8dbg\") pod \"tuned-8wxpk\" (UID: \"26b55d22-fe60-4588-96cb-9cd68b9bbd2a\") " pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:05.716187 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.716165 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54x9v\" (UniqueName: \"kubernetes.io/projected/9262dc43-0cc0-4446-a8d4-570955a0442e-kube-api-access-54x9v\") pod \"node-ca-r8qsv\" (UID: \"9262dc43-0cc0-4446-a8d4-570955a0442e\") " pod="openshift-image-registry/node-ca-r8qsv" May 21 21:21:05.716745 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.716725 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxpdg\" (UniqueName: \"kubernetes.io/projected/8d31096e-e77f-4f67-a945-72f8f000b896-kube-api-access-bxpdg\") pod \"multus-dxvcp\" (UID: \"8d31096e-e77f-4f67-a945-72f8f000b896\") " pod="openshift-multus/multus-dxvcp" May 21 21:21:05.716858 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.716839 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxhr6\" (UniqueName: \"kubernetes.io/projected/ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1-kube-api-access-nxhr6\") pod \"aws-ebs-csi-driver-node-trckn\" (UID: \"ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" May 21 21:21:05.717198 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.717181 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jplr\" (UniqueName: \"kubernetes.io/projected/64964f5a-350d-4d54-87ca-b1a3151533b0-kube-api-access-9jplr\") pod \"iptables-alerter-km4hl\" (UID: \"64964f5a-350d-4d54-87ca-b1a3151533b0\") " pod="openshift-network-operator/iptables-alerter-km4hl" May 21 21:21:05.717360 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.717343 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl9mp\" (UniqueName: \"kubernetes.io/projected/6e5c7f2a-57a0-4291-974b-4414efc916e1-kube-api-access-zl9mp\") pod \"multus-additional-cni-plugins-c2csm\" (UID: \"6e5c7f2a-57a0-4291-974b-4414efc916e1\") " pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.717410 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.717347 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn8k5\" (UniqueName: \"kubernetes.io/projected/3d5474a2-32a3-4370-8e73-79b7ecbf4fd6-kube-api-access-sn8k5\") pod \"node-resolver-rzckq\" (UID: \"3d5474a2-32a3-4370-8e73-79b7ecbf4fd6\") " pod="openshift-dns/node-resolver-rzckq" May 21 21:21:05.728899 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.728884 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c2csm" May 21 21:21:05.734921 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.734904 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-km4hl" May 21 21:21:05.782424 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:05.782388 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1bcfa917a54ac6563779f94fbfd3a99.slice/crio-7a89effe4ed795973e677c5714a2ff9f598dffabc53e8ef99e9d1b6924b1b577 WatchSource:0}: Error finding container 7a89effe4ed795973e677c5714a2ff9f598dffabc53e8ef99e9d1b6924b1b577: Status 404 returned error can't find the container with id 7a89effe4ed795973e677c5714a2ff9f598dffabc53e8ef99e9d1b6924b1b577 May 21 21:21:05.782661 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:05.782643 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf60ea2db76896f8a68dfa4cecb6168b4.slice/crio-7596473165f0d2bb18ac8a19edbd16f3ee3b08f12b34e6595a6fd23115cd2505 WatchSource:0}: Error finding container 7596473165f0d2bb18ac8a19edbd16f3ee3b08f12b34e6595a6fd23115cd2505: Status 404 returned error can't find the container with id 7596473165f0d2bb18ac8a19edbd16f3ee3b08f12b34e6595a6fd23115cd2505 May 21 21:21:05.785874 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.785858 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 21:21:05.913521 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.913436 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lrz84" May 21 21:21:05.919682 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:05.919659 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2739574e_acb3_4fca_8dfd_03ec5801a1e1.slice/crio-7a18b99b6fe2a59eec456dd9a912b882732df9e794c29b3342cc472cdbc8833d WatchSource:0}: Error finding container 7a18b99b6fe2a59eec456dd9a912b882732df9e794c29b3342cc472cdbc8833d: Status 404 returned error can't find the container with id 7a18b99b6fe2a59eec456dd9a912b882732df9e794c29b3342cc472cdbc8833d May 21 21:21:05.936463 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.936445 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dxvcp" May 21 21:21:05.942306 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:05.942284 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d31096e_e77f_4f67_a945_72f8f000b896.slice/crio-f503c89152ba59977e14dd26143f8fda2a0da091652fb38081261c21df3b0287 WatchSource:0}: Error finding container f503c89152ba59977e14dd26143f8fda2a0da091652fb38081261c21df3b0287: Status 404 returned error can't find the container with id f503c89152ba59977e14dd26143f8fda2a0da091652fb38081261c21df3b0287 May 21 21:21:05.947189 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.947173 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:05.952995 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:05.952972 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8ddeadf_53c9_4198_8334_76cbdd1832c2.slice/crio-0deac09168e079322db16c14954dc672c0c86316d13a9ff0289b59e7403d78aa WatchSource:0}: Error finding container 0deac09168e079322db16c14954dc672c0c86316d13a9ff0289b59e7403d78aa: Status 404 returned error can't find the container with id 0deac09168e079322db16c14954dc672c0c86316d13a9ff0289b59e7403d78aa May 21 21:21:05.966027 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.966006 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" May 21 21:21:05.973036 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:05.973012 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddfca1a3_2415_4f87_bbf1_8cd3919fc3f1.slice/crio-5fd787a9b8dbf69975884f8aa8a317c61d095b5a559ca16ae391097f131f35c5 WatchSource:0}: Error finding container 5fd787a9b8dbf69975884f8aa8a317c61d095b5a559ca16ae391097f131f35c5: Status 404 returned error can't find the container with id 5fd787a9b8dbf69975884f8aa8a317c61d095b5a559ca16ae391097f131f35c5 May 21 21:21:05.977932 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.977909 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rzckq" May 21 21:21:05.983663 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:05.983644 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d5474a2_32a3_4370_8e73_79b7ecbf4fd6.slice/crio-af954278e0ca62a6d25e3592c3c66595598fc9db7bb85355addb6d02edc53a6a WatchSource:0}: Error finding container af954278e0ca62a6d25e3592c3c66595598fc9db7bb85355addb6d02edc53a6a: Status 404 returned error can't find the container with id af954278e0ca62a6d25e3592c3c66595598fc9db7bb85355addb6d02edc53a6a May 21 21:21:05.984353 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.984334 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r8qsv" May 21 21:21:05.990197 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:05.990176 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9262dc43_0cc0_4446_a8d4_570955a0442e.slice/crio-05a084788e4f1e1c013e68e9aa7f1e5c42c1521c1b87c2d1f3f76debeb9416e0 WatchSource:0}: Error finding container 05a084788e4f1e1c013e68e9aa7f1e5c42c1521c1b87c2d1f3f76debeb9416e0: Status 404 returned error can't find the container with id 05a084788e4f1e1c013e68e9aa7f1e5c42c1521c1b87c2d1f3f76debeb9416e0 May 21 21:21:05.999767 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:05.999750 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" May 21 21:21:06.005092 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:06.005071 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26b55d22_fe60_4588_96cb_9cd68b9bbd2a.slice/crio-cd44ff0020c5019d83d7631b43852876285617854d4e111fcca915cff6846f67 WatchSource:0}: Error finding container cd44ff0020c5019d83d7631b43852876285617854d4e111fcca915cff6846f67: Status 404 returned error can't find the container with id cd44ff0020c5019d83d7631b43852876285617854d4e111fcca915cff6846f67 May 21 21:21:06.019731 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:06.019711 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64964f5a_350d_4d54_87ca_b1a3151533b0.slice/crio-e436d0e4c677c7780f4fd53e2dfb2616172b99a7fbc9f531a7861bca273569a9 WatchSource:0}: Error finding container e436d0e4c677c7780f4fd53e2dfb2616172b99a7fbc9f531a7861bca273569a9: Status 404 returned error can't find the container with id e436d0e4c677c7780f4fd53e2dfb2616172b99a7fbc9f531a7861bca273569a9 May 21 21:21:06.022244 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:06.022225 2572 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 21:21:06.026864 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:06.026846 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e5c7f2a_57a0_4291_974b_4414efc916e1.slice/crio-88d1ec0a94a6216117f709cebba7f1b3f0a65280bb7d61d4c118ff1c2a796c8d WatchSource:0}: Error finding container 88d1ec0a94a6216117f709cebba7f1b3f0a65280bb7d61d4c118ff1c2a796c8d: Status 404 returned error can't find the container with id 88d1ec0a94a6216117f709cebba7f1b3f0a65280bb7d61d4c118ff1c2a796c8d May 21 21:21:06.212831 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:06.212748 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs\") pod \"network-metrics-daemon-f84fj\" (UID: \"36b197d1-1cdf-47d2-9c86-c8b3e1dbe565\") " pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:06.212965 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:06.212856 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 21:21:06.212965 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:06.212911 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs podName:36b197d1-1cdf-47d2-9c86-c8b3e1dbe565 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:07.212895109 +0000 UTC m=+3.034492509 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs") pod "network-metrics-daemon-f84fj" (UID: "36b197d1-1cdf-47d2-9c86-c8b3e1dbe565") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 21:21:06.314112 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:06.314069 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rsg2v\" (UniqueName: \"kubernetes.io/projected/00cfcf38-19fe-4241-b6dc-3d464c44f2d1-kube-api-access-rsg2v\") pod \"network-check-target-wmgw6\" (UID: \"00cfcf38-19fe-4241-b6dc-3d464c44f2d1\") " pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:06.314274 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:06.314237 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 21:21:06.314274 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:06.314263 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 21:21:06.314398 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:06.314277 2572 projected.go:194] Error preparing data for projected volume kube-api-access-rsg2v for pod openshift-network-diagnostics/network-check-target-wmgw6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 21:21:06.314398 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:06.314340 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00cfcf38-19fe-4241-b6dc-3d464c44f2d1-kube-api-access-rsg2v podName:00cfcf38-19fe-4241-b6dc-3d464c44f2d1 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:07.314321941 +0000 UTC m=+3.135919354 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rsg2v" (UniqueName: "kubernetes.io/projected/00cfcf38-19fe-4241-b6dc-3d464c44f2d1-kube-api-access-rsg2v") pod "network-check-target-wmgw6" (UID: "00cfcf38-19fe-4241-b6dc-3d464c44f2d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 21:21:06.657583 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:06.657505 2572 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 21:21:06.692810 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:06.692748 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 21:16:05 +0000 UTC" deadline="2028-01-11 06:43:06.505005804 +0000 UTC" May 21 21:21:06.692810 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:06.692783 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14385h21m59.812225803s" May 21 21:21:06.701510 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:06.701486 2572 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 21:21:06.770539 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:06.770480 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" event={"ID":"b1bcfa917a54ac6563779f94fbfd3a99","Type":"ContainerStarted","Data":"7a89effe4ed795973e677c5714a2ff9f598dffabc53e8ef99e9d1b6924b1b577"} May 21 21:21:06.773240 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:06.773211 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" event={"ID":"26b55d22-fe60-4588-96cb-9cd68b9bbd2a","Type":"ContainerStarted","Data":"cd44ff0020c5019d83d7631b43852876285617854d4e111fcca915cff6846f67"} May 21 21:21:06.775222 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:06.775159 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r8qsv" event={"ID":"9262dc43-0cc0-4446-a8d4-570955a0442e","Type":"ContainerStarted","Data":"05a084788e4f1e1c013e68e9aa7f1e5c42c1521c1b87c2d1f3f76debeb9416e0"} May 21 21:21:06.777242 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:06.777216 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rzckq" event={"ID":"3d5474a2-32a3-4370-8e73-79b7ecbf4fd6","Type":"ContainerStarted","Data":"af954278e0ca62a6d25e3592c3c66595598fc9db7bb85355addb6d02edc53a6a"} May 21 21:21:06.786898 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:06.786867 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" event={"ID":"c8ddeadf-53c9-4198-8334-76cbdd1832c2","Type":"ContainerStarted","Data":"0deac09168e079322db16c14954dc672c0c86316d13a9ff0289b59e7403d78aa"} May 21 21:21:06.801920 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:06.801888 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-99.ec2.internal" event={"ID":"f60ea2db76896f8a68dfa4cecb6168b4","Type":"ContainerStarted","Data":"7596473165f0d2bb18ac8a19edbd16f3ee3b08f12b34e6595a6fd23115cd2505"} May 21 21:21:06.808952 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:06.808921 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c2csm" event={"ID":"6e5c7f2a-57a0-4291-974b-4414efc916e1","Type":"ContainerStarted","Data":"88d1ec0a94a6216117f709cebba7f1b3f0a65280bb7d61d4c118ff1c2a796c8d"} May 21 21:21:06.822642 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:06.822610 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-km4hl" event={"ID":"64964f5a-350d-4d54-87ca-b1a3151533b0","Type":"ContainerStarted","Data":"e436d0e4c677c7780f4fd53e2dfb2616172b99a7fbc9f531a7861bca273569a9"} May 21 21:21:06.832942 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:06.832875 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" event={"ID":"ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1","Type":"ContainerStarted","Data":"5fd787a9b8dbf69975884f8aa8a317c61d095b5a559ca16ae391097f131f35c5"} May 21 21:21:06.849613 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:06.849577 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dxvcp" event={"ID":"8d31096e-e77f-4f67-a945-72f8f000b896","Type":"ContainerStarted","Data":"f503c89152ba59977e14dd26143f8fda2a0da091652fb38081261c21df3b0287"} May 21 21:21:06.875302 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:06.875262 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lrz84" event={"ID":"2739574e-acb3-4fca-8dfd-03ec5801a1e1","Type":"ContainerStarted","Data":"7a18b99b6fe2a59eec456dd9a912b882732df9e794c29b3342cc472cdbc8833d"} May 21 21:21:07.222387 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:07.222350 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs\") pod \"network-metrics-daemon-f84fj\" (UID: \"36b197d1-1cdf-47d2-9c86-c8b3e1dbe565\") " pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:07.222576 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:07.222532 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 21:21:07.222639 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:07.222596 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs podName:36b197d1-1cdf-47d2-9c86-c8b3e1dbe565 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:09.222577182 +0000 UTC m=+5.044174588 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs") pod "network-metrics-daemon-f84fj" (UID: "36b197d1-1cdf-47d2-9c86-c8b3e1dbe565") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 21:21:07.323566 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:07.323525 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rsg2v\" (UniqueName: \"kubernetes.io/projected/00cfcf38-19fe-4241-b6dc-3d464c44f2d1-kube-api-access-rsg2v\") pod \"network-check-target-wmgw6\" (UID: \"00cfcf38-19fe-4241-b6dc-3d464c44f2d1\") " pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:07.323778 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:07.323699 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 21:21:07.323778 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:07.323719 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 21:21:07.323778 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:07.323733 2572 projected.go:194] Error preparing data for projected volume kube-api-access-rsg2v for pod openshift-network-diagnostics/network-check-target-wmgw6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 21:21:07.323945 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:07.323793 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00cfcf38-19fe-4241-b6dc-3d464c44f2d1-kube-api-access-rsg2v podName:00cfcf38-19fe-4241-b6dc-3d464c44f2d1 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:09.323774794 +0000 UTC m=+5.145372208 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rsg2v" (UniqueName: "kubernetes.io/projected/00cfcf38-19fe-4241-b6dc-3d464c44f2d1-kube-api-access-rsg2v") pod "network-check-target-wmgw6" (UID: "00cfcf38-19fe-4241-b6dc-3d464c44f2d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 21:21:07.694213 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:07.694114 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 21:16:05 +0000 UTC" deadline="2027-10-27 10:39:17.683691049 +0000 UTC" May 21 21:21:07.694213 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:07.694160 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12565h18m9.989536917s" May 21 21:21:07.739799 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:07.738941 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:07.739799 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:07.739099 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmgw6" podUID="00cfcf38-19fe-4241-b6dc-3d464c44f2d1" May 21 21:21:07.739799 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:07.739617 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:07.739799 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:07.739744 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f84fj" podUID="36b197d1-1cdf-47d2-9c86-c8b3e1dbe565" May 21 21:21:09.239901 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:09.239860 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs\") pod \"network-metrics-daemon-f84fj\" (UID: \"36b197d1-1cdf-47d2-9c86-c8b3e1dbe565\") " pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:09.240361 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:09.240036 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 21:21:09.240361 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:09.240122 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs podName:36b197d1-1cdf-47d2-9c86-c8b3e1dbe565 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:13.240099108 +0000 UTC m=+9.061696513 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs") pod "network-metrics-daemon-f84fj" (UID: "36b197d1-1cdf-47d2-9c86-c8b3e1dbe565") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 21:21:09.340735 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:09.340628 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rsg2v\" (UniqueName: \"kubernetes.io/projected/00cfcf38-19fe-4241-b6dc-3d464c44f2d1-kube-api-access-rsg2v\") pod \"network-check-target-wmgw6\" (UID: \"00cfcf38-19fe-4241-b6dc-3d464c44f2d1\") " pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:09.340936 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:09.340842 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 21:21:09.340936 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:09.340868 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 21:21:09.340936 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:09.340881 2572 projected.go:194] Error preparing data for projected volume kube-api-access-rsg2v for pod openshift-network-diagnostics/network-check-target-wmgw6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 21:21:09.341120 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:09.340947 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00cfcf38-19fe-4241-b6dc-3d464c44f2d1-kube-api-access-rsg2v podName:00cfcf38-19fe-4241-b6dc-3d464c44f2d1 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:13.340925107 +0000 UTC m=+9.162522520 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rsg2v" (UniqueName: "kubernetes.io/projected/00cfcf38-19fe-4241-b6dc-3d464c44f2d1-kube-api-access-rsg2v") pod "network-check-target-wmgw6" (UID: "00cfcf38-19fe-4241-b6dc-3d464c44f2d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 21:21:09.739876 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:09.739778 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:09.739876 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:09.739801 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:09.740117 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:09.739946 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmgw6" podUID="00cfcf38-19fe-4241-b6dc-3d464c44f2d1" May 21 21:21:09.740117 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:09.740093 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f84fj" podUID="36b197d1-1cdf-47d2-9c86-c8b3e1dbe565" May 21 21:21:11.739008 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:11.738968 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:11.739473 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:11.738987 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:11.739473 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:11.739102 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmgw6" podUID="00cfcf38-19fe-4241-b6dc-3d464c44f2d1" May 21 21:21:11.739473 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:11.739180 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f84fj" podUID="36b197d1-1cdf-47d2-9c86-c8b3e1dbe565" May 21 21:21:13.273746 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:13.273704 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs\") pod \"network-metrics-daemon-f84fj\" (UID: \"36b197d1-1cdf-47d2-9c86-c8b3e1dbe565\") " pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:13.274241 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:13.273872 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 21:21:13.274241 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:13.273954 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs podName:36b197d1-1cdf-47d2-9c86-c8b3e1dbe565 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:21.273932793 +0000 UTC m=+17.095530196 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs") pod "network-metrics-daemon-f84fj" (UID: "36b197d1-1cdf-47d2-9c86-c8b3e1dbe565") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 21:21:13.374914 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:13.374860 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rsg2v\" (UniqueName: \"kubernetes.io/projected/00cfcf38-19fe-4241-b6dc-3d464c44f2d1-kube-api-access-rsg2v\") pod \"network-check-target-wmgw6\" (UID: \"00cfcf38-19fe-4241-b6dc-3d464c44f2d1\") " pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:13.375112 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:13.375056 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 21:21:13.375112 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:13.375083 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 21:21:13.375112 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:13.375096 2572 projected.go:194] Error preparing data for projected volume kube-api-access-rsg2v for pod openshift-network-diagnostics/network-check-target-wmgw6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 21:21:13.375265 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:13.375167 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00cfcf38-19fe-4241-b6dc-3d464c44f2d1-kube-api-access-rsg2v podName:00cfcf38-19fe-4241-b6dc-3d464c44f2d1 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:21.375145854 +0000 UTC m=+17.196743261 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rsg2v" (UniqueName: "kubernetes.io/projected/00cfcf38-19fe-4241-b6dc-3d464c44f2d1-kube-api-access-rsg2v") pod "network-check-target-wmgw6" (UID: "00cfcf38-19fe-4241-b6dc-3d464c44f2d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 21:21:13.739715 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:13.739531 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:13.739715 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:13.739675 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmgw6" podUID="00cfcf38-19fe-4241-b6dc-3d464c44f2d1" May 21 21:21:13.740187 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:13.740014 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:13.740187 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:13.740149 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f84fj" podUID="36b197d1-1cdf-47d2-9c86-c8b3e1dbe565" May 21 21:21:15.016200 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:15.016162 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-hgf7j"] May 21 21:21:15.022518 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:15.022490 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:15.022717 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:15.022581 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hgf7j" podUID="c737fef0-1e59-4bb3-bf82-b34b18cb7337" May 21 21:21:15.091036 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:15.090955 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c737fef0-1e59-4bb3-bf82-b34b18cb7337-dbus\") pod \"global-pull-secret-syncer-hgf7j\" (UID: \"c737fef0-1e59-4bb3-bf82-b34b18cb7337\") " pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:15.091222 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:15.091037 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c737fef0-1e59-4bb3-bf82-b34b18cb7337-original-pull-secret\") pod \"global-pull-secret-syncer-hgf7j\" (UID: \"c737fef0-1e59-4bb3-bf82-b34b18cb7337\") " pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:15.091222 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:15.091064 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c737fef0-1e59-4bb3-bf82-b34b18cb7337-kubelet-config\") pod \"global-pull-secret-syncer-hgf7j\" (UID: \"c737fef0-1e59-4bb3-bf82-b34b18cb7337\") " pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:15.192300 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:15.192258 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c737fef0-1e59-4bb3-bf82-b34b18cb7337-original-pull-secret\") pod \"global-pull-secret-syncer-hgf7j\" (UID: \"c737fef0-1e59-4bb3-bf82-b34b18cb7337\") " pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:15.192489 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:15.192312 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c737fef0-1e59-4bb3-bf82-b34b18cb7337-kubelet-config\") pod \"global-pull-secret-syncer-hgf7j\" (UID: \"c737fef0-1e59-4bb3-bf82-b34b18cb7337\") " pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:15.192489 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:15.192439 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 21:21:15.192489 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:15.192471 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c737fef0-1e59-4bb3-bf82-b34b18cb7337-kubelet-config\") pod \"global-pull-secret-syncer-hgf7j\" (UID: \"c737fef0-1e59-4bb3-bf82-b34b18cb7337\") " pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:15.192709 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:15.192438 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c737fef0-1e59-4bb3-bf82-b34b18cb7337-dbus\") pod \"global-pull-secret-syncer-hgf7j\" (UID: \"c737fef0-1e59-4bb3-bf82-b34b18cb7337\") " pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:15.192709 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:15.192511 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c737fef0-1e59-4bb3-bf82-b34b18cb7337-original-pull-secret podName:c737fef0-1e59-4bb3-bf82-b34b18cb7337 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:15.692491653 +0000 UTC m=+11.514089069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c737fef0-1e59-4bb3-bf82-b34b18cb7337-original-pull-secret") pod "global-pull-secret-syncer-hgf7j" (UID: "c737fef0-1e59-4bb3-bf82-b34b18cb7337") : object "kube-system"/"original-pull-secret" not registered May 21 21:21:15.192709 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:15.192582 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c737fef0-1e59-4bb3-bf82-b34b18cb7337-dbus\") pod \"global-pull-secret-syncer-hgf7j\" (UID: \"c737fef0-1e59-4bb3-bf82-b34b18cb7337\") " pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:15.697613 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:15.697566 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c737fef0-1e59-4bb3-bf82-b34b18cb7337-original-pull-secret\") pod \"global-pull-secret-syncer-hgf7j\" (UID: \"c737fef0-1e59-4bb3-bf82-b34b18cb7337\") " pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:15.697815 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:15.697737 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 21:21:15.697815 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:15.697812 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c737fef0-1e59-4bb3-bf82-b34b18cb7337-original-pull-secret podName:c737fef0-1e59-4bb3-bf82-b34b18cb7337 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:16.697791643 +0000 UTC m=+12.519389041 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c737fef0-1e59-4bb3-bf82-b34b18cb7337-original-pull-secret") pod "global-pull-secret-syncer-hgf7j" (UID: "c737fef0-1e59-4bb3-bf82-b34b18cb7337") : object "kube-system"/"original-pull-secret" not registered May 21 21:21:15.738908 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:15.738874 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:15.739103 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:15.738909 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:15.739103 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:15.739022 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f84fj" podUID="36b197d1-1cdf-47d2-9c86-c8b3e1dbe565" May 21 21:21:15.739223 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:15.739139 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmgw6" podUID="00cfcf38-19fe-4241-b6dc-3d464c44f2d1" May 21 21:21:16.705571 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:16.705523 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c737fef0-1e59-4bb3-bf82-b34b18cb7337-original-pull-secret\") pod \"global-pull-secret-syncer-hgf7j\" (UID: \"c737fef0-1e59-4bb3-bf82-b34b18cb7337\") " pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:16.706001 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:16.705699 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 21:21:16.706001 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:16.705773 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c737fef0-1e59-4bb3-bf82-b34b18cb7337-original-pull-secret podName:c737fef0-1e59-4bb3-bf82-b34b18cb7337 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:18.705757856 +0000 UTC m=+14.527355259 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c737fef0-1e59-4bb3-bf82-b34b18cb7337-original-pull-secret") pod "global-pull-secret-syncer-hgf7j" (UID: "c737fef0-1e59-4bb3-bf82-b34b18cb7337") : object "kube-system"/"original-pull-secret" not registered May 21 21:21:16.739826 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:16.739782 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:16.740003 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:16.739932 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hgf7j" podUID="c737fef0-1e59-4bb3-bf82-b34b18cb7337" May 21 21:21:17.739680 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:17.739639 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:17.740246 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:17.739699 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:17.740246 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:17.739787 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmgw6" podUID="00cfcf38-19fe-4241-b6dc-3d464c44f2d1" May 21 21:21:17.740246 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:17.739919 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f84fj" podUID="36b197d1-1cdf-47d2-9c86-c8b3e1dbe565" May 21 21:21:18.719927 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:18.719881 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c737fef0-1e59-4bb3-bf82-b34b18cb7337-original-pull-secret\") pod \"global-pull-secret-syncer-hgf7j\" (UID: \"c737fef0-1e59-4bb3-bf82-b34b18cb7337\") " pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:18.720127 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:18.720057 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 21:21:18.720187 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:18.720149 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c737fef0-1e59-4bb3-bf82-b34b18cb7337-original-pull-secret podName:c737fef0-1e59-4bb3-bf82-b34b18cb7337 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:22.720124212 +0000 UTC m=+18.541721614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c737fef0-1e59-4bb3-bf82-b34b18cb7337-original-pull-secret") pod "global-pull-secret-syncer-hgf7j" (UID: "c737fef0-1e59-4bb3-bf82-b34b18cb7337") : object "kube-system"/"original-pull-secret" not registered May 21 21:21:18.738964 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:18.738928 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:18.739118 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:18.739066 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hgf7j" podUID="c737fef0-1e59-4bb3-bf82-b34b18cb7337" May 21 21:21:19.739228 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:19.739182 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:19.739730 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:19.739182 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:19.739730 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:19.739334 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f84fj" podUID="36b197d1-1cdf-47d2-9c86-c8b3e1dbe565" May 21 21:21:19.739730 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:19.739407 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmgw6" podUID="00cfcf38-19fe-4241-b6dc-3d464c44f2d1" May 21 21:21:20.739270 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:20.739230 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:20.739645 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:20.739372 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hgf7j" podUID="c737fef0-1e59-4bb3-bf82-b34b18cb7337" May 21 21:21:21.338807 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:21.338715 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs\") pod \"network-metrics-daemon-f84fj\" (UID: \"36b197d1-1cdf-47d2-9c86-c8b3e1dbe565\") " pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:21.339014 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:21.338894 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 21:21:21.339014 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:21.338967 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs podName:36b197d1-1cdf-47d2-9c86-c8b3e1dbe565 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:37.338942839 +0000 UTC m=+33.160540239 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs") pod "network-metrics-daemon-f84fj" (UID: "36b197d1-1cdf-47d2-9c86-c8b3e1dbe565") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 21:21:21.439613 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:21.439583 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rsg2v\" (UniqueName: \"kubernetes.io/projected/00cfcf38-19fe-4241-b6dc-3d464c44f2d1-kube-api-access-rsg2v\") pod \"network-check-target-wmgw6\" (UID: \"00cfcf38-19fe-4241-b6dc-3d464c44f2d1\") " pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:21.439802 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:21.439783 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 21:21:21.439853 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:21.439811 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 21:21:21.439853 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:21.439827 2572 projected.go:194] Error preparing data for projected volume kube-api-access-rsg2v for pod openshift-network-diagnostics/network-check-target-wmgw6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 21:21:21.439925 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:21.439887 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00cfcf38-19fe-4241-b6dc-3d464c44f2d1-kube-api-access-rsg2v podName:00cfcf38-19fe-4241-b6dc-3d464c44f2d1 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:37.439872866 +0000 UTC m=+33.261470265 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rsg2v" (UniqueName: "kubernetes.io/projected/00cfcf38-19fe-4241-b6dc-3d464c44f2d1-kube-api-access-rsg2v") pod "network-check-target-wmgw6" (UID: "00cfcf38-19fe-4241-b6dc-3d464c44f2d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 21:21:21.738858 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:21.738783 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:21.738858 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:21.738806 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:21.739073 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:21.738898 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmgw6" podUID="00cfcf38-19fe-4241-b6dc-3d464c44f2d1" May 21 21:21:21.739073 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:21.739037 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f84fj" podUID="36b197d1-1cdf-47d2-9c86-c8b3e1dbe565" May 21 21:21:22.739150 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:22.739108 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:22.739578 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:22.739230 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hgf7j" podUID="c737fef0-1e59-4bb3-bf82-b34b18cb7337" May 21 21:21:22.749113 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:22.749081 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c737fef0-1e59-4bb3-bf82-b34b18cb7337-original-pull-secret\") pod \"global-pull-secret-syncer-hgf7j\" (UID: \"c737fef0-1e59-4bb3-bf82-b34b18cb7337\") " pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:22.749264 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:22.749200 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 21:21:22.749264 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:22.749255 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c737fef0-1e59-4bb3-bf82-b34b18cb7337-original-pull-secret podName:c737fef0-1e59-4bb3-bf82-b34b18cb7337 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:30.749238848 +0000 UTC m=+26.570836249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c737fef0-1e59-4bb3-bf82-b34b18cb7337-original-pull-secret") pod "global-pull-secret-syncer-hgf7j" (UID: "c737fef0-1e59-4bb3-bf82-b34b18cb7337") : object "kube-system"/"original-pull-secret" not registered May 21 21:21:23.739367 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:23.739325 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:23.739866 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:23.739325 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:23.739866 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:23.739464 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmgw6" podUID="00cfcf38-19fe-4241-b6dc-3d464c44f2d1" May 21 21:21:23.739866 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:23.739509 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f84fj" podUID="36b197d1-1cdf-47d2-9c86-c8b3e1dbe565" May 21 21:21:24.739949 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:24.739912 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:24.740403 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:24.740014 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hgf7j" podUID="c737fef0-1e59-4bb3-bf82-b34b18cb7337" May 21 21:21:25.738901 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:25.738810 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:25.739071 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:25.738809 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:25.739071 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:25.738927 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f84fj" podUID="36b197d1-1cdf-47d2-9c86-c8b3e1dbe565" May 21 21:21:25.739071 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:25.739014 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmgw6" podUID="00cfcf38-19fe-4241-b6dc-3d464c44f2d1" May 21 21:21:25.915336 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:25.915275 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dxvcp" event={"ID":"8d31096e-e77f-4f67-a945-72f8f000b896","Type":"ContainerStarted","Data":"50e670cc533e6f1bf2c34708df4b530a7920b91bfdc83318cdb9759c5f412b62"} May 21 21:21:25.916758 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:25.916722 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" event={"ID":"26b55d22-fe60-4588-96cb-9cd68b9bbd2a","Type":"ContainerStarted","Data":"0ca490a41b9abb55b7dff57eb0932d15559544c0eb95a52d01a02119d89ddf26"} May 21 21:21:25.918068 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:25.918037 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-99.ec2.internal" event={"ID":"f60ea2db76896f8a68dfa4cecb6168b4","Type":"ContainerStarted","Data":"4c1e5d4b3fa694ad3beb246442347100bf17f9e80451e6cebe8c74d23c9f4264"} May 21 21:21:25.931821 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:25.931776 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-dxvcp" podStartSLOduration=2.302834975 podStartE2EDuration="21.931763094s" podCreationTimestamp="2026-05-21 21:21:04 +0000 UTC" firstStartedPulling="2026-05-21 21:21:05.943745889 +0000 UTC m=+1.765343287" lastFinishedPulling="2026-05-21 21:21:25.572674002 +0000 UTC m=+21.394271406" observedRunningTime="2026-05-21 21:21:25.931644127 +0000 UTC m=+21.753241548" watchObservedRunningTime="2026-05-21 21:21:25.931763094 +0000 UTC m=+21.753360546" May 21 21:21:25.944389 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:25.944345 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-99.ec2.internal" podStartSLOduration=20.944330394 podStartE2EDuration="20.944330394s" podCreationTimestamp="2026-05-21 21:21:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:21:25.943872337 +0000 UTC m=+21.765469758" watchObservedRunningTime="2026-05-21 21:21:25.944330394 +0000 UTC m=+21.765927815" May 21 21:21:25.959202 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:25.959152 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8wxpk" podStartSLOduration=1.663377602 podStartE2EDuration="20.959137101s" podCreationTimestamp="2026-05-21 21:21:05 +0000 UTC" firstStartedPulling="2026-05-21 21:21:06.00919511 +0000 UTC m=+1.830792510" lastFinishedPulling="2026-05-21 21:21:25.304954603 +0000 UTC m=+21.126552009" observedRunningTime="2026-05-21 21:21:25.959002553 +0000 UTC m=+21.780599973" watchObservedRunningTime="2026-05-21 21:21:25.959137101 +0000 UTC m=+21.780734521" May 21 21:21:26.739902 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:26.739717 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:26.740123 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:26.739987 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hgf7j" podUID="c737fef0-1e59-4bb3-bf82-b34b18cb7337" May 21 21:21:26.922728 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:26.922657 2572 generic.go:358] "Generic (PLEG): container finished" podID="6e5c7f2a-57a0-4291-974b-4414efc916e1" containerID="8e1b5c28fd0d5872c458cb7b6b43918f35ae21b40cfffddb4393da594c952fa1" exitCode=0 May 21 21:21:26.923547 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:26.922771 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c2csm" event={"ID":"6e5c7f2a-57a0-4291-974b-4414efc916e1","Type":"ContainerDied","Data":"8e1b5c28fd0d5872c458cb7b6b43918f35ae21b40cfffddb4393da594c952fa1"} May 21 21:21:26.925433 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:26.925404 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" event={"ID":"ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1","Type":"ContainerStarted","Data":"652b9c30bab0833040eed30bf1c4f476e6165b5848350f7848ad40f53e42cfd9"} May 21 21:21:26.927275 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:26.927240 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lrz84" event={"ID":"2739574e-acb3-4fca-8dfd-03ec5801a1e1","Type":"ContainerStarted","Data":"49b00805757986f6db864f4dd5e7656f236b1c2ed7106db3b1a8e0b29750e14e"} May 21 21:21:26.929136 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:26.929112 2572 generic.go:358] "Generic (PLEG): container finished" podID="b1bcfa917a54ac6563779f94fbfd3a99" containerID="0cc6945f27e9ad79393e7e8f27aa225d7de3b28f236fa4655a0558cc1bf27a25" exitCode=0 May 21 21:21:26.929236 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:26.929197 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" event={"ID":"b1bcfa917a54ac6563779f94fbfd3a99","Type":"ContainerDied","Data":"0cc6945f27e9ad79393e7e8f27aa225d7de3b28f236fa4655a0558cc1bf27a25"} May 21 21:21:26.930798 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:26.930770 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r8qsv" event={"ID":"9262dc43-0cc0-4446-a8d4-570955a0442e","Type":"ContainerStarted","Data":"2ac7e604418be18ef25a02992758ee6a034d4f4ee7cda32568d4637eabb1d4b4"} May 21 21:21:26.932252 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:26.932228 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rzckq" event={"ID":"3d5474a2-32a3-4370-8e73-79b7ecbf4fd6","Type":"ContainerStarted","Data":"67c559021ccdcceba1037d0c5fe83660ad10cf4758f18b17b0be79899756508b"} May 21 21:21:26.935112 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:26.935090 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cs2zq_c8ddeadf-53c9-4198-8334-76cbdd1832c2/ovn-acl-logging/0.log" May 21 21:21:26.935471 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:26.935450 2572 generic.go:358] "Generic (PLEG): container finished" podID="c8ddeadf-53c9-4198-8334-76cbdd1832c2" containerID="d70880b669d002b41fd342e5bffab528db18a9b35831533fa355c2d0c5b5cb11" exitCode=1 May 21 21:21:26.935629 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:26.935603 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" event={"ID":"c8ddeadf-53c9-4198-8334-76cbdd1832c2","Type":"ContainerStarted","Data":"a64123be4791fa2c20035a6a3d5c34b6967e71ed9b6524bad3c0086bb7bdac0e"} May 21 21:21:26.935727 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:26.935632 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" event={"ID":"c8ddeadf-53c9-4198-8334-76cbdd1832c2","Type":"ContainerStarted","Data":"c191af918e552d01a9fa3fa0c4cc1f870b3061c5751edbe605aa4d93651fc733"} May 21 21:21:26.935727 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:26.935644 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" event={"ID":"c8ddeadf-53c9-4198-8334-76cbdd1832c2","Type":"ContainerStarted","Data":"fd6666d0f06ae3164ccc0d55d139e4d609f04bd31e469ff00511c03c1ade1e54"} May 21 21:21:26.935727 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:26.935653 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" event={"ID":"c8ddeadf-53c9-4198-8334-76cbdd1832c2","Type":"ContainerStarted","Data":"40e1ae9292c79d36774a8de67dcd664bd3ceecda6c8f850a090481f65c181806"} May 21 21:21:26.935727 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:26.935662 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" event={"ID":"c8ddeadf-53c9-4198-8334-76cbdd1832c2","Type":"ContainerDied","Data":"d70880b669d002b41fd342e5bffab528db18a9b35831533fa355c2d0c5b5cb11"} May 21 21:21:26.935727 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:26.935672 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" event={"ID":"c8ddeadf-53c9-4198-8334-76cbdd1832c2","Type":"ContainerStarted","Data":"35054f6f61ee71c283b2843fb94b2969310523a19d53106fc83dd2146bbac1e0"} May 21 21:21:26.968875 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:26.968811 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lrz84" podStartSLOduration=3.607781609 podStartE2EDuration="22.968789455s" podCreationTimestamp="2026-05-21 21:21:04 +0000 UTC" firstStartedPulling="2026-05-21 21:21:05.921231628 +0000 UTC m=+1.742829027" lastFinishedPulling="2026-05-21 21:21:25.282239467 +0000 UTC m=+21.103836873" observedRunningTime="2026-05-21 21:21:26.968747015 +0000 UTC m=+22.790344435" watchObservedRunningTime="2026-05-21 21:21:26.968789455 +0000 UTC m=+22.790386897" May 21 21:21:26.969004 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:26.968961 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-r8qsv" podStartSLOduration=7.389281328 podStartE2EDuration="21.968954055s" podCreationTimestamp="2026-05-21 21:21:05 +0000 UTC" firstStartedPulling="2026-05-21 21:21:05.991531647 +0000 UTC m=+1.813129046" lastFinishedPulling="2026-05-21 21:21:20.571204371 +0000 UTC m=+16.392801773" observedRunningTime="2026-05-21 21:21:26.955772801 +0000 UTC m=+22.777370224" watchObservedRunningTime="2026-05-21 21:21:26.968954055 +0000 UTC m=+22.790551477" May 21 21:21:27.020094 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:27.020049 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-rzckq" podStartSLOduration=3.723066931 podStartE2EDuration="23.020033481s" podCreationTimestamp="2026-05-21 21:21:04 +0000 UTC" firstStartedPulling="2026-05-21 21:21:05.985271579 +0000 UTC m=+1.806868978" lastFinishedPulling="2026-05-21 21:21:25.282238129 +0000 UTC m=+21.103835528" observedRunningTime="2026-05-21 21:21:26.987427749 +0000 UTC m=+22.809025171" watchObservedRunningTime="2026-05-21 21:21:27.020033481 +0000 UTC m=+22.841630902" May 21 21:21:27.698540 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:27.698502 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 21:21:27.739799 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:27.739765 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:27.739981 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:27.739765 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:27.739981 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:27.739883 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmgw6" podUID="00cfcf38-19fe-4241-b6dc-3d464c44f2d1" May 21 21:21:27.739981 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:27.739941 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f84fj" podUID="36b197d1-1cdf-47d2-9c86-c8b3e1dbe565" May 21 21:21:27.938885 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:27.938788 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-km4hl" event={"ID":"64964f5a-350d-4d54-87ca-b1a3151533b0","Type":"ContainerStarted","Data":"2a9219b8c07b785157b03c6924aff22553af89abccb847508ba808e3579e8e50"} May 21 21:21:27.941009 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:27.940975 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" event={"ID":"ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1","Type":"ContainerStarted","Data":"2f535344f06e3748e3bdc364c27ae55e8078e62d5aa8497ac9fff64d117cad43"} May 21 21:21:27.944058 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:27.943647 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" event={"ID":"b1bcfa917a54ac6563779f94fbfd3a99","Type":"ContainerStarted","Data":"222f5a0720ca76809f53e056d8fac1c343d0878ace0b3d180ffd3003032e62b3"} May 21 21:21:27.955112 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:27.955060 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-km4hl" podStartSLOduration=3.675977725 podStartE2EDuration="22.955045849s" podCreationTimestamp="2026-05-21 21:21:05 +0000 UTC" firstStartedPulling="2026-05-21 21:21:06.021709307 +0000 UTC m=+1.843306711" lastFinishedPulling="2026-05-21 21:21:25.300777413 +0000 UTC m=+21.122374835" observedRunningTime="2026-05-21 21:21:27.954516194 +0000 UTC m=+23.776113614" watchObservedRunningTime="2026-05-21 21:21:27.955045849 +0000 UTC m=+23.776643267" May 21 21:21:27.969417 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:27.969367 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" podStartSLOduration=22.969352657 podStartE2EDuration="22.969352657s" podCreationTimestamp="2026-05-21 21:21:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:21:27.96926569 +0000 UTC m=+23.790863112" watchObservedRunningTime="2026-05-21 21:21:27.969352657 +0000 UTC m=+23.790950074" May 21 21:21:28.675649 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:28.675525 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T21:21:27.698522531Z","UUID":"e219ec99-cf23-4733-a105-f3a312679e59","Handler":null,"Name":"","Endpoint":""} May 21 21:21:28.679741 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:28.679714 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 21:21:28.679741 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:28.679749 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 21:21:28.739816 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:28.739780 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:28.739986 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:28.739906 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hgf7j" podUID="c737fef0-1e59-4bb3-bf82-b34b18cb7337" May 21 21:21:29.738979 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:29.738937 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:29.739504 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:29.738940 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:29.739504 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:29.739040 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmgw6" podUID="00cfcf38-19fe-4241-b6dc-3d464c44f2d1" May 21 21:21:29.739504 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:29.739123 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f84fj" podUID="36b197d1-1cdf-47d2-9c86-c8b3e1dbe565" May 21 21:21:29.948956 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:29.948913 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" event={"ID":"ddfca1a3-2415-4f87-bbf1-8cd3919fc3f1","Type":"ContainerStarted","Data":"ebc18426aa4380a015e8b8d9aee9aefc8daac479ea63ed9e87dbb0b5865a35d1"} May 21 21:21:29.951503 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:29.951481 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cs2zq_c8ddeadf-53c9-4198-8334-76cbdd1832c2/ovn-acl-logging/0.log" May 21 21:21:29.951821 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:29.951802 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" event={"ID":"c8ddeadf-53c9-4198-8334-76cbdd1832c2","Type":"ContainerStarted","Data":"aeb45b54ef628617e8207f22c36c1f715ad9ee5e0df20093c6524cdd4a03e012"} May 21 21:21:29.968597 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:29.968554 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trckn" podStartSLOduration=2.957363206 podStartE2EDuration="25.96854053s" podCreationTimestamp="2026-05-21 21:21:04 +0000 UTC" firstStartedPulling="2026-05-21 21:21:05.9745251 +0000 UTC m=+1.796122499" lastFinishedPulling="2026-05-21 21:21:28.985702409 +0000 UTC m=+24.807299823" observedRunningTime="2026-05-21 21:21:29.967946311 +0000 UTC m=+25.789543733" watchObservedRunningTime="2026-05-21 21:21:29.96854053 +0000 UTC m=+25.790137951" May 21 21:21:30.739679 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:30.739637 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:30.740179 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:30.739791 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hgf7j" podUID="c737fef0-1e59-4bb3-bf82-b34b18cb7337" May 21 21:21:30.807181 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:30.807138 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c737fef0-1e59-4bb3-bf82-b34b18cb7337-original-pull-secret\") pod \"global-pull-secret-syncer-hgf7j\" (UID: \"c737fef0-1e59-4bb3-bf82-b34b18cb7337\") " pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:30.809869 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:30.807675 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 21:21:30.809869 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:30.807798 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c737fef0-1e59-4bb3-bf82-b34b18cb7337-original-pull-secret podName:c737fef0-1e59-4bb3-bf82-b34b18cb7337 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:46.807775517 +0000 UTC m=+42.629372934 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c737fef0-1e59-4bb3-bf82-b34b18cb7337-original-pull-secret") pod "global-pull-secret-syncer-hgf7j" (UID: "c737fef0-1e59-4bb3-bf82-b34b18cb7337") : object "kube-system"/"original-pull-secret" not registered May 21 21:21:31.318142 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:31.318100 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lrz84" May 21 21:21:31.318842 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:31.318816 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lrz84" May 21 21:21:31.739856 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:31.739815 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:31.740479 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:31.739830 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:31.740479 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:31.739966 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmgw6" podUID="00cfcf38-19fe-4241-b6dc-3d464c44f2d1" May 21 21:21:31.740479 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:31.740037 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f84fj" podUID="36b197d1-1cdf-47d2-9c86-c8b3e1dbe565" May 21 21:21:31.956762 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:31.956728 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lrz84" May 21 21:21:31.957354 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:31.957334 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lrz84" May 21 21:21:32.739267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:32.738830 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:32.739267 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:32.738957 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hgf7j" podUID="c737fef0-1e59-4bb3-bf82-b34b18cb7337" May 21 21:21:32.961159 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:32.960989 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cs2zq_c8ddeadf-53c9-4198-8334-76cbdd1832c2/ovn-acl-logging/0.log" May 21 21:21:32.961671 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:32.961417 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" event={"ID":"c8ddeadf-53c9-4198-8334-76cbdd1832c2","Type":"ContainerStarted","Data":"ac107821de58a0016a0ef8e07d81142f1987a9ea9636790d0f3c19a22df51153"} May 21 21:21:32.961748 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:32.961681 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:32.961903 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:32.961887 2572 scope.go:117] "RemoveContainer" containerID="d70880b669d002b41fd342e5bffab528db18a9b35831533fa355c2d0c5b5cb11" May 21 21:21:32.978596 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:32.978573 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:33.267226 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:33.267137 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:33.738878 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:33.738837 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:33.739043 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:33.738837 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:33.739043 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:33.738952 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmgw6" podUID="00cfcf38-19fe-4241-b6dc-3d464c44f2d1" May 21 21:21:33.739107 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:33.739021 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f84fj" podUID="36b197d1-1cdf-47d2-9c86-c8b3e1dbe565" May 21 21:21:33.968075 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:33.967959 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cs2zq_c8ddeadf-53c9-4198-8334-76cbdd1832c2/ovn-acl-logging/0.log" May 21 21:21:33.969002 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:33.968960 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" event={"ID":"c8ddeadf-53c9-4198-8334-76cbdd1832c2","Type":"ContainerStarted","Data":"60b3f317675baaa10b0db81939c414e1407ca447ab166ad64f2da2fc35fa9291"} May 21 21:21:33.971671 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:33.971633 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:33.977281 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:33.973939 2572 generic.go:358] "Generic (PLEG): container finished" podID="6e5c7f2a-57a0-4291-974b-4414efc916e1" containerID="0cb8e58b3b09f1c359eda1fce51262864c17e74ac1cbae1176166d3d7599875b" exitCode=0 May 21 21:21:33.977281 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:33.975006 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c2csm" event={"ID":"6e5c7f2a-57a0-4291-974b-4414efc916e1","Type":"ContainerDied","Data":"0cb8e58b3b09f1c359eda1fce51262864c17e74ac1cbae1176166d3d7599875b"} May 21 21:21:33.995745 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:33.995717 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:21:34.000735 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:34.000663 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" podStartSLOduration=9.899560028 podStartE2EDuration="30.000646723s" podCreationTimestamp="2026-05-21 21:21:04 +0000 UTC" firstStartedPulling="2026-05-21 21:21:05.954564826 +0000 UTC m=+1.776162224" lastFinishedPulling="2026-05-21 21:21:26.055651515 +0000 UTC m=+21.877248919" observedRunningTime="2026-05-21 21:21:33.999273322 +0000 UTC m=+29.820870740" watchObservedRunningTime="2026-05-21 21:21:34.000646723 +0000 UTC m=+29.822244145" May 21 21:21:34.612549 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:34.612513 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hgf7j"] May 21 21:21:34.612732 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:34.612675 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:34.612849 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:34.612822 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hgf7j" podUID="c737fef0-1e59-4bb3-bf82-b34b18cb7337" May 21 21:21:34.615500 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:34.615471 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f84fj"] May 21 21:21:34.615645 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:34.615584 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:34.615754 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:34.615732 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f84fj" podUID="36b197d1-1cdf-47d2-9c86-c8b3e1dbe565" May 21 21:21:34.618453 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:34.618420 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wmgw6"] May 21 21:21:34.618588 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:34.618518 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:34.618654 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:34.618614 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmgw6" podUID="00cfcf38-19fe-4241-b6dc-3d464c44f2d1" May 21 21:21:35.979572 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:35.979379 2572 generic.go:358] "Generic (PLEG): container finished" podID="6e5c7f2a-57a0-4291-974b-4414efc916e1" containerID="467e4bd21ce0540a05fb8f6c69711f3f71c233ebd56ba6214265abcd10725c81" exitCode=0 May 21 21:21:35.980012 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:35.979469 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c2csm" event={"ID":"6e5c7f2a-57a0-4291-974b-4414efc916e1","Type":"ContainerDied","Data":"467e4bd21ce0540a05fb8f6c69711f3f71c233ebd56ba6214265abcd10725c81"} May 21 21:21:36.739314 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:36.739276 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:36.739518 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:36.739328 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:36.739518 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:36.739436 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f84fj" podUID="36b197d1-1cdf-47d2-9c86-c8b3e1dbe565" May 21 21:21:36.739518 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:36.739494 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hgf7j" podUID="c737fef0-1e59-4bb3-bf82-b34b18cb7337" May 21 21:21:36.739651 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:36.739540 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:36.739651 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:36.739603 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmgw6" podUID="00cfcf38-19fe-4241-b6dc-3d464c44f2d1" May 21 21:21:37.355012 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:37.354969 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs\") pod \"network-metrics-daemon-f84fj\" (UID: \"36b197d1-1cdf-47d2-9c86-c8b3e1dbe565\") " pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:37.355620 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:37.355146 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 21:21:37.355620 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:37.355230 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs podName:36b197d1-1cdf-47d2-9c86-c8b3e1dbe565 nodeName:}" failed. No retries permitted until 2026-05-21 21:22:09.355208626 +0000 UTC m=+65.176806045 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs") pod "network-metrics-daemon-f84fj" (UID: "36b197d1-1cdf-47d2-9c86-c8b3e1dbe565") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 21:21:37.455866 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:37.455830 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rsg2v\" (UniqueName: \"kubernetes.io/projected/00cfcf38-19fe-4241-b6dc-3d464c44f2d1-kube-api-access-rsg2v\") pod \"network-check-target-wmgw6\" (UID: \"00cfcf38-19fe-4241-b6dc-3d464c44f2d1\") " pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:37.456018 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:37.455998 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 21:21:37.456062 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:37.456023 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 21:21:37.456062 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:37.456034 2572 projected.go:194] Error preparing data for projected volume kube-api-access-rsg2v for pod openshift-network-diagnostics/network-check-target-wmgw6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 21:21:37.456124 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:37.456083 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00cfcf38-19fe-4241-b6dc-3d464c44f2d1-kube-api-access-rsg2v podName:00cfcf38-19fe-4241-b6dc-3d464c44f2d1 nodeName:}" failed. No retries permitted until 2026-05-21 21:22:09.4560688 +0000 UTC m=+65.277666198 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rsg2v" (UniqueName: "kubernetes.io/projected/00cfcf38-19fe-4241-b6dc-3d464c44f2d1-kube-api-access-rsg2v") pod "network-check-target-wmgw6" (UID: "00cfcf38-19fe-4241-b6dc-3d464c44f2d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 21:21:37.985698 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:37.985648 2572 generic.go:358] "Generic (PLEG): container finished" podID="6e5c7f2a-57a0-4291-974b-4414efc916e1" containerID="99d2ad81e3f4a66177b329357d580650f2c632387c297503b9116aedc1009da9" exitCode=0 May 21 21:21:37.985856 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:37.985711 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c2csm" event={"ID":"6e5c7f2a-57a0-4291-974b-4414efc916e1","Type":"ContainerDied","Data":"99d2ad81e3f4a66177b329357d580650f2c632387c297503b9116aedc1009da9"} May 21 21:21:38.498071 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.498040 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeReady" May 21 21:21:38.498500 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.498174 2572 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 21:21:38.531325 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.530839 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8457d49484-g8pbv"] May 21 21:21:38.548531 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.548114 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8457d49484-g8pbv"] May 21 21:21:38.548531 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.548276 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:38.548984 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.548956 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8ltkf"] May 21 21:21:38.551014 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.550986 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 21:21:38.551147 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.551071 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 21:21:38.551147 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.551129 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 21:21:38.551265 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.551075 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tbbwf\"" May 21 21:21:38.556548 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.556527 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 21:21:38.570498 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.570467 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2w7p5"] May 21 21:21:38.570670 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.570591 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8ltkf" May 21 21:21:38.575400 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.575374 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 21:21:38.575918 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.575716 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6c5qz\"" May 21 21:21:38.575918 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.575771 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 21:21:38.575918 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.575858 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 21:21:38.592631 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.592602 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8ltkf"] May 21 21:21:38.592631 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.592629 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2w7p5"] May 21 21:21:38.592840 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.592759 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2w7p5" May 21 21:21:38.595274 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.595245 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bvcxl\"" May 21 21:21:38.595433 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.595416 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 21:21:38.596019 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.595991 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 21:21:38.665562 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.665514 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpj4z\" (UniqueName: \"kubernetes.io/projected/01b78fa7-270f-479b-b579-915de407c411-kube-api-access-kpj4z\") pod \"dns-default-2w7p5\" (UID: \"01b78fa7-270f-479b-b579-915de407c411\") " pod="openshift-dns/dns-default-2w7p5" May 21 21:21:38.665562 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.665564 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert\") pod \"ingress-canary-8ltkf\" (UID: \"56a356d3-0c79-4cff-8256-bc5aee2db13c\") " pod="openshift-ingress-canary/ingress-canary-8ltkf" May 21 21:21:38.665847 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.665673 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:38.665847 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.665734 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce43e05d-855e-40d9-88e7-7a5b58791fa6-trusted-ca\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:38.665847 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.665778 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce43e05d-855e-40d9-88e7-7a5b58791fa6-image-registry-private-configuration\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:38.665847 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.665804 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-certificates\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:38.666021 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.665896 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce43e05d-855e-40d9-88e7-7a5b58791fa6-installation-pull-secrets\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:38.666021 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.665935 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mrsr\" (UniqueName: \"kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-kube-api-access-7mrsr\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:38.666021 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.665981 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce43e05d-855e-40d9-88e7-7a5b58791fa6-ca-trust-extracted\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:38.666021 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.665999 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-bound-sa-token\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:38.666021 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.666019 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/01b78fa7-270f-479b-b579-915de407c411-config-volume\") pod \"dns-default-2w7p5\" (UID: \"01b78fa7-270f-479b-b579-915de407c411\") " pod="openshift-dns/dns-default-2w7p5" May 21 21:21:38.666219 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.666052 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01b78fa7-270f-479b-b579-915de407c411-tmp-dir\") pod \"dns-default-2w7p5\" (UID: \"01b78fa7-270f-479b-b579-915de407c411\") " pod="openshift-dns/dns-default-2w7p5" May 21 21:21:38.666219 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.666085 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg8wd\" (UniqueName: \"kubernetes.io/projected/56a356d3-0c79-4cff-8256-bc5aee2db13c-kube-api-access-wg8wd\") pod \"ingress-canary-8ltkf\" (UID: \"56a356d3-0c79-4cff-8256-bc5aee2db13c\") " pod="openshift-ingress-canary/ingress-canary-8ltkf" May 21 21:21:38.666219 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.666105 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls\") pod \"dns-default-2w7p5\" (UID: \"01b78fa7-270f-479b-b579-915de407c411\") " pod="openshift-dns/dns-default-2w7p5" May 21 21:21:38.739635 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.739596 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:21:38.739835 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.739599 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:38.739933 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.739596 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:21:38.743039 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.743013 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 21:21:38.743163 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.743048 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 21:21:38.743163 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.743087 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jqv7p\"" May 21 21:21:38.743283 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.743269 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xmr9w\"" May 21 21:21:38.743318 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.743286 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 21:21:38.743399 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.743380 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 21:21:38.766375 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.766352 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:38.766514 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.766383 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce43e05d-855e-40d9-88e7-7a5b58791fa6-trusted-ca\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:38.766514 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.766422 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce43e05d-855e-40d9-88e7-7a5b58791fa6-image-registry-private-configuration\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:38.766514 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.766449 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-certificates\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:38.766514 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.766491 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce43e05d-855e-40d9-88e7-7a5b58791fa6-installation-pull-secrets\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:38.766755 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.766515 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7mrsr\" (UniqueName: \"kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-kube-api-access-7mrsr\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:38.766755 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:38.766517 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 21:21:38.766755 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:38.766538 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8457d49484-g8pbv: secret "image-registry-tls" not found May 21 21:21:38.766755 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:38.766610 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls podName:ce43e05d-855e-40d9-88e7-7a5b58791fa6 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:39.266588803 +0000 UTC m=+35.088186216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls") pod "image-registry-8457d49484-g8pbv" (UID: "ce43e05d-855e-40d9-88e7-7a5b58791fa6") : secret "image-registry-tls" not found May 21 21:21:38.766946 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.766901 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce43e05d-855e-40d9-88e7-7a5b58791fa6-ca-trust-extracted\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:38.767004 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.766940 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-bound-sa-token\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:38.767004 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.766982 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/01b78fa7-270f-479b-b579-915de407c411-config-volume\") pod \"dns-default-2w7p5\" (UID: \"01b78fa7-270f-479b-b579-915de407c411\") " pod="openshift-dns/dns-default-2w7p5" May 21 21:21:38.767102 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.767018 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01b78fa7-270f-479b-b579-915de407c411-tmp-dir\") pod \"dns-default-2w7p5\" (UID: \"01b78fa7-270f-479b-b579-915de407c411\") " pod="openshift-dns/dns-default-2w7p5" May 21 21:21:38.767102 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.767054 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wg8wd\" (UniqueName: \"kubernetes.io/projected/56a356d3-0c79-4cff-8256-bc5aee2db13c-kube-api-access-wg8wd\") pod \"ingress-canary-8ltkf\" (UID: \"56a356d3-0c79-4cff-8256-bc5aee2db13c\") " pod="openshift-ingress-canary/ingress-canary-8ltkf" May 21 21:21:38.767102 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.767079 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls\") pod \"dns-default-2w7p5\" (UID: \"01b78fa7-270f-479b-b579-915de407c411\") " pod="openshift-dns/dns-default-2w7p5" May 21 21:21:38.767216 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.767116 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kpj4z\" (UniqueName: \"kubernetes.io/projected/01b78fa7-270f-479b-b579-915de407c411-kube-api-access-kpj4z\") pod \"dns-default-2w7p5\" (UID: \"01b78fa7-270f-479b-b579-915de407c411\") " pod="openshift-dns/dns-default-2w7p5" May 21 21:21:38.767216 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.767141 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert\") pod \"ingress-canary-8ltkf\" (UID: \"56a356d3-0c79-4cff-8256-bc5aee2db13c\") " pod="openshift-ingress-canary/ingress-canary-8ltkf" May 21 21:21:38.767310 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.767250 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-certificates\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:38.767310 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.767261 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce43e05d-855e-40d9-88e7-7a5b58791fa6-ca-trust-extracted\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:38.767310 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:38.767273 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 21:21:38.767425 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:38.767334 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert podName:56a356d3-0c79-4cff-8256-bc5aee2db13c nodeName:}" failed. No retries permitted until 2026-05-21 21:21:39.267315959 +0000 UTC m=+35.088913369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert") pod "ingress-canary-8ltkf" (UID: "56a356d3-0c79-4cff-8256-bc5aee2db13c") : secret "canary-serving-cert" not found May 21 21:21:38.767519 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.767498 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce43e05d-855e-40d9-88e7-7a5b58791fa6-trusted-ca\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:38.767565 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:38.767503 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 21:21:38.767637 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:38.767625 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls podName:01b78fa7-270f-479b-b579-915de407c411 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:39.267607107 +0000 UTC m=+35.089204518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls") pod "dns-default-2w7p5" (UID: "01b78fa7-270f-479b-b579-915de407c411") : secret "dns-default-metrics-tls" not found May 21 21:21:38.767812 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.767788 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01b78fa7-270f-479b-b579-915de407c411-tmp-dir\") pod \"dns-default-2w7p5\" (UID: \"01b78fa7-270f-479b-b579-915de407c411\") " pod="openshift-dns/dns-default-2w7p5" May 21 21:21:38.767996 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.767964 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/01b78fa7-270f-479b-b579-915de407c411-config-volume\") pod \"dns-default-2w7p5\" (UID: \"01b78fa7-270f-479b-b579-915de407c411\") " pod="openshift-dns/dns-default-2w7p5" May 21 21:21:38.771299 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.771279 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce43e05d-855e-40d9-88e7-7a5b58791fa6-image-registry-private-configuration\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:38.776950 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.776913 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpj4z\" (UniqueName: \"kubernetes.io/projected/01b78fa7-270f-479b-b579-915de407c411-kube-api-access-kpj4z\") pod \"dns-default-2w7p5\" (UID: \"01b78fa7-270f-479b-b579-915de407c411\") " pod="openshift-dns/dns-default-2w7p5" May 21 21:21:38.777207 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.777187 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg8wd\" (UniqueName: \"kubernetes.io/projected/56a356d3-0c79-4cff-8256-bc5aee2db13c-kube-api-access-wg8wd\") pod \"ingress-canary-8ltkf\" (UID: \"56a356d3-0c79-4cff-8256-bc5aee2db13c\") " pod="openshift-ingress-canary/ingress-canary-8ltkf" May 21 21:21:38.777278 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.777187 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mrsr\" (UniqueName: \"kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-kube-api-access-7mrsr\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:38.777530 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.777512 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-bound-sa-token\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:38.781857 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:38.781830 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce43e05d-855e-40d9-88e7-7a5b58791fa6-installation-pull-secrets\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:39.270863 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:39.270818 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls\") pod \"dns-default-2w7p5\" (UID: \"01b78fa7-270f-479b-b579-915de407c411\") " pod="openshift-dns/dns-default-2w7p5" May 21 21:21:39.271065 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:39.270875 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert\") pod \"ingress-canary-8ltkf\" (UID: \"56a356d3-0c79-4cff-8256-bc5aee2db13c\") " pod="openshift-ingress-canary/ingress-canary-8ltkf" May 21 21:21:39.271065 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:39.270974 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 21:21:39.271065 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:39.270987 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 21:21:39.271065 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:39.271006 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:39.271065 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:39.271044 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert podName:56a356d3-0c79-4cff-8256-bc5aee2db13c nodeName:}" failed. No retries permitted until 2026-05-21 21:21:40.27102577 +0000 UTC m=+36.092623195 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert") pod "ingress-canary-8ltkf" (UID: "56a356d3-0c79-4cff-8256-bc5aee2db13c") : secret "canary-serving-cert" not found May 21 21:21:39.271268 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:39.271068 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls podName:01b78fa7-270f-479b-b579-915de407c411 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:40.271056676 +0000 UTC m=+36.092654080 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls") pod "dns-default-2w7p5" (UID: "01b78fa7-270f-479b-b579-915de407c411") : secret "dns-default-metrics-tls" not found May 21 21:21:39.271268 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:39.271085 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 21:21:39.271268 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:39.271096 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8457d49484-g8pbv: secret "image-registry-tls" not found May 21 21:21:39.271268 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:39.271136 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls podName:ce43e05d-855e-40d9-88e7-7a5b58791fa6 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:40.271126298 +0000 UTC m=+36.092723714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls") pod "image-registry-8457d49484-g8pbv" (UID: "ce43e05d-855e-40d9-88e7-7a5b58791fa6") : secret "image-registry-tls" not found May 21 21:21:40.278763 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:40.278674 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:40.279446 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:40.278860 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 21:21:40.279446 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:40.278872 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls\") pod \"dns-default-2w7p5\" (UID: \"01b78fa7-270f-479b-b579-915de407c411\") " pod="openshift-dns/dns-default-2w7p5" May 21 21:21:40.279446 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:40.278882 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8457d49484-g8pbv: secret "image-registry-tls" not found May 21 21:21:40.279446 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:40.278909 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert\") pod \"ingress-canary-8ltkf\" (UID: \"56a356d3-0c79-4cff-8256-bc5aee2db13c\") " pod="openshift-ingress-canary/ingress-canary-8ltkf" May 21 21:21:40.279446 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:40.278958 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls podName:ce43e05d-855e-40d9-88e7-7a5b58791fa6 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:42.278935104 +0000 UTC m=+38.100532536 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls") pod "image-registry-8457d49484-g8pbv" (UID: "ce43e05d-855e-40d9-88e7-7a5b58791fa6") : secret "image-registry-tls" not found May 21 21:21:40.279446 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:40.278969 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 21:21:40.279446 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:40.279009 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls podName:01b78fa7-270f-479b-b579-915de407c411 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:42.278998656 +0000 UTC m=+38.100596070 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls") pod "dns-default-2w7p5" (UID: "01b78fa7-270f-479b-b579-915de407c411") : secret "dns-default-metrics-tls" not found May 21 21:21:40.279446 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:40.279037 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 21:21:40.279446 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:40.279116 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert podName:56a356d3-0c79-4cff-8256-bc5aee2db13c nodeName:}" failed. No retries permitted until 2026-05-21 21:21:42.279099059 +0000 UTC m=+38.100696471 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert") pod "ingress-canary-8ltkf" (UID: "56a356d3-0c79-4cff-8256-bc5aee2db13c") : secret "canary-serving-cert" not found May 21 21:21:42.297080 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:42.297041 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls\") pod \"dns-default-2w7p5\" (UID: \"01b78fa7-270f-479b-b579-915de407c411\") " pod="openshift-dns/dns-default-2w7p5" May 21 21:21:42.297605 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:42.297099 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert\") pod \"ingress-canary-8ltkf\" (UID: \"56a356d3-0c79-4cff-8256-bc5aee2db13c\") " pod="openshift-ingress-canary/ingress-canary-8ltkf" May 21 21:21:42.297605 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:42.297210 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 21:21:42.297605 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:42.297247 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:42.297605 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:42.297279 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls podName:01b78fa7-270f-479b-b579-915de407c411 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:46.297264931 +0000 UTC m=+42.118862334 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls") pod "dns-default-2w7p5" (UID: "01b78fa7-270f-479b-b579-915de407c411") : secret "dns-default-metrics-tls" not found May 21 21:21:42.297605 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:42.297211 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 21:21:42.297605 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:42.297330 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 21:21:42.297605 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:42.297341 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8457d49484-g8pbv: secret "image-registry-tls" not found May 21 21:21:42.297605 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:42.297392 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert podName:56a356d3-0c79-4cff-8256-bc5aee2db13c nodeName:}" failed. No retries permitted until 2026-05-21 21:21:46.297374124 +0000 UTC m=+42.118971539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert") pod "ingress-canary-8ltkf" (UID: "56a356d3-0c79-4cff-8256-bc5aee2db13c") : secret "canary-serving-cert" not found May 21 21:21:42.297605 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:42.297428 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls podName:ce43e05d-855e-40d9-88e7-7a5b58791fa6 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:46.297411134 +0000 UTC m=+42.119008541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls") pod "image-registry-8457d49484-g8pbv" (UID: "ce43e05d-855e-40d9-88e7-7a5b58791fa6") : secret "image-registry-tls" not found May 21 21:21:46.005083 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:46.004903 2572 generic.go:358] "Generic (PLEG): container finished" podID="6e5c7f2a-57a0-4291-974b-4414efc916e1" containerID="eb9e2908895cd295cbafdfa020d32a458f32b5382637df7b332f2f9f5339eccd" exitCode=0 May 21 21:21:46.005444 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:46.004987 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c2csm" event={"ID":"6e5c7f2a-57a0-4291-974b-4414efc916e1","Type":"ContainerDied","Data":"eb9e2908895cd295cbafdfa020d32a458f32b5382637df7b332f2f9f5339eccd"} May 21 21:21:46.330886 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:46.330791 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert\") pod \"ingress-canary-8ltkf\" (UID: \"56a356d3-0c79-4cff-8256-bc5aee2db13c\") " pod="openshift-ingress-canary/ingress-canary-8ltkf" May 21 21:21:46.330886 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:46.330847 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:46.331138 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:46.330902 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls\") pod \"dns-default-2w7p5\" (UID: \"01b78fa7-270f-479b-b579-915de407c411\") " pod="openshift-dns/dns-default-2w7p5" May 21 21:21:46.331138 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:46.330928 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 21:21:46.331138 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:46.330983 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 21:21:46.331138 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:46.330994 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert podName:56a356d3-0c79-4cff-8256-bc5aee2db13c nodeName:}" failed. No retries permitted until 2026-05-21 21:21:54.330979414 +0000 UTC m=+50.152576813 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert") pod "ingress-canary-8ltkf" (UID: "56a356d3-0c79-4cff-8256-bc5aee2db13c") : secret "canary-serving-cert" not found May 21 21:21:46.331138 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:46.331000 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 21:21:46.331138 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:46.331020 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8457d49484-g8pbv: secret "image-registry-tls" not found May 21 21:21:46.331138 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:46.331049 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls podName:01b78fa7-270f-479b-b579-915de407c411 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:54.331036392 +0000 UTC m=+50.152633791 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls") pod "dns-default-2w7p5" (UID: "01b78fa7-270f-479b-b579-915de407c411") : secret "dns-default-metrics-tls" not found May 21 21:21:46.331138 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:46.331078 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls podName:ce43e05d-855e-40d9-88e7-7a5b58791fa6 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:54.33106413 +0000 UTC m=+50.152661536 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls") pod "image-registry-8457d49484-g8pbv" (UID: "ce43e05d-855e-40d9-88e7-7a5b58791fa6") : secret "image-registry-tls" not found May 21 21:21:46.834932 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:46.834894 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c737fef0-1e59-4bb3-bf82-b34b18cb7337-original-pull-secret\") pod \"global-pull-secret-syncer-hgf7j\" (UID: \"c737fef0-1e59-4bb3-bf82-b34b18cb7337\") " pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:46.838085 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:46.838064 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c737fef0-1e59-4bb3-bf82-b34b18cb7337-original-pull-secret\") pod \"global-pull-secret-syncer-hgf7j\" (UID: \"c737fef0-1e59-4bb3-bf82-b34b18cb7337\") " pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:46.859155 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:46.859117 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hgf7j" May 21 21:21:47.009427 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:47.009396 2572 generic.go:358] "Generic (PLEG): container finished" podID="6e5c7f2a-57a0-4291-974b-4414efc916e1" containerID="77017446bbea23e497f798d83fa92794ecb372bf83b97c44c38e922c0044b3e4" exitCode=0 May 21 21:21:47.009798 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:47.009455 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c2csm" event={"ID":"6e5c7f2a-57a0-4291-974b-4414efc916e1","Type":"ContainerDied","Data":"77017446bbea23e497f798d83fa92794ecb372bf83b97c44c38e922c0044b3e4"} May 21 21:21:47.027911 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:47.027878 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hgf7j"] May 21 21:21:47.032777 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:21:47.032749 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc737fef0_1e59_4bb3_bf82_b34b18cb7337.slice/crio-1dd32c51103bfbfa49f2dccfcbc31c40c55873ea2d3da97237a8b0c51ad4e4eb WatchSource:0}: Error finding container 1dd32c51103bfbfa49f2dccfcbc31c40c55873ea2d3da97237a8b0c51ad4e4eb: Status 404 returned error can't find the container with id 1dd32c51103bfbfa49f2dccfcbc31c40c55873ea2d3da97237a8b0c51ad4e4eb May 21 21:21:48.013090 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:48.013047 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hgf7j" event={"ID":"c737fef0-1e59-4bb3-bf82-b34b18cb7337","Type":"ContainerStarted","Data":"1dd32c51103bfbfa49f2dccfcbc31c40c55873ea2d3da97237a8b0c51ad4e4eb"} May 21 21:21:48.016545 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:48.016517 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c2csm" event={"ID":"6e5c7f2a-57a0-4291-974b-4414efc916e1","Type":"ContainerStarted","Data":"663b8263c696ec7c2eb9b3d59365c3aaee1e75f55183cbd54094501edc03047d"} May 21 21:21:48.040922 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:48.040864 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-c2csm" podStartSLOduration=3.809952156 podStartE2EDuration="43.040837007s" podCreationTimestamp="2026-05-21 21:21:05 +0000 UTC" firstStartedPulling="2026-05-21 21:21:06.028302913 +0000 UTC m=+1.849900312" lastFinishedPulling="2026-05-21 21:21:45.25918775 +0000 UTC m=+41.080785163" observedRunningTime="2026-05-21 21:21:48.038702633 +0000 UTC m=+43.860300051" watchObservedRunningTime="2026-05-21 21:21:48.040837007 +0000 UTC m=+43.862434431" May 21 21:21:53.026518 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:53.026479 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hgf7j" event={"ID":"c737fef0-1e59-4bb3-bf82-b34b18cb7337","Type":"ContainerStarted","Data":"5112f4666f52f067fa383eb976c912caeb9453ae79006a5356ef7ac829c30f18"} May 21 21:21:53.041374 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:53.041309 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hgf7j" podStartSLOduration=32.568444705 podStartE2EDuration="38.041293093s" podCreationTimestamp="2026-05-21 21:21:15 +0000 UTC" firstStartedPulling="2026-05-21 21:21:47.034831564 +0000 UTC m=+42.856428978" lastFinishedPulling="2026-05-21 21:21:52.507679966 +0000 UTC m=+48.329277366" observedRunningTime="2026-05-21 21:21:53.040830224 +0000 UTC m=+48.862427646" watchObservedRunningTime="2026-05-21 21:21:53.041293093 +0000 UTC m=+48.862890513" May 21 21:21:54.396238 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:54.396192 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:21:54.396808 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:54.396275 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls\") pod \"dns-default-2w7p5\" (UID: \"01b78fa7-270f-479b-b579-915de407c411\") " pod="openshift-dns/dns-default-2w7p5" May 21 21:21:54.396808 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:21:54.396302 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert\") pod \"ingress-canary-8ltkf\" (UID: \"56a356d3-0c79-4cff-8256-bc5aee2db13c\") " pod="openshift-ingress-canary/ingress-canary-8ltkf" May 21 21:21:54.396808 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:54.396347 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 21:21:54.396808 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:54.396369 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8457d49484-g8pbv: secret "image-registry-tls" not found May 21 21:21:54.396808 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:54.396378 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 21:21:54.396808 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:54.396398 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 21:21:54.396808 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:54.396428 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls podName:ce43e05d-855e-40d9-88e7-7a5b58791fa6 nodeName:}" failed. No retries permitted until 2026-05-21 21:22:10.396411388 +0000 UTC m=+66.218008791 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls") pod "image-registry-8457d49484-g8pbv" (UID: "ce43e05d-855e-40d9-88e7-7a5b58791fa6") : secret "image-registry-tls" not found May 21 21:21:54.396808 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:54.396441 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls podName:01b78fa7-270f-479b-b579-915de407c411 nodeName:}" failed. No retries permitted until 2026-05-21 21:22:10.39643485 +0000 UTC m=+66.218032248 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls") pod "dns-default-2w7p5" (UID: "01b78fa7-270f-479b-b579-915de407c411") : secret "dns-default-metrics-tls" not found May 21 21:21:54.396808 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:21:54.396454 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert podName:56a356d3-0c79-4cff-8256-bc5aee2db13c nodeName:}" failed. No retries permitted until 2026-05-21 21:22:10.396446073 +0000 UTC m=+66.218043472 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert") pod "ingress-canary-8ltkf" (UID: "56a356d3-0c79-4cff-8256-bc5aee2db13c") : secret "canary-serving-cert" not found May 21 21:22:06.001451 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:06.001419 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cs2zq" May 21 21:22:09.410777 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:09.410733 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs\") pod \"network-metrics-daemon-f84fj\" (UID: \"36b197d1-1cdf-47d2-9c86-c8b3e1dbe565\") " pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:22:09.413431 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:09.413412 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 21:22:09.421402 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:09.421371 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 21:22:09.421531 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:09.421470 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs podName:36b197d1-1cdf-47d2-9c86-c8b3e1dbe565 nodeName:}" failed. No retries permitted until 2026-05-21 21:23:13.421443941 +0000 UTC m=+129.243041357 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs") pod "network-metrics-daemon-f84fj" (UID: "36b197d1-1cdf-47d2-9c86-c8b3e1dbe565") : secret "metrics-daemon-secret" not found May 21 21:22:09.511279 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:09.511239 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rsg2v\" (UniqueName: \"kubernetes.io/projected/00cfcf38-19fe-4241-b6dc-3d464c44f2d1-kube-api-access-rsg2v\") pod \"network-check-target-wmgw6\" (UID: \"00cfcf38-19fe-4241-b6dc-3d464c44f2d1\") " pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:22:09.513918 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:09.513895 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 21:22:09.524474 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:09.524449 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 21:22:09.535067 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:09.535037 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsg2v\" (UniqueName: \"kubernetes.io/projected/00cfcf38-19fe-4241-b6dc-3d464c44f2d1-kube-api-access-rsg2v\") pod \"network-check-target-wmgw6\" (UID: \"00cfcf38-19fe-4241-b6dc-3d464c44f2d1\") " pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:22:09.667738 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:09.667639 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xmr9w\"" May 21 21:22:09.675391 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:09.675364 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:22:09.831226 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:09.831193 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wmgw6"] May 21 21:22:09.834944 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:22:09.834913 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00cfcf38_19fe_4241_b6dc_3d464c44f2d1.slice/crio-41ce06f3c864911ccea68a716844ece7f9b3cc9c620f6d27992bad53f23710a7 WatchSource:0}: Error finding container 41ce06f3c864911ccea68a716844ece7f9b3cc9c620f6d27992bad53f23710a7: Status 404 returned error can't find the container with id 41ce06f3c864911ccea68a716844ece7f9b3cc9c620f6d27992bad53f23710a7 May 21 21:22:10.059384 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:10.059291 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wmgw6" event={"ID":"00cfcf38-19fe-4241-b6dc-3d464c44f2d1","Type":"ContainerStarted","Data":"41ce06f3c864911ccea68a716844ece7f9b3cc9c620f6d27992bad53f23710a7"} May 21 21:22:10.416663 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:10.416624 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls\") pod \"dns-default-2w7p5\" (UID: \"01b78fa7-270f-479b-b579-915de407c411\") " pod="openshift-dns/dns-default-2w7p5" May 21 21:22:10.417101 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:10.416681 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert\") pod \"ingress-canary-8ltkf\" (UID: \"56a356d3-0c79-4cff-8256-bc5aee2db13c\") " pod="openshift-ingress-canary/ingress-canary-8ltkf" May 21 21:22:10.417101 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:10.416728 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:22:10.417101 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:10.416801 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 21:22:10.417101 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:10.416851 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 21:22:10.417101 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:10.416858 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 21:22:10.417101 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:10.416863 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8457d49484-g8pbv: secret "image-registry-tls" not found May 21 21:22:10.417101 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:10.416867 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls podName:01b78fa7-270f-479b-b579-915de407c411 nodeName:}" failed. No retries permitted until 2026-05-21 21:22:42.416847295 +0000 UTC m=+98.238444713 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls") pod "dns-default-2w7p5" (UID: "01b78fa7-270f-479b-b579-915de407c411") : secret "dns-default-metrics-tls" not found May 21 21:22:10.417101 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:10.416985 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert podName:56a356d3-0c79-4cff-8256-bc5aee2db13c nodeName:}" failed. No retries permitted until 2026-05-21 21:22:42.416962753 +0000 UTC m=+98.238560167 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert") pod "ingress-canary-8ltkf" (UID: "56a356d3-0c79-4cff-8256-bc5aee2db13c") : secret "canary-serving-cert" not found May 21 21:22:10.417101 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:10.417007 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls podName:ce43e05d-855e-40d9-88e7-7a5b58791fa6 nodeName:}" failed. No retries permitted until 2026-05-21 21:22:42.416997406 +0000 UTC m=+98.238594809 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls") pod "image-registry-8457d49484-g8pbv" (UID: "ce43e05d-855e-40d9-88e7-7a5b58791fa6") : secret "image-registry-tls" not found May 21 21:22:13.070279 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:13.070189 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wmgw6" event={"ID":"00cfcf38-19fe-4241-b6dc-3d464c44f2d1","Type":"ContainerStarted","Data":"74ce38457335b1c51256e81b8be5605307053578fb8ddedb230eb62d483ec978"} May 21 21:22:13.070631 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:13.070338 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:22:42.434238 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:42.434179 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls\") pod \"dns-default-2w7p5\" (UID: \"01b78fa7-270f-479b-b579-915de407c411\") " pod="openshift-dns/dns-default-2w7p5" May 21 21:22:42.434840 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:42.434253 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert\") pod \"ingress-canary-8ltkf\" (UID: \"56a356d3-0c79-4cff-8256-bc5aee2db13c\") " pod="openshift-ingress-canary/ingress-canary-8ltkf" May 21 21:22:42.434840 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:42.434284 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls\") pod \"image-registry-8457d49484-g8pbv\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:22:42.434840 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:42.434348 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 21:22:42.434840 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:42.434389 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 21:22:42.434840 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:42.434397 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 21:22:42.434840 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:42.434413 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8457d49484-g8pbv: secret "image-registry-tls" not found May 21 21:22:42.434840 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:42.434448 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert podName:56a356d3-0c79-4cff-8256-bc5aee2db13c nodeName:}" failed. No retries permitted until 2026-05-21 21:23:46.434426131 +0000 UTC m=+162.256023544 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert") pod "ingress-canary-8ltkf" (UID: "56a356d3-0c79-4cff-8256-bc5aee2db13c") : secret "canary-serving-cert" not found May 21 21:22:42.434840 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:42.434474 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls podName:ce43e05d-855e-40d9-88e7-7a5b58791fa6 nodeName:}" failed. No retries permitted until 2026-05-21 21:23:46.434457615 +0000 UTC m=+162.256055014 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls") pod "image-registry-8457d49484-g8pbv" (UID: "ce43e05d-855e-40d9-88e7-7a5b58791fa6") : secret "image-registry-tls" not found May 21 21:22:42.434840 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:42.434492 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls podName:01b78fa7-270f-479b-b579-915de407c411 nodeName:}" failed. No retries permitted until 2026-05-21 21:23:46.434483231 +0000 UTC m=+162.256080638 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls") pod "dns-default-2w7p5" (UID: "01b78fa7-270f-479b-b579-915de407c411") : secret "dns-default-metrics-tls" not found May 21 21:22:44.074666 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:44.074628 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wmgw6" May 21 21:22:44.090184 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:44.090128 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wmgw6" podStartSLOduration=96.188036229 podStartE2EDuration="1m39.090112815s" podCreationTimestamp="2026-05-21 21:21:05 +0000 UTC" firstStartedPulling="2026-05-21 21:22:09.83748626 +0000 UTC m=+65.659083659" lastFinishedPulling="2026-05-21 21:22:12.739562841 +0000 UTC m=+68.561160245" observedRunningTime="2026-05-21 21:22:13.102962066 +0000 UTC m=+68.924559488" watchObservedRunningTime="2026-05-21 21:22:44.090112815 +0000 UTC m=+99.911710236" May 21 21:22:47.619249 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.619202 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-cjmvr"] May 21 21:22:47.621775 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.621753 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-5l9qb"] May 21 21:22:47.621952 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.621921 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-cjmvr" May 21 21:22:47.624332 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.624313 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-s7b5h"] May 21 21:22:47.624473 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.624456 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5l9qb" May 21 21:22:47.625533 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.625508 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 21 21:22:47.625801 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.625775 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vvvxr\"" May 21 21:22:47.625883 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.625816 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 21 21:22:47.626518 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.626500 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 21 21:22:47.626704 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.626670 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-94b86d8cb-4w4s6"] May 21 21:22:47.626772 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.626757 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 21 21:22:47.626809 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.626764 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" May 21 21:22:47.626884 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.626860 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 21 21:22:47.627016 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.626998 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-h24r8\"" May 21 21:22:47.628971 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.628952 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 21 21:22:47.629086 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.629069 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-n6xqs\"" May 21 21:22:47.629253 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.629234 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:22:47.629363 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.629329 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 21 21:22:47.629363 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.629347 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 21 21:22:47.631070 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.631048 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 21 21:22:47.632479 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.632458 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 21 21:22:47.632634 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.632614 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 21 21:22:47.632898 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.632880 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 21:22:47.633033 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.632948 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 21:22:47.633174 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.632974 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 21 21:22:47.633548 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.633493 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-j7d6s\"" May 21 21:22:47.633548 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.633512 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 21 21:22:47.634312 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.634290 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-5l9qb"] May 21 21:22:47.636516 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.636496 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 21 21:22:47.637006 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.636989 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-cjmvr"] May 21 21:22:47.637642 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.637625 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-s7b5h"] May 21 21:22:47.638503 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.638481 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-94b86d8cb-4w4s6"] May 21 21:22:47.670949 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.670917 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b6e44fa-e9e8-4c30-9354-efbfe5194baa-samples-operator-tls\") pod \"cluster-samples-operator-697587599-5l9qb\" (UID: \"4b6e44fa-e9e8-4c30-9354-efbfe5194baa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5l9qb" May 21 21:22:47.670949 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.670952 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b3e1a90-2f91-4105-bcc6-64375d2527d2-serving-cert\") pod \"console-operator-76dff48d59-s7b5h\" (UID: \"5b3e1a90-2f91-4105-bcc6-64375d2527d2\") " pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" May 21 21:22:47.671243 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.670973 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbqms\" (UniqueName: \"kubernetes.io/projected/9a8b5d2d-43b7-4cf3-be4f-62b247e443e9-kube-api-access-hbqms\") pod \"volume-data-source-validator-5cf8c89d64-cjmvr\" (UID: \"9a8b5d2d-43b7-4cf3-be4f-62b247e443e9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-cjmvr" May 21 21:22:47.671243 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.670995 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b3e1a90-2f91-4105-bcc6-64375d2527d2-config\") pod \"console-operator-76dff48d59-s7b5h\" (UID: \"5b3e1a90-2f91-4105-bcc6-64375d2527d2\") " pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" May 21 21:22:47.671243 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.671037 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2drpw\" (UniqueName: \"kubernetes.io/projected/5b3e1a90-2f91-4105-bcc6-64375d2527d2-kube-api-access-2drpw\") pod \"console-operator-76dff48d59-s7b5h\" (UID: \"5b3e1a90-2f91-4105-bcc6-64375d2527d2\") " pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" May 21 21:22:47.671243 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.671078 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbthq\" (UniqueName: \"kubernetes.io/projected/4b6e44fa-e9e8-4c30-9354-efbfe5194baa-kube-api-access-fbthq\") pod \"cluster-samples-operator-697587599-5l9qb\" (UID: \"4b6e44fa-e9e8-4c30-9354-efbfe5194baa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5l9qb" May 21 21:22:47.671243 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.671108 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-default-certificate\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:22:47.671243 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.671168 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-stats-auth\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:22:47.671243 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.671202 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-metrics-certs\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:22:47.671243 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.671223 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/435d78d6-e6b0-4569-8585-aa2990bdee1f-service-ca-bundle\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:22:47.671479 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.671270 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5b3e1a90-2f91-4105-bcc6-64375d2527d2-trusted-ca\") pod \"console-operator-76dff48d59-s7b5h\" (UID: \"5b3e1a90-2f91-4105-bcc6-64375d2527d2\") " pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" May 21 21:22:47.671479 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.671299 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rx6c\" (UniqueName: \"kubernetes.io/projected/435d78d6-e6b0-4569-8585-aa2990bdee1f-kube-api-access-7rx6c\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:22:47.725434 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.725390 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-tns2g"] May 21 21:22:47.728407 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.728390 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-tns2g" May 21 21:22:47.730794 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.730762 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-j9fr2\"" May 21 21:22:47.730935 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.730879 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 21:22:47.731111 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.731094 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 21:22:47.731920 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.731902 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 21 21:22:47.732007 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.731947 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 21 21:22:47.736765 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.736740 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 21 21:22:47.737158 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.737141 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-tns2g"] May 21 21:22:47.771603 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.771564 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b6e44fa-e9e8-4c30-9354-efbfe5194baa-samples-operator-tls\") pod \"cluster-samples-operator-697587599-5l9qb\" (UID: \"4b6e44fa-e9e8-4c30-9354-efbfe5194baa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5l9qb" May 21 21:22:47.771603 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.771603 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/330c5249-5f06-42ef-a15b-2a83a215bb8b-tmp\") pod \"insights-operator-78bdfb888c-tns2g\" (UID: \"330c5249-5f06-42ef-a15b-2a83a215bb8b\") " pod="openshift-insights/insights-operator-78bdfb888c-tns2g" May 21 21:22:47.771848 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.771623 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2drpw\" (UniqueName: \"kubernetes.io/projected/5b3e1a90-2f91-4105-bcc6-64375d2527d2-kube-api-access-2drpw\") pod \"console-operator-76dff48d59-s7b5h\" (UID: \"5b3e1a90-2f91-4105-bcc6-64375d2527d2\") " pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" May 21 21:22:47.771848 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:47.771766 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 21:22:47.771848 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.771799 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-default-certificate\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:22:47.771848 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:47.771846 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b6e44fa-e9e8-4c30-9354-efbfe5194baa-samples-operator-tls podName:4b6e44fa-e9e8-4c30-9354-efbfe5194baa nodeName:}" failed. No retries permitted until 2026-05-21 21:22:48.271818612 +0000 UTC m=+104.093416016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4b6e44fa-e9e8-4c30-9354-efbfe5194baa-samples-operator-tls") pod "cluster-samples-operator-697587599-5l9qb" (UID: "4b6e44fa-e9e8-4c30-9354-efbfe5194baa") : secret "samples-operator-tls" not found May 21 21:22:47.772051 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.771880 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fbthq\" (UniqueName: \"kubernetes.io/projected/4b6e44fa-e9e8-4c30-9354-efbfe5194baa-kube-api-access-fbthq\") pod \"cluster-samples-operator-697587599-5l9qb\" (UID: \"4b6e44fa-e9e8-4c30-9354-efbfe5194baa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5l9qb" May 21 21:22:47.772051 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.771980 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/330c5249-5f06-42ef-a15b-2a83a215bb8b-service-ca-bundle\") pod \"insights-operator-78bdfb888c-tns2g\" (UID: \"330c5249-5f06-42ef-a15b-2a83a215bb8b\") " pod="openshift-insights/insights-operator-78bdfb888c-tns2g" May 21 21:22:47.772051 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.772017 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmh4p\" (UniqueName: \"kubernetes.io/projected/330c5249-5f06-42ef-a15b-2a83a215bb8b-kube-api-access-gmh4p\") pod \"insights-operator-78bdfb888c-tns2g\" (UID: \"330c5249-5f06-42ef-a15b-2a83a215bb8b\") " pod="openshift-insights/insights-operator-78bdfb888c-tns2g" May 21 21:22:47.772051 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.772038 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/435d78d6-e6b0-4569-8585-aa2990bdee1f-service-ca-bundle\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:22:47.772241 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.772063 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5b3e1a90-2f91-4105-bcc6-64375d2527d2-trusted-ca\") pod \"console-operator-76dff48d59-s7b5h\" (UID: \"5b3e1a90-2f91-4105-bcc6-64375d2527d2\") " pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" May 21 21:22:47.772241 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.772083 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rx6c\" (UniqueName: \"kubernetes.io/projected/435d78d6-e6b0-4569-8585-aa2990bdee1f-kube-api-access-7rx6c\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:22:47.772241 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.772158 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/330c5249-5f06-42ef-a15b-2a83a215bb8b-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-tns2g\" (UID: \"330c5249-5f06-42ef-a15b-2a83a215bb8b\") " pod="openshift-insights/insights-operator-78bdfb888c-tns2g" May 21 21:22:47.772241 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:47.772192 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/435d78d6-e6b0-4569-8585-aa2990bdee1f-service-ca-bundle podName:435d78d6-e6b0-4569-8585-aa2990bdee1f nodeName:}" failed. No retries permitted until 2026-05-21 21:22:48.27217299 +0000 UTC m=+104.093770414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/435d78d6-e6b0-4569-8585-aa2990bdee1f-service-ca-bundle") pod "router-default-94b86d8cb-4w4s6" (UID: "435d78d6-e6b0-4569-8585-aa2990bdee1f") : configmap references non-existent config key: service-ca.crt May 21 21:22:47.772397 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.772322 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b3e1a90-2f91-4105-bcc6-64375d2527d2-serving-cert\") pod \"console-operator-76dff48d59-s7b5h\" (UID: \"5b3e1a90-2f91-4105-bcc6-64375d2527d2\") " pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" May 21 21:22:47.772397 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.772345 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b3e1a90-2f91-4105-bcc6-64375d2527d2-config\") pod \"console-operator-76dff48d59-s7b5h\" (UID: \"5b3e1a90-2f91-4105-bcc6-64375d2527d2\") " pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" May 21 21:22:47.772397 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.772377 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-stats-auth\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:22:47.772605 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.772402 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/330c5249-5f06-42ef-a15b-2a83a215bb8b-snapshots\") pod \"insights-operator-78bdfb888c-tns2g\" (UID: \"330c5249-5f06-42ef-a15b-2a83a215bb8b\") " pod="openshift-insights/insights-operator-78bdfb888c-tns2g" May 21 21:22:47.772605 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.772434 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/330c5249-5f06-42ef-a15b-2a83a215bb8b-serving-cert\") pod \"insights-operator-78bdfb888c-tns2g\" (UID: \"330c5249-5f06-42ef-a15b-2a83a215bb8b\") " pod="openshift-insights/insights-operator-78bdfb888c-tns2g" May 21 21:22:47.772605 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.772479 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-metrics-certs\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:22:47.772605 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.772530 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hbqms\" (UniqueName: \"kubernetes.io/projected/9a8b5d2d-43b7-4cf3-be4f-62b247e443e9-kube-api-access-hbqms\") pod \"volume-data-source-validator-5cf8c89d64-cjmvr\" (UID: \"9a8b5d2d-43b7-4cf3-be4f-62b247e443e9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-cjmvr" May 21 21:22:47.772832 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:47.772599 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 21:22:47.772832 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:47.772671 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-metrics-certs podName:435d78d6-e6b0-4569-8585-aa2990bdee1f nodeName:}" failed. No retries permitted until 2026-05-21 21:22:48.272651188 +0000 UTC m=+104.094248604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-metrics-certs") pod "router-default-94b86d8cb-4w4s6" (UID: "435d78d6-e6b0-4569-8585-aa2990bdee1f") : secret "router-metrics-certs-default" not found May 21 21:22:47.772979 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.772955 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5b3e1a90-2f91-4105-bcc6-64375d2527d2-trusted-ca\") pod \"console-operator-76dff48d59-s7b5h\" (UID: \"5b3e1a90-2f91-4105-bcc6-64375d2527d2\") " pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" May 21 21:22:47.773064 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.773017 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b3e1a90-2f91-4105-bcc6-64375d2527d2-config\") pod \"console-operator-76dff48d59-s7b5h\" (UID: \"5b3e1a90-2f91-4105-bcc6-64375d2527d2\") " pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" May 21 21:22:47.774550 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.774525 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-default-certificate\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:22:47.774550 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.774544 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b3e1a90-2f91-4105-bcc6-64375d2527d2-serving-cert\") pod \"console-operator-76dff48d59-s7b5h\" (UID: \"5b3e1a90-2f91-4105-bcc6-64375d2527d2\") " pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" May 21 21:22:47.774878 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.774857 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-stats-auth\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:22:47.780335 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.780284 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbthq\" (UniqueName: \"kubernetes.io/projected/4b6e44fa-e9e8-4c30-9354-efbfe5194baa-kube-api-access-fbthq\") pod \"cluster-samples-operator-697587599-5l9qb\" (UID: \"4b6e44fa-e9e8-4c30-9354-efbfe5194baa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5l9qb" May 21 21:22:47.780488 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.780415 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rx6c\" (UniqueName: \"kubernetes.io/projected/435d78d6-e6b0-4569-8585-aa2990bdee1f-kube-api-access-7rx6c\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:22:47.780824 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.780789 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2drpw\" (UniqueName: \"kubernetes.io/projected/5b3e1a90-2f91-4105-bcc6-64375d2527d2-kube-api-access-2drpw\") pod \"console-operator-76dff48d59-s7b5h\" (UID: \"5b3e1a90-2f91-4105-bcc6-64375d2527d2\") " pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" May 21 21:22:47.781271 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.781252 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbqms\" (UniqueName: \"kubernetes.io/projected/9a8b5d2d-43b7-4cf3-be4f-62b247e443e9-kube-api-access-hbqms\") pod \"volume-data-source-validator-5cf8c89d64-cjmvr\" (UID: \"9a8b5d2d-43b7-4cf3-be4f-62b247e443e9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-cjmvr" May 21 21:22:47.873946 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.873834 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/330c5249-5f06-42ef-a15b-2a83a215bb8b-tmp\") pod \"insights-operator-78bdfb888c-tns2g\" (UID: \"330c5249-5f06-42ef-a15b-2a83a215bb8b\") " pod="openshift-insights/insights-operator-78bdfb888c-tns2g" May 21 21:22:47.873946 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.873894 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/330c5249-5f06-42ef-a15b-2a83a215bb8b-service-ca-bundle\") pod \"insights-operator-78bdfb888c-tns2g\" (UID: \"330c5249-5f06-42ef-a15b-2a83a215bb8b\") " pod="openshift-insights/insights-operator-78bdfb888c-tns2g" May 21 21:22:47.873946 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.873930 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gmh4p\" (UniqueName: \"kubernetes.io/projected/330c5249-5f06-42ef-a15b-2a83a215bb8b-kube-api-access-gmh4p\") pod \"insights-operator-78bdfb888c-tns2g\" (UID: \"330c5249-5f06-42ef-a15b-2a83a215bb8b\") " pod="openshift-insights/insights-operator-78bdfb888c-tns2g" May 21 21:22:47.874231 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.873989 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/330c5249-5f06-42ef-a15b-2a83a215bb8b-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-tns2g\" (UID: \"330c5249-5f06-42ef-a15b-2a83a215bb8b\") " pod="openshift-insights/insights-operator-78bdfb888c-tns2g" May 21 21:22:47.874231 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.874023 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/330c5249-5f06-42ef-a15b-2a83a215bb8b-snapshots\") pod \"insights-operator-78bdfb888c-tns2g\" (UID: \"330c5249-5f06-42ef-a15b-2a83a215bb8b\") " pod="openshift-insights/insights-operator-78bdfb888c-tns2g" May 21 21:22:47.874231 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.874043 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/330c5249-5f06-42ef-a15b-2a83a215bb8b-serving-cert\") pod \"insights-operator-78bdfb888c-tns2g\" (UID: \"330c5249-5f06-42ef-a15b-2a83a215bb8b\") " pod="openshift-insights/insights-operator-78bdfb888c-tns2g" May 21 21:22:47.874421 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.874400 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/330c5249-5f06-42ef-a15b-2a83a215bb8b-tmp\") pod \"insights-operator-78bdfb888c-tns2g\" (UID: \"330c5249-5f06-42ef-a15b-2a83a215bb8b\") " pod="openshift-insights/insights-operator-78bdfb888c-tns2g" May 21 21:22:47.874617 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.874587 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/330c5249-5f06-42ef-a15b-2a83a215bb8b-snapshots\") pod \"insights-operator-78bdfb888c-tns2g\" (UID: \"330c5249-5f06-42ef-a15b-2a83a215bb8b\") " pod="openshift-insights/insights-operator-78bdfb888c-tns2g" May 21 21:22:47.874755 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.874628 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/330c5249-5f06-42ef-a15b-2a83a215bb8b-service-ca-bundle\") pod \"insights-operator-78bdfb888c-tns2g\" (UID: \"330c5249-5f06-42ef-a15b-2a83a215bb8b\") " pod="openshift-insights/insights-operator-78bdfb888c-tns2g" May 21 21:22:47.874967 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.874940 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/330c5249-5f06-42ef-a15b-2a83a215bb8b-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-tns2g\" (UID: \"330c5249-5f06-42ef-a15b-2a83a215bb8b\") " pod="openshift-insights/insights-operator-78bdfb888c-tns2g" May 21 21:22:47.876411 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.876391 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/330c5249-5f06-42ef-a15b-2a83a215bb8b-serving-cert\") pod \"insights-operator-78bdfb888c-tns2g\" (UID: \"330c5249-5f06-42ef-a15b-2a83a215bb8b\") " pod="openshift-insights/insights-operator-78bdfb888c-tns2g" May 21 21:22:47.881927 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.881906 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmh4p\" (UniqueName: \"kubernetes.io/projected/330c5249-5f06-42ef-a15b-2a83a215bb8b-kube-api-access-gmh4p\") pod \"insights-operator-78bdfb888c-tns2g\" (UID: \"330c5249-5f06-42ef-a15b-2a83a215bb8b\") " pod="openshift-insights/insights-operator-78bdfb888c-tns2g" May 21 21:22:47.935068 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.935017 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-cjmvr" May 21 21:22:47.948152 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:47.948120 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" May 21 21:22:48.038113 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:48.038081 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-tns2g" May 21 21:22:48.062751 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:48.062633 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-cjmvr"] May 21 21:22:48.065380 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:22:48.065350 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a8b5d2d_43b7_4cf3_be4f_62b247e443e9.slice/crio-062542ee0f6f670345502a071720176f2f2d2b863184f703da29958aa8369c3e WatchSource:0}: Error finding container 062542ee0f6f670345502a071720176f2f2d2b863184f703da29958aa8369c3e: Status 404 returned error can't find the container with id 062542ee0f6f670345502a071720176f2f2d2b863184f703da29958aa8369c3e May 21 21:22:48.079839 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:48.079804 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-s7b5h"] May 21 21:22:48.083565 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:22:48.083535 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b3e1a90_2f91_4105_bcc6_64375d2527d2.slice/crio-95d0de6d7e43eb6d4a8ed45afa1a88ba5c65139262e112130a10f6021aae2cdb WatchSource:0}: Error finding container 95d0de6d7e43eb6d4a8ed45afa1a88ba5c65139262e112130a10f6021aae2cdb: Status 404 returned error can't find the container with id 95d0de6d7e43eb6d4a8ed45afa1a88ba5c65139262e112130a10f6021aae2cdb May 21 21:22:48.137229 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:48.137145 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" event={"ID":"5b3e1a90-2f91-4105-bcc6-64375d2527d2","Type":"ContainerStarted","Data":"95d0de6d7e43eb6d4a8ed45afa1a88ba5c65139262e112130a10f6021aae2cdb"} May 21 21:22:48.138164 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:48.138134 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-cjmvr" event={"ID":"9a8b5d2d-43b7-4cf3-be4f-62b247e443e9","Type":"ContainerStarted","Data":"062542ee0f6f670345502a071720176f2f2d2b863184f703da29958aa8369c3e"} May 21 21:22:48.167744 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:48.167708 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-tns2g"] May 21 21:22:48.171025 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:22:48.171000 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod330c5249_5f06_42ef_a15b_2a83a215bb8b.slice/crio-1d99107f632bc34443f32d317254ea58c072fa9d777fd83a9938fa83626dfbe6 WatchSource:0}: Error finding container 1d99107f632bc34443f32d317254ea58c072fa9d777fd83a9938fa83626dfbe6: Status 404 returned error can't find the container with id 1d99107f632bc34443f32d317254ea58c072fa9d777fd83a9938fa83626dfbe6 May 21 21:22:48.278781 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:48.278743 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/435d78d6-e6b0-4569-8585-aa2990bdee1f-service-ca-bundle\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:22:48.278961 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:48.278809 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-metrics-certs\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:22:48.278961 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:48.278870 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b6e44fa-e9e8-4c30-9354-efbfe5194baa-samples-operator-tls\") pod \"cluster-samples-operator-697587599-5l9qb\" (UID: \"4b6e44fa-e9e8-4c30-9354-efbfe5194baa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5l9qb" May 21 21:22:48.278961 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:48.278903 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 21:22:48.278961 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:48.278918 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/435d78d6-e6b0-4569-8585-aa2990bdee1f-service-ca-bundle podName:435d78d6-e6b0-4569-8585-aa2990bdee1f nodeName:}" failed. No retries permitted until 2026-05-21 21:22:49.278901081 +0000 UTC m=+105.100498480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/435d78d6-e6b0-4569-8585-aa2990bdee1f-service-ca-bundle") pod "router-default-94b86d8cb-4w4s6" (UID: "435d78d6-e6b0-4569-8585-aa2990bdee1f") : configmap references non-existent config key: service-ca.crt May 21 21:22:48.278961 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:48.278950 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-metrics-certs podName:435d78d6-e6b0-4569-8585-aa2990bdee1f nodeName:}" failed. No retries permitted until 2026-05-21 21:22:49.278937909 +0000 UTC m=+105.100535308 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-metrics-certs") pod "router-default-94b86d8cb-4w4s6" (UID: "435d78d6-e6b0-4569-8585-aa2990bdee1f") : secret "router-metrics-certs-default" not found May 21 21:22:48.279162 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:48.278967 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 21:22:48.279162 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:48.279005 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b6e44fa-e9e8-4c30-9354-efbfe5194baa-samples-operator-tls podName:4b6e44fa-e9e8-4c30-9354-efbfe5194baa nodeName:}" failed. No retries permitted until 2026-05-21 21:22:49.278994991 +0000 UTC m=+105.100592390 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4b6e44fa-e9e8-4c30-9354-efbfe5194baa-samples-operator-tls") pod "cluster-samples-operator-697587599-5l9qb" (UID: "4b6e44fa-e9e8-4c30-9354-efbfe5194baa") : secret "samples-operator-tls" not found May 21 21:22:49.141984 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:49.141932 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-tns2g" event={"ID":"330c5249-5f06-42ef-a15b-2a83a215bb8b","Type":"ContainerStarted","Data":"1d99107f632bc34443f32d317254ea58c072fa9d777fd83a9938fa83626dfbe6"} May 21 21:22:49.288270 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:49.288190 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-metrics-certs\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:22:49.288270 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:49.288272 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b6e44fa-e9e8-4c30-9354-efbfe5194baa-samples-operator-tls\") pod \"cluster-samples-operator-697587599-5l9qb\" (UID: \"4b6e44fa-e9e8-4c30-9354-efbfe5194baa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5l9qb" May 21 21:22:49.288528 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:49.288405 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 21:22:49.288528 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:49.288459 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/435d78d6-e6b0-4569-8585-aa2990bdee1f-service-ca-bundle\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:22:49.288528 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:49.288468 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b6e44fa-e9e8-4c30-9354-efbfe5194baa-samples-operator-tls podName:4b6e44fa-e9e8-4c30-9354-efbfe5194baa nodeName:}" failed. No retries permitted until 2026-05-21 21:22:51.288449303 +0000 UTC m=+107.110046716 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4b6e44fa-e9e8-4c30-9354-efbfe5194baa-samples-operator-tls") pod "cluster-samples-operator-697587599-5l9qb" (UID: "4b6e44fa-e9e8-4c30-9354-efbfe5194baa") : secret "samples-operator-tls" not found May 21 21:22:49.288722 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:49.288643 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/435d78d6-e6b0-4569-8585-aa2990bdee1f-service-ca-bundle podName:435d78d6-e6b0-4569-8585-aa2990bdee1f nodeName:}" failed. No retries permitted until 2026-05-21 21:22:51.288626969 +0000 UTC m=+107.110224392 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/435d78d6-e6b0-4569-8585-aa2990bdee1f-service-ca-bundle") pod "router-default-94b86d8cb-4w4s6" (UID: "435d78d6-e6b0-4569-8585-aa2990bdee1f") : configmap references non-existent config key: service-ca.crt May 21 21:22:49.288722 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:49.288405 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 21:22:49.288722 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:49.288707 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-metrics-certs podName:435d78d6-e6b0-4569-8585-aa2990bdee1f nodeName:}" failed. No retries permitted until 2026-05-21 21:22:51.288676307 +0000 UTC m=+107.110273708 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-metrics-certs") pod "router-default-94b86d8cb-4w4s6" (UID: "435d78d6-e6b0-4569-8585-aa2990bdee1f") : secret "router-metrics-certs-default" not found May 21 21:22:50.146086 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:50.146038 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-cjmvr" event={"ID":"9a8b5d2d-43b7-4cf3-be4f-62b247e443e9","Type":"ContainerStarted","Data":"43df2837488fd302457ca3d2294164c993284169d5be057ca72bfa3a1dff304d"} May 21 21:22:50.161437 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:50.161356 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-cjmvr" podStartSLOduration=1.6138911249999999 podStartE2EDuration="3.161333829s" podCreationTimestamp="2026-05-21 21:22:47 +0000 UTC" firstStartedPulling="2026-05-21 21:22:48.067061013 +0000 UTC m=+103.888658413" lastFinishedPulling="2026-05-21 21:22:49.614503707 +0000 UTC m=+105.436101117" observedRunningTime="2026-05-21 21:22:50.160385737 +0000 UTC m=+105.981983158" watchObservedRunningTime="2026-05-21 21:22:50.161333829 +0000 UTC m=+105.982931251" May 21 21:22:51.149722 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:51.149663 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-tns2g" event={"ID":"330c5249-5f06-42ef-a15b-2a83a215bb8b","Type":"ContainerStarted","Data":"1eef774be144d1faa32b2d753d61751c3cd107077002218cb22586245daa2970"} May 21 21:22:51.151124 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:51.151102 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-s7b5h_5b3e1a90-2f91-4105-bcc6-64375d2527d2/console-operator/0.log" May 21 21:22:51.151231 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:51.151140 2572 generic.go:358] "Generic (PLEG): container finished" podID="5b3e1a90-2f91-4105-bcc6-64375d2527d2" containerID="1f832bc6467fa1d59ecd35156c14e4a94f225d85870344345b7e356735fc294a" exitCode=255 May 21 21:22:51.151231 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:51.151211 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" event={"ID":"5b3e1a90-2f91-4105-bcc6-64375d2527d2","Type":"ContainerDied","Data":"1f832bc6467fa1d59ecd35156c14e4a94f225d85870344345b7e356735fc294a"} May 21 21:22:51.151389 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:51.151378 2572 scope.go:117] "RemoveContainer" containerID="1f832bc6467fa1d59ecd35156c14e4a94f225d85870344345b7e356735fc294a" May 21 21:22:51.167714 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:51.167652 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-tns2g" podStartSLOduration=1.578053454 podStartE2EDuration="4.16763878s" podCreationTimestamp="2026-05-21 21:22:47 +0000 UTC" firstStartedPulling="2026-05-21 21:22:48.172869334 +0000 UTC m=+103.994466732" lastFinishedPulling="2026-05-21 21:22:50.762454659 +0000 UTC m=+106.584052058" observedRunningTime="2026-05-21 21:22:51.166612139 +0000 UTC m=+106.988209560" watchObservedRunningTime="2026-05-21 21:22:51.16763878 +0000 UTC m=+106.989236201" May 21 21:22:51.306912 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:51.306863 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/435d78d6-e6b0-4569-8585-aa2990bdee1f-service-ca-bundle\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:22:51.307065 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:51.306965 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-metrics-certs\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:22:51.307065 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:51.307020 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b6e44fa-e9e8-4c30-9354-efbfe5194baa-samples-operator-tls\") pod \"cluster-samples-operator-697587599-5l9qb\" (UID: \"4b6e44fa-e9e8-4c30-9354-efbfe5194baa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5l9qb" May 21 21:22:51.307065 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:51.307039 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/435d78d6-e6b0-4569-8585-aa2990bdee1f-service-ca-bundle podName:435d78d6-e6b0-4569-8585-aa2990bdee1f nodeName:}" failed. No retries permitted until 2026-05-21 21:22:55.307013195 +0000 UTC m=+111.128610594 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/435d78d6-e6b0-4569-8585-aa2990bdee1f-service-ca-bundle") pod "router-default-94b86d8cb-4w4s6" (UID: "435d78d6-e6b0-4569-8585-aa2990bdee1f") : configmap references non-existent config key: service-ca.crt May 21 21:22:51.307205 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:51.307105 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 21:22:51.307205 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:51.307153 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-metrics-certs podName:435d78d6-e6b0-4569-8585-aa2990bdee1f nodeName:}" failed. No retries permitted until 2026-05-21 21:22:55.307141271 +0000 UTC m=+111.128738674 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-metrics-certs") pod "router-default-94b86d8cb-4w4s6" (UID: "435d78d6-e6b0-4569-8585-aa2990bdee1f") : secret "router-metrics-certs-default" not found May 21 21:22:51.307205 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:51.307109 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 21:22:51.307205 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:51.307185 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b6e44fa-e9e8-4c30-9354-efbfe5194baa-samples-operator-tls podName:4b6e44fa-e9e8-4c30-9354-efbfe5194baa nodeName:}" failed. No retries permitted until 2026-05-21 21:22:55.307178188 +0000 UTC m=+111.128775587 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4b6e44fa-e9e8-4c30-9354-efbfe5194baa-samples-operator-tls") pod "cluster-samples-operator-697587599-5l9qb" (UID: "4b6e44fa-e9e8-4c30-9354-efbfe5194baa") : secret "samples-operator-tls" not found May 21 21:22:52.155168 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:52.155140 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-s7b5h_5b3e1a90-2f91-4105-bcc6-64375d2527d2/console-operator/1.log" May 21 21:22:52.155635 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:52.155495 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-s7b5h_5b3e1a90-2f91-4105-bcc6-64375d2527d2/console-operator/0.log" May 21 21:22:52.155635 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:52.155536 2572 generic.go:358] "Generic (PLEG): container finished" podID="5b3e1a90-2f91-4105-bcc6-64375d2527d2" containerID="184e497201e77ba8a08c66ac66f25b6a0f5aa46d75eea5ad7dead9344470d1a3" exitCode=255 May 21 21:22:52.155635 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:52.155622 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" event={"ID":"5b3e1a90-2f91-4105-bcc6-64375d2527d2","Type":"ContainerDied","Data":"184e497201e77ba8a08c66ac66f25b6a0f5aa46d75eea5ad7dead9344470d1a3"} May 21 21:22:52.155822 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:52.155670 2572 scope.go:117] "RemoveContainer" containerID="1f832bc6467fa1d59ecd35156c14e4a94f225d85870344345b7e356735fc294a" May 21 21:22:52.155913 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:52.155893 2572 scope.go:117] "RemoveContainer" containerID="184e497201e77ba8a08c66ac66f25b6a0f5aa46d75eea5ad7dead9344470d1a3" May 21 21:22:52.156083 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:52.156065 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-s7b5h_openshift-console-operator(5b3e1a90-2f91-4105-bcc6-64375d2527d2)\"" pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" podUID="5b3e1a90-2f91-4105-bcc6-64375d2527d2" May 21 21:22:53.159256 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:53.159224 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-s7b5h_5b3e1a90-2f91-4105-bcc6-64375d2527d2/console-operator/1.log" May 21 21:22:53.159662 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:53.159573 2572 scope.go:117] "RemoveContainer" containerID="184e497201e77ba8a08c66ac66f25b6a0f5aa46d75eea5ad7dead9344470d1a3" May 21 21:22:53.159802 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:53.159781 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-s7b5h_openshift-console-operator(5b3e1a90-2f91-4105-bcc6-64375d2527d2)\"" pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" podUID="5b3e1a90-2f91-4105-bcc6-64375d2527d2" May 21 21:22:53.796792 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:53.796758 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-vh5mr"] May 21 21:22:53.800591 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:53.800573 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vh5mr" May 21 21:22:53.802907 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:53.802890 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-tvn5k\"" May 21 21:22:53.806670 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:53.806642 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-vh5mr"] May 21 21:22:53.929830 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:53.929793 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vf8n\" (UniqueName: \"kubernetes.io/projected/5dd183c5-25d7-4e55-b54b-06f28528a1bc-kube-api-access-9vf8n\") pod \"network-check-source-7f44b6dd87-vh5mr\" (UID: \"5dd183c5-25d7-4e55-b54b-06f28528a1bc\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vh5mr" May 21 21:22:54.031153 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:54.031097 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9vf8n\" (UniqueName: \"kubernetes.io/projected/5dd183c5-25d7-4e55-b54b-06f28528a1bc-kube-api-access-9vf8n\") pod \"network-check-source-7f44b6dd87-vh5mr\" (UID: \"5dd183c5-25d7-4e55-b54b-06f28528a1bc\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vh5mr" May 21 21:22:54.038996 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:54.038961 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vf8n\" (UniqueName: \"kubernetes.io/projected/5dd183c5-25d7-4e55-b54b-06f28528a1bc-kube-api-access-9vf8n\") pod \"network-check-source-7f44b6dd87-vh5mr\" (UID: \"5dd183c5-25d7-4e55-b54b-06f28528a1bc\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vh5mr" May 21 21:22:54.110612 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:54.110514 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vh5mr" May 21 21:22:54.159081 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:54.159055 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rzckq_3d5474a2-32a3-4370-8e73-79b7ecbf4fd6/dns-node-resolver/0.log" May 21 21:22:54.233891 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:54.233860 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-vh5mr"] May 21 21:22:54.237131 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:22:54.237104 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dd183c5_25d7_4e55_b54b_06f28528a1bc.slice/crio-c03db75d8dfb12ace7d8ec5390b8fae2fd32646d69a9694d635ad6eff4c80703 WatchSource:0}: Error finding container c03db75d8dfb12ace7d8ec5390b8fae2fd32646d69a9694d635ad6eff4c80703: Status 404 returned error can't find the container with id c03db75d8dfb12ace7d8ec5390b8fae2fd32646d69a9694d635ad6eff4c80703 May 21 21:22:54.759087 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:54.759061 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r8qsv_9262dc43-0cc0-4446-a8d4-570955a0442e/node-ca/0.log" May 21 21:22:55.166437 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:55.166402 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vh5mr" event={"ID":"5dd183c5-25d7-4e55-b54b-06f28528a1bc","Type":"ContainerStarted","Data":"764d2c1d499503a53408ff063b698663b7164797f306089c7066ade77072eef9"} May 21 21:22:55.166437 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:55.166439 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vh5mr" event={"ID":"5dd183c5-25d7-4e55-b54b-06f28528a1bc","Type":"ContainerStarted","Data":"c03db75d8dfb12ace7d8ec5390b8fae2fd32646d69a9694d635ad6eff4c80703"} May 21 21:22:55.181733 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:55.181662 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vh5mr" podStartSLOduration=2.18164642 podStartE2EDuration="2.18164642s" podCreationTimestamp="2026-05-21 21:22:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:22:55.180363679 +0000 UTC m=+111.001961112" watchObservedRunningTime="2026-05-21 21:22:55.18164642 +0000 UTC m=+111.003243840" May 21 21:22:55.342745 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:55.342706 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b6e44fa-e9e8-4c30-9354-efbfe5194baa-samples-operator-tls\") pod \"cluster-samples-operator-697587599-5l9qb\" (UID: \"4b6e44fa-e9e8-4c30-9354-efbfe5194baa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5l9qb" May 21 21:22:55.343216 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:55.342791 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 21:22:55.343216 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:55.342856 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b6e44fa-e9e8-4c30-9354-efbfe5194baa-samples-operator-tls podName:4b6e44fa-e9e8-4c30-9354-efbfe5194baa nodeName:}" failed. No retries permitted until 2026-05-21 21:23:03.342840004 +0000 UTC m=+119.164437403 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4b6e44fa-e9e8-4c30-9354-efbfe5194baa-samples-operator-tls") pod "cluster-samples-operator-697587599-5l9qb" (UID: "4b6e44fa-e9e8-4c30-9354-efbfe5194baa") : secret "samples-operator-tls" not found May 21 21:22:55.343216 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:55.342794 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/435d78d6-e6b0-4569-8585-aa2990bdee1f-service-ca-bundle\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:22:55.343216 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:55.342889 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/435d78d6-e6b0-4569-8585-aa2990bdee1f-service-ca-bundle podName:435d78d6-e6b0-4569-8585-aa2990bdee1f nodeName:}" failed. No retries permitted until 2026-05-21 21:23:03.342872775 +0000 UTC m=+119.164470175 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/435d78d6-e6b0-4569-8585-aa2990bdee1f-service-ca-bundle") pod "router-default-94b86d8cb-4w4s6" (UID: "435d78d6-e6b0-4569-8585-aa2990bdee1f") : configmap references non-existent config key: service-ca.crt May 21 21:22:55.343216 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:55.342983 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-metrics-certs\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:22:55.343216 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:55.343131 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 21:22:55.343216 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:55.343190 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-metrics-certs podName:435d78d6-e6b0-4569-8585-aa2990bdee1f nodeName:}" failed. No retries permitted until 2026-05-21 21:23:03.343176255 +0000 UTC m=+119.164773666 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-metrics-certs") pod "router-default-94b86d8cb-4w4s6" (UID: "435d78d6-e6b0-4569-8585-aa2990bdee1f") : secret "router-metrics-certs-default" not found May 21 21:22:57.949235 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:57.949198 2572 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" May 21 21:22:57.949235 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:57.949241 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" May 21 21:22:57.949642 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:22:57.949611 2572 scope.go:117] "RemoveContainer" containerID="184e497201e77ba8a08c66ac66f25b6a0f5aa46d75eea5ad7dead9344470d1a3" May 21 21:22:57.949816 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:22:57.949798 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-s7b5h_openshift-console-operator(5b3e1a90-2f91-4105-bcc6-64375d2527d2)\"" pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" podUID="5b3e1a90-2f91-4105-bcc6-64375d2527d2" May 21 21:23:03.406109 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:03.406069 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/435d78d6-e6b0-4569-8585-aa2990bdee1f-service-ca-bundle\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:23:03.406610 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:03.406235 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-metrics-certs\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:23:03.406610 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:23:03.406279 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/435d78d6-e6b0-4569-8585-aa2990bdee1f-service-ca-bundle podName:435d78d6-e6b0-4569-8585-aa2990bdee1f nodeName:}" failed. No retries permitted until 2026-05-21 21:23:19.406252445 +0000 UTC m=+135.227849861 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/435d78d6-e6b0-4569-8585-aa2990bdee1f-service-ca-bundle") pod "router-default-94b86d8cb-4w4s6" (UID: "435d78d6-e6b0-4569-8585-aa2990bdee1f") : configmap references non-existent config key: service-ca.crt May 21 21:23:03.406610 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:23:03.406323 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 21:23:03.406610 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:23:03.406370 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-metrics-certs podName:435d78d6-e6b0-4569-8585-aa2990bdee1f nodeName:}" failed. No retries permitted until 2026-05-21 21:23:19.406358466 +0000 UTC m=+135.227955865 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-metrics-certs") pod "router-default-94b86d8cb-4w4s6" (UID: "435d78d6-e6b0-4569-8585-aa2990bdee1f") : secret "router-metrics-certs-default" not found May 21 21:23:03.406610 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:03.406364 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b6e44fa-e9e8-4c30-9354-efbfe5194baa-samples-operator-tls\") pod \"cluster-samples-operator-697587599-5l9qb\" (UID: \"4b6e44fa-e9e8-4c30-9354-efbfe5194baa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5l9qb" May 21 21:23:03.408775 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:03.408753 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b6e44fa-e9e8-4c30-9354-efbfe5194baa-samples-operator-tls\") pod \"cluster-samples-operator-697587599-5l9qb\" (UID: \"4b6e44fa-e9e8-4c30-9354-efbfe5194baa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5l9qb" May 21 21:23:03.540828 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:03.540776 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5l9qb" May 21 21:23:03.670705 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:03.670609 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-5l9qb"] May 21 21:23:04.187438 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:04.187392 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5l9qb" event={"ID":"4b6e44fa-e9e8-4c30-9354-efbfe5194baa","Type":"ContainerStarted","Data":"e4c9b4480b694e04676a15faeca2082e0c263a6c043655cbe4107cac5692b894"} May 21 21:23:06.193430 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:06.193393 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5l9qb" event={"ID":"4b6e44fa-e9e8-4c30-9354-efbfe5194baa","Type":"ContainerStarted","Data":"fe191218d1a117f33682a4ce383a5aae941b67f2b37e8ce939a7d08d998cc8a0"} May 21 21:23:06.193430 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:06.193434 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5l9qb" event={"ID":"4b6e44fa-e9e8-4c30-9354-efbfe5194baa","Type":"ContainerStarted","Data":"07389db4b049c0e8b8ee5cce2d5857cd108de34c4a44cc3a339a5375a215a365"} May 21 21:23:06.208746 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:06.208659 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-5l9qb" podStartSLOduration=17.226137097 podStartE2EDuration="19.208638147s" podCreationTimestamp="2026-05-21 21:22:47 +0000 UTC" firstStartedPulling="2026-05-21 21:23:03.711342016 +0000 UTC m=+119.532939418" lastFinishedPulling="2026-05-21 21:23:05.693843062 +0000 UTC m=+121.515440468" observedRunningTime="2026-05-21 21:23:06.208347806 +0000 UTC m=+122.029945228" watchObservedRunningTime="2026-05-21 21:23:06.208638147 +0000 UTC m=+122.030235570" May 21 21:23:12.740151 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:12.740113 2572 scope.go:117] "RemoveContainer" containerID="184e497201e77ba8a08c66ac66f25b6a0f5aa46d75eea5ad7dead9344470d1a3" May 21 21:23:13.211410 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:13.211380 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-s7b5h_5b3e1a90-2f91-4105-bcc6-64375d2527d2/console-operator/2.log" May 21 21:23:13.211794 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:13.211778 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-s7b5h_5b3e1a90-2f91-4105-bcc6-64375d2527d2/console-operator/1.log" May 21 21:23:13.211867 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:13.211814 2572 generic.go:358] "Generic (PLEG): container finished" podID="5b3e1a90-2f91-4105-bcc6-64375d2527d2" containerID="b9df8bc200c2b1ab0ed7f40cdb26b0d84ff5d4220146ea8a6536c948f3d6308e" exitCode=255 May 21 21:23:13.211904 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:13.211884 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" event={"ID":"5b3e1a90-2f91-4105-bcc6-64375d2527d2","Type":"ContainerDied","Data":"b9df8bc200c2b1ab0ed7f40cdb26b0d84ff5d4220146ea8a6536c948f3d6308e"} May 21 21:23:13.211946 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:13.211924 2572 scope.go:117] "RemoveContainer" containerID="184e497201e77ba8a08c66ac66f25b6a0f5aa46d75eea5ad7dead9344470d1a3" May 21 21:23:13.212289 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:13.212272 2572 scope.go:117] "RemoveContainer" containerID="b9df8bc200c2b1ab0ed7f40cdb26b0d84ff5d4220146ea8a6536c948f3d6308e" May 21 21:23:13.212482 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:23:13.212460 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-s7b5h_openshift-console-operator(5b3e1a90-2f91-4105-bcc6-64375d2527d2)\"" pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" podUID="5b3e1a90-2f91-4105-bcc6-64375d2527d2" May 21 21:23:13.492470 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:13.492372 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs\") pod \"network-metrics-daemon-f84fj\" (UID: \"36b197d1-1cdf-47d2-9c86-c8b3e1dbe565\") " pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:23:13.494802 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:13.494777 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36b197d1-1cdf-47d2-9c86-c8b3e1dbe565-metrics-certs\") pod \"network-metrics-daemon-f84fj\" (UID: \"36b197d1-1cdf-47d2-9c86-c8b3e1dbe565\") " pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:23:13.554023 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:13.553978 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jqv7p\"" May 21 21:23:13.562104 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:13.562076 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f84fj" May 21 21:23:13.684897 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:13.684861 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f84fj"] May 21 21:23:13.687843 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:23:13.687814 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b197d1_1cdf_47d2_9c86_c8b3e1dbe565.slice/crio-3fd0b4639907a9d7729d9cf534de58fce283ff68c4a256a8f79b5e6bf37f4668 WatchSource:0}: Error finding container 3fd0b4639907a9d7729d9cf534de58fce283ff68c4a256a8f79b5e6bf37f4668: Status 404 returned error can't find the container with id 3fd0b4639907a9d7729d9cf534de58fce283ff68c4a256a8f79b5e6bf37f4668 May 21 21:23:14.216645 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:14.216607 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f84fj" event={"ID":"36b197d1-1cdf-47d2-9c86-c8b3e1dbe565","Type":"ContainerStarted","Data":"3fd0b4639907a9d7729d9cf534de58fce283ff68c4a256a8f79b5e6bf37f4668"} May 21 21:23:14.218202 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:14.218177 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-s7b5h_5b3e1a90-2f91-4105-bcc6-64375d2527d2/console-operator/2.log" May 21 21:23:15.221936 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:15.221899 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f84fj" event={"ID":"36b197d1-1cdf-47d2-9c86-c8b3e1dbe565","Type":"ContainerStarted","Data":"01b54e7b38b48c61f777063339c743e30016be2afefea8bee87e779b10206a9c"} May 21 21:23:15.221936 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:15.221935 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f84fj" event={"ID":"36b197d1-1cdf-47d2-9c86-c8b3e1dbe565","Type":"ContainerStarted","Data":"790964c3f1fe999248376532d09d98ca62c302126980f64b233181ce0629fdf9"} May 21 21:23:15.238353 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:15.238294 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-f84fj" podStartSLOduration=130.158570501 podStartE2EDuration="2m11.238277715s" podCreationTimestamp="2026-05-21 21:21:04 +0000 UTC" firstStartedPulling="2026-05-21 21:23:13.689706607 +0000 UTC m=+129.511304012" lastFinishedPulling="2026-05-21 21:23:14.76941381 +0000 UTC m=+130.591011226" observedRunningTime="2026-05-21 21:23:15.237420737 +0000 UTC m=+131.059018176" watchObservedRunningTime="2026-05-21 21:23:15.238277715 +0000 UTC m=+131.059875136" May 21 21:23:17.949009 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:17.948966 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" May 21 21:23:17.949009 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:17.949002 2572 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" May 21 21:23:17.949511 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:17.949319 2572 scope.go:117] "RemoveContainer" containerID="b9df8bc200c2b1ab0ed7f40cdb26b0d84ff5d4220146ea8a6536c948f3d6308e" May 21 21:23:17.949511 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:23:17.949484 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-s7b5h_openshift-console-operator(5b3e1a90-2f91-4105-bcc6-64375d2527d2)\"" pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" podUID="5b3e1a90-2f91-4105-bcc6-64375d2527d2" May 21 21:23:19.440566 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:19.440505 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-metrics-certs\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:23:19.440982 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:19.440601 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/435d78d6-e6b0-4569-8585-aa2990bdee1f-service-ca-bundle\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:23:19.441188 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:19.441169 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/435d78d6-e6b0-4569-8585-aa2990bdee1f-service-ca-bundle\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:23:19.443080 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:19.443054 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/435d78d6-e6b0-4569-8585-aa2990bdee1f-metrics-certs\") pod \"router-default-94b86d8cb-4w4s6\" (UID: \"435d78d6-e6b0-4569-8585-aa2990bdee1f\") " pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:23:19.455351 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:19.455317 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-j7d6s\"" May 21 21:23:19.463458 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:19.463435 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:23:19.591130 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:19.591082 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-94b86d8cb-4w4s6"] May 21 21:23:19.594775 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:23:19.594745 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod435d78d6_e6b0_4569_8585_aa2990bdee1f.slice/crio-fac0d7b42f73c2f5b0033ed046f97f341214bf148df98e8d6802306f0ba7e7de WatchSource:0}: Error finding container fac0d7b42f73c2f5b0033ed046f97f341214bf148df98e8d6802306f0ba7e7de: Status 404 returned error can't find the container with id fac0d7b42f73c2f5b0033ed046f97f341214bf148df98e8d6802306f0ba7e7de May 21 21:23:20.241312 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.241271 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-94b86d8cb-4w4s6" event={"ID":"435d78d6-e6b0-4569-8585-aa2990bdee1f","Type":"ContainerStarted","Data":"d20864af64039cf89b8862597135cc810243063ff169dd6314f4756da33cf3fa"} May 21 21:23:20.241312 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.241315 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-94b86d8cb-4w4s6" event={"ID":"435d78d6-e6b0-4569-8585-aa2990bdee1f","Type":"ContainerStarted","Data":"fac0d7b42f73c2f5b0033ed046f97f341214bf148df98e8d6802306f0ba7e7de"} May 21 21:23:20.464082 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.464045 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:23:20.465989 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.465937 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-94b86d8cb-4w4s6" podStartSLOduration=33.465917194 podStartE2EDuration="33.465917194s" podCreationTimestamp="2026-05-21 21:22:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:23:20.274256995 +0000 UTC m=+136.095854425" watchObservedRunningTime="2026-05-21 21:23:20.465917194 +0000 UTC m=+136.287514617" May 21 21:23:20.466285 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.466264 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9xfxl"] May 21 21:23:20.469821 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.469802 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:23:20.469930 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.469912 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9xfxl" May 21 21:23:20.472375 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.472351 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w6tpj\"" May 21 21:23:20.472606 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.472590 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 21:23:20.472660 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.472620 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 21:23:20.486127 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.486100 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9xfxl"] May 21 21:23:20.650070 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.650041 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/90304d18-b4d5-4b43-9184-eef4a8a712f2-crio-socket\") pod \"insights-runtime-extractor-9xfxl\" (UID: \"90304d18-b4d5-4b43-9184-eef4a8a712f2\") " pod="openshift-insights/insights-runtime-extractor-9xfxl" May 21 21:23:20.650244 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.650102 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/90304d18-b4d5-4b43-9184-eef4a8a712f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xfxl\" (UID: \"90304d18-b4d5-4b43-9184-eef4a8a712f2\") " pod="openshift-insights/insights-runtime-extractor-9xfxl" May 21 21:23:20.650244 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.650129 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hpq7\" (UniqueName: \"kubernetes.io/projected/90304d18-b4d5-4b43-9184-eef4a8a712f2-kube-api-access-6hpq7\") pod \"insights-runtime-extractor-9xfxl\" (UID: \"90304d18-b4d5-4b43-9184-eef4a8a712f2\") " pod="openshift-insights/insights-runtime-extractor-9xfxl" May 21 21:23:20.650244 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.650154 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90304d18-b4d5-4b43-9184-eef4a8a712f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xfxl\" (UID: \"90304d18-b4d5-4b43-9184-eef4a8a712f2\") " pod="openshift-insights/insights-runtime-extractor-9xfxl" May 21 21:23:20.650244 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.650184 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/90304d18-b4d5-4b43-9184-eef4a8a712f2-data-volume\") pod \"insights-runtime-extractor-9xfxl\" (UID: \"90304d18-b4d5-4b43-9184-eef4a8a712f2\") " pod="openshift-insights/insights-runtime-extractor-9xfxl" May 21 21:23:20.750797 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.750767 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/90304d18-b4d5-4b43-9184-eef4a8a712f2-data-volume\") pod \"insights-runtime-extractor-9xfxl\" (UID: \"90304d18-b4d5-4b43-9184-eef4a8a712f2\") " pod="openshift-insights/insights-runtime-extractor-9xfxl" May 21 21:23:20.750963 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.750843 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/90304d18-b4d5-4b43-9184-eef4a8a712f2-crio-socket\") pod \"insights-runtime-extractor-9xfxl\" (UID: \"90304d18-b4d5-4b43-9184-eef4a8a712f2\") " pod="openshift-insights/insights-runtime-extractor-9xfxl" May 21 21:23:20.750963 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.750874 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/90304d18-b4d5-4b43-9184-eef4a8a712f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xfxl\" (UID: \"90304d18-b4d5-4b43-9184-eef4a8a712f2\") " pod="openshift-insights/insights-runtime-extractor-9xfxl" May 21 21:23:20.750963 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.750897 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6hpq7\" (UniqueName: \"kubernetes.io/projected/90304d18-b4d5-4b43-9184-eef4a8a712f2-kube-api-access-6hpq7\") pod \"insights-runtime-extractor-9xfxl\" (UID: \"90304d18-b4d5-4b43-9184-eef4a8a712f2\") " pod="openshift-insights/insights-runtime-extractor-9xfxl" May 21 21:23:20.750963 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.750934 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90304d18-b4d5-4b43-9184-eef4a8a712f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xfxl\" (UID: \"90304d18-b4d5-4b43-9184-eef4a8a712f2\") " pod="openshift-insights/insights-runtime-extractor-9xfxl" May 21 21:23:20.751091 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.750959 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/90304d18-b4d5-4b43-9184-eef4a8a712f2-crio-socket\") pod \"insights-runtime-extractor-9xfxl\" (UID: \"90304d18-b4d5-4b43-9184-eef4a8a712f2\") " pod="openshift-insights/insights-runtime-extractor-9xfxl" May 21 21:23:20.751173 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.751156 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/90304d18-b4d5-4b43-9184-eef4a8a712f2-data-volume\") pod \"insights-runtime-extractor-9xfxl\" (UID: \"90304d18-b4d5-4b43-9184-eef4a8a712f2\") " pod="openshift-insights/insights-runtime-extractor-9xfxl" May 21 21:23:20.751410 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.751390 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/90304d18-b4d5-4b43-9184-eef4a8a712f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xfxl\" (UID: \"90304d18-b4d5-4b43-9184-eef4a8a712f2\") " pod="openshift-insights/insights-runtime-extractor-9xfxl" May 21 21:23:20.753398 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.753380 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90304d18-b4d5-4b43-9184-eef4a8a712f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xfxl\" (UID: \"90304d18-b4d5-4b43-9184-eef4a8a712f2\") " pod="openshift-insights/insights-runtime-extractor-9xfxl" May 21 21:23:20.765273 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.765249 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hpq7\" (UniqueName: \"kubernetes.io/projected/90304d18-b4d5-4b43-9184-eef4a8a712f2-kube-api-access-6hpq7\") pod \"insights-runtime-extractor-9xfxl\" (UID: \"90304d18-b4d5-4b43-9184-eef4a8a712f2\") " pod="openshift-insights/insights-runtime-extractor-9xfxl" May 21 21:23:20.779480 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.779414 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9xfxl" May 21 21:23:20.942503 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:20.942419 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9xfxl"] May 21 21:23:20.945897 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:23:20.945857 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90304d18_b4d5_4b43_9184_eef4a8a712f2.slice/crio-0ff942e8fa9f567b88867fea8db51548227e081bc60e52275c757a1e49b6b29a WatchSource:0}: Error finding container 0ff942e8fa9f567b88867fea8db51548227e081bc60e52275c757a1e49b6b29a: Status 404 returned error can't find the container with id 0ff942e8fa9f567b88867fea8db51548227e081bc60e52275c757a1e49b6b29a May 21 21:23:21.245167 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:21.245078 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9xfxl" event={"ID":"90304d18-b4d5-4b43-9184-eef4a8a712f2","Type":"ContainerStarted","Data":"98e064e61d28089e5b51f334143d4e41d48596d0584e0982aa2467a0613689ef"} May 21 21:23:21.245167 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:21.245128 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9xfxl" event={"ID":"90304d18-b4d5-4b43-9184-eef4a8a712f2","Type":"ContainerStarted","Data":"0ff942e8fa9f567b88867fea8db51548227e081bc60e52275c757a1e49b6b29a"} May 21 21:23:21.245338 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:21.245304 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:23:21.246754 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:21.246726 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-94b86d8cb-4w4s6" May 21 21:23:22.250910 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:22.250874 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9xfxl" event={"ID":"90304d18-b4d5-4b43-9184-eef4a8a712f2","Type":"ContainerStarted","Data":"8f8a99725f87d0e0c9a48889956ce5e4bf5e4499c7964582e454a79c0e519396"} May 21 21:23:23.008497 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:23.008461 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2jcpf"] May 21 21:23:23.011557 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:23.011536 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2jcpf" May 21 21:23:23.014155 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:23.014128 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-q8b84\"" May 21 21:23:23.014311 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:23.014292 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 21 21:23:23.019076 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:23.019046 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2jcpf"] May 21 21:23:23.173260 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:23.173218 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e590a475-e249-478e-b4a3-66bbaa4416cc-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-2jcpf\" (UID: \"e590a475-e249-478e-b4a3-66bbaa4416cc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2jcpf" May 21 21:23:23.274031 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:23.273929 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e590a475-e249-478e-b4a3-66bbaa4416cc-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-2jcpf\" (UID: \"e590a475-e249-478e-b4a3-66bbaa4416cc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2jcpf" May 21 21:23:23.274454 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:23:23.274110 2572 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found May 21 21:23:23.274454 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:23:23.274191 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e590a475-e249-478e-b4a3-66bbaa4416cc-tls-certificates podName:e590a475-e249-478e-b4a3-66bbaa4416cc nodeName:}" failed. No retries permitted until 2026-05-21 21:23:23.774172673 +0000 UTC m=+139.595770075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/e590a475-e249-478e-b4a3-66bbaa4416cc-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-2jcpf" (UID: "e590a475-e249-478e-b4a3-66bbaa4416cc") : secret "prometheus-operator-admission-webhook-tls" not found May 21 21:23:23.778118 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:23.778081 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e590a475-e249-478e-b4a3-66bbaa4416cc-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-2jcpf\" (UID: \"e590a475-e249-478e-b4a3-66bbaa4416cc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2jcpf" May 21 21:23:23.780523 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:23.780502 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e590a475-e249-478e-b4a3-66bbaa4416cc-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-2jcpf\" (UID: \"e590a475-e249-478e-b4a3-66bbaa4416cc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2jcpf" May 21 21:23:23.922729 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:23.922697 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2jcpf" May 21 21:23:24.050206 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:24.050171 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2jcpf"] May 21 21:23:24.055629 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:23:24.055596 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode590a475_e249_478e_b4a3_66bbaa4416cc.slice/crio-4eee54b0552b323a892ba6957c14ea4526a1c98d5ce8eb71da84b23d01c6b4b4 WatchSource:0}: Error finding container 4eee54b0552b323a892ba6957c14ea4526a1c98d5ce8eb71da84b23d01c6b4b4: Status 404 returned error can't find the container with id 4eee54b0552b323a892ba6957c14ea4526a1c98d5ce8eb71da84b23d01c6b4b4 May 21 21:23:24.258227 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:24.258134 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2jcpf" event={"ID":"e590a475-e249-478e-b4a3-66bbaa4416cc","Type":"ContainerStarted","Data":"4eee54b0552b323a892ba6957c14ea4526a1c98d5ce8eb71da84b23d01c6b4b4"} May 21 21:23:24.259886 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:24.259860 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9xfxl" event={"ID":"90304d18-b4d5-4b43-9184-eef4a8a712f2","Type":"ContainerStarted","Data":"ffb5cf2c65c29888056561eeb1bf81b579ecd24df35c2833ec7d876a49a6b1d2"} May 21 21:23:24.277991 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:24.277934 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9xfxl" podStartSLOduration=1.737219963 podStartE2EDuration="4.27791919s" podCreationTimestamp="2026-05-21 21:23:20 +0000 UTC" firstStartedPulling="2026-05-21 21:23:21.00093295 +0000 UTC m=+136.822530349" lastFinishedPulling="2026-05-21 21:23:23.541632173 +0000 UTC m=+139.363229576" observedRunningTime="2026-05-21 21:23:24.276958982 +0000 UTC m=+140.098556402" watchObservedRunningTime="2026-05-21 21:23:24.27791919 +0000 UTC m=+140.099516610" May 21 21:23:26.267664 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:26.267624 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2jcpf" event={"ID":"e590a475-e249-478e-b4a3-66bbaa4416cc","Type":"ContainerStarted","Data":"1379061d4ad9d67adcdf2f9f2a4c7db7cd9034a253694b633cfdd2b069825810"} May 21 21:23:26.268054 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:26.267948 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2jcpf" May 21 21:23:26.272704 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:26.272667 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2jcpf" May 21 21:23:26.288301 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:26.288204 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2jcpf" podStartSLOduration=3.023537754 podStartE2EDuration="4.288191688s" podCreationTimestamp="2026-05-21 21:23:22 +0000 UTC" firstStartedPulling="2026-05-21 21:23:24.058266192 +0000 UTC m=+139.879863592" lastFinishedPulling="2026-05-21 21:23:25.322920113 +0000 UTC m=+141.144517526" observedRunningTime="2026-05-21 21:23:26.287466287 +0000 UTC m=+142.109063709" watchObservedRunningTime="2026-05-21 21:23:26.288191688 +0000 UTC m=+142.109789108" May 21 21:23:27.080321 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:27.080280 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-gzb4k"] May 21 21:23:27.082625 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:27.082609 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gzb4k" May 21 21:23:27.085182 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:27.085157 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 21 21:23:27.086227 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:27.086199 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 21:23:27.086478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:27.086460 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 21:23:27.086576 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:27.086498 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 21:23:27.086576 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:27.086511 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 21 21:23:27.086708 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:27.086577 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-nbtwl\"" May 21 21:23:27.091788 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:27.091764 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-gzb4k"] May 21 21:23:27.203670 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:27.203633 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4aee03ea-f387-4671-a8a4-32f76b915ef1-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-gzb4k\" (UID: \"4aee03ea-f387-4671-a8a4-32f76b915ef1\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gzb4k" May 21 21:23:27.203897 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:27.203734 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4aee03ea-f387-4671-a8a4-32f76b915ef1-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-gzb4k\" (UID: \"4aee03ea-f387-4671-a8a4-32f76b915ef1\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gzb4k" May 21 21:23:27.203897 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:27.203772 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz728\" (UniqueName: \"kubernetes.io/projected/4aee03ea-f387-4671-a8a4-32f76b915ef1-kube-api-access-sz728\") pod \"prometheus-operator-7779bbdd78-gzb4k\" (UID: \"4aee03ea-f387-4671-a8a4-32f76b915ef1\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gzb4k" May 21 21:23:27.203897 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:27.203800 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4aee03ea-f387-4671-a8a4-32f76b915ef1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-gzb4k\" (UID: \"4aee03ea-f387-4671-a8a4-32f76b915ef1\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gzb4k" May 21 21:23:27.304422 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:27.304388 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4aee03ea-f387-4671-a8a4-32f76b915ef1-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-gzb4k\" (UID: \"4aee03ea-f387-4671-a8a4-32f76b915ef1\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gzb4k" May 21 21:23:27.304850 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:27.304443 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sz728\" (UniqueName: \"kubernetes.io/projected/4aee03ea-f387-4671-a8a4-32f76b915ef1-kube-api-access-sz728\") pod \"prometheus-operator-7779bbdd78-gzb4k\" (UID: \"4aee03ea-f387-4671-a8a4-32f76b915ef1\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gzb4k" May 21 21:23:27.304850 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:27.304471 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4aee03ea-f387-4671-a8a4-32f76b915ef1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-gzb4k\" (UID: \"4aee03ea-f387-4671-a8a4-32f76b915ef1\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gzb4k" May 21 21:23:27.304850 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:27.304501 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4aee03ea-f387-4671-a8a4-32f76b915ef1-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-gzb4k\" (UID: \"4aee03ea-f387-4671-a8a4-32f76b915ef1\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gzb4k" May 21 21:23:27.305168 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:27.305146 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4aee03ea-f387-4671-a8a4-32f76b915ef1-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-gzb4k\" (UID: \"4aee03ea-f387-4671-a8a4-32f76b915ef1\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gzb4k" May 21 21:23:27.306894 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:27.306869 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4aee03ea-f387-4671-a8a4-32f76b915ef1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-gzb4k\" (UID: \"4aee03ea-f387-4671-a8a4-32f76b915ef1\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gzb4k" May 21 21:23:27.307018 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:27.307001 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4aee03ea-f387-4671-a8a4-32f76b915ef1-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-gzb4k\" (UID: \"4aee03ea-f387-4671-a8a4-32f76b915ef1\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gzb4k" May 21 21:23:27.315379 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:27.315350 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz728\" (UniqueName: \"kubernetes.io/projected/4aee03ea-f387-4671-a8a4-32f76b915ef1-kube-api-access-sz728\") pod \"prometheus-operator-7779bbdd78-gzb4k\" (UID: \"4aee03ea-f387-4671-a8a4-32f76b915ef1\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gzb4k" May 21 21:23:27.393342 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:27.393250 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gzb4k" May 21 21:23:27.523169 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:27.523135 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-gzb4k"] May 21 21:23:27.526343 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:23:27.526315 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aee03ea_f387_4671_a8a4_32f76b915ef1.slice/crio-73c0c851335844846741d0d9bc434d3fa1ab0187999eff569e8f2992dda1db00 WatchSource:0}: Error finding container 73c0c851335844846741d0d9bc434d3fa1ab0187999eff569e8f2992dda1db00: Status 404 returned error can't find the container with id 73c0c851335844846741d0d9bc434d3fa1ab0187999eff569e8f2992dda1db00 May 21 21:23:28.274151 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:28.274110 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gzb4k" event={"ID":"4aee03ea-f387-4671-a8a4-32f76b915ef1","Type":"ContainerStarted","Data":"73c0c851335844846741d0d9bc434d3fa1ab0187999eff569e8f2992dda1db00"} May 21 21:23:29.278141 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:29.278096 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gzb4k" event={"ID":"4aee03ea-f387-4671-a8a4-32f76b915ef1","Type":"ContainerStarted","Data":"b784defcd99a0a18892e938e118f3174c6f49ae353cae8e776bccad5e70ab3de"} May 21 21:23:29.278141 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:29.278143 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gzb4k" event={"ID":"4aee03ea-f387-4671-a8a4-32f76b915ef1","Type":"ContainerStarted","Data":"522b18afef9b601299b643355932197580109b50c0dfde329a136fe43ce50094"} May 21 21:23:29.295019 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:29.294960 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gzb4k" podStartSLOduration=0.94126613 podStartE2EDuration="2.294942047s" podCreationTimestamp="2026-05-21 21:23:27 +0000 UTC" firstStartedPulling="2026-05-21 21:23:27.528234304 +0000 UTC m=+143.349831703" lastFinishedPulling="2026-05-21 21:23:28.881910216 +0000 UTC m=+144.703507620" observedRunningTime="2026-05-21 21:23:29.293329496 +0000 UTC m=+145.114926932" watchObservedRunningTime="2026-05-21 21:23:29.294942047 +0000 UTC m=+145.116539467" May 21 21:23:30.740109 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:30.740071 2572 scope.go:117] "RemoveContainer" containerID="b9df8bc200c2b1ab0ed7f40cdb26b0d84ff5d4220146ea8a6536c948f3d6308e" May 21 21:23:30.740587 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:23:30.740301 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-s7b5h_openshift-console-operator(5b3e1a90-2f91-4105-bcc6-64375d2527d2)\"" pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" podUID="5b3e1a90-2f91-4105-bcc6-64375d2527d2" May 21 21:23:31.486493 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.486448 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-jrhv7"] May 21 21:23:31.489996 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.489969 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-jrhv7" May 21 21:23:31.492532 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.492508 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-r2szr\"" May 21 21:23:31.492650 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.492509 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 21 21:23:31.492650 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.492626 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 21 21:23:31.501447 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.501424 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-jrhv7"] May 21 21:23:31.511408 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.511379 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5j6h6"] May 21 21:23:31.514666 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.514648 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.517476 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.517452 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 21:23:31.517700 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.517664 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 21:23:31.518022 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.518000 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 21:23:31.518233 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.518221 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lb4kv\"" May 21 21:23:31.539042 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.539008 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc5561be-0755-4d68-a1b7-5086ba5e366b-metrics-client-ca\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.539283 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.539264 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc5561be-0755-4d68-a1b7-5086ba5e366b-sys\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.539421 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.539401 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/098692c5-9775-4c5a-9da0-5ecddb242ab6-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-jrhv7\" (UID: \"098692c5-9775-4c5a-9da0-5ecddb242ab6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-jrhv7" May 21 21:23:31.539545 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.539433 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc5561be-0755-4d68-a1b7-5086ba5e366b-root\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.539545 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.539473 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbsx5\" (UniqueName: \"kubernetes.io/projected/098692c5-9775-4c5a-9da0-5ecddb242ab6-kube-api-access-fbsx5\") pod \"openshift-state-metrics-9c959559f-jrhv7\" (UID: \"098692c5-9775-4c5a-9da0-5ecddb242ab6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-jrhv7" May 21 21:23:31.539661 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.539555 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc5561be-0755-4d68-a1b7-5086ba5e366b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.539661 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.539593 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc5561be-0755-4d68-a1b7-5086ba5e366b-node-exporter-textfile\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.539661 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.539635 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc5561be-0755-4d68-a1b7-5086ba5e366b-node-exporter-wtmp\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.539840 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.539666 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc5561be-0755-4d68-a1b7-5086ba5e366b-node-exporter-accelerators-collector-config\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.539840 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.539719 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vhmk\" (UniqueName: \"kubernetes.io/projected/bc5561be-0755-4d68-a1b7-5086ba5e366b-kube-api-access-8vhmk\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.539840 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.539747 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc5561be-0755-4d68-a1b7-5086ba5e366b-node-exporter-tls\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.539840 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.539782 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/098692c5-9775-4c5a-9da0-5ecddb242ab6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-jrhv7\" (UID: \"098692c5-9775-4c5a-9da0-5ecddb242ab6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-jrhv7" May 21 21:23:31.539840 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.539808 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/098692c5-9775-4c5a-9da0-5ecddb242ab6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-jrhv7\" (UID: \"098692c5-9775-4c5a-9da0-5ecddb242ab6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-jrhv7" May 21 21:23:31.641081 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.641036 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc5561be-0755-4d68-a1b7-5086ba5e366b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.641081 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.641080 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc5561be-0755-4d68-a1b7-5086ba5e366b-node-exporter-textfile\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.641345 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.641108 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc5561be-0755-4d68-a1b7-5086ba5e366b-node-exporter-wtmp\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.641345 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.641218 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc5561be-0755-4d68-a1b7-5086ba5e366b-node-exporter-wtmp\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.641345 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.641230 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc5561be-0755-4d68-a1b7-5086ba5e366b-node-exporter-accelerators-collector-config\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.641345 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.641274 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8vhmk\" (UniqueName: \"kubernetes.io/projected/bc5561be-0755-4d68-a1b7-5086ba5e366b-kube-api-access-8vhmk\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.641345 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.641295 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc5561be-0755-4d68-a1b7-5086ba5e366b-node-exporter-tls\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.641345 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.641324 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/098692c5-9775-4c5a-9da0-5ecddb242ab6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-jrhv7\" (UID: \"098692c5-9775-4c5a-9da0-5ecddb242ab6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-jrhv7" May 21 21:23:31.641345 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.641348 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/098692c5-9775-4c5a-9da0-5ecddb242ab6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-jrhv7\" (UID: \"098692c5-9775-4c5a-9da0-5ecddb242ab6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-jrhv7" May 21 21:23:31.641712 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:23:31.641394 2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 21 21:23:31.641712 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.641405 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc5561be-0755-4d68-a1b7-5086ba5e366b-metrics-client-ca\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.641712 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.641436 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc5561be-0755-4d68-a1b7-5086ba5e366b-sys\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.641712 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:23:31.641452 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc5561be-0755-4d68-a1b7-5086ba5e366b-node-exporter-tls podName:bc5561be-0755-4d68-a1b7-5086ba5e366b nodeName:}" failed. No retries permitted until 2026-05-21 21:23:32.141432229 +0000 UTC m=+147.963029637 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/bc5561be-0755-4d68-a1b7-5086ba5e366b-node-exporter-tls") pod "node-exporter-5j6h6" (UID: "bc5561be-0755-4d68-a1b7-5086ba5e366b") : secret "node-exporter-tls" not found May 21 21:23:31.641712 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.641487 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc5561be-0755-4d68-a1b7-5086ba5e366b-sys\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.641712 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.641492 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/098692c5-9775-4c5a-9da0-5ecddb242ab6-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-jrhv7\" (UID: \"098692c5-9775-4c5a-9da0-5ecddb242ab6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-jrhv7" May 21 21:23:31.641712 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:23:31.641491 2572 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 21 21:23:31.641712 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.641539 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc5561be-0755-4d68-a1b7-5086ba5e366b-root\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.641712 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:23:31.641566 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/098692c5-9775-4c5a-9da0-5ecddb242ab6-openshift-state-metrics-tls podName:098692c5-9775-4c5a-9da0-5ecddb242ab6 nodeName:}" failed. No retries permitted until 2026-05-21 21:23:32.141548603 +0000 UTC m=+147.963146002 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/098692c5-9775-4c5a-9da0-5ecddb242ab6-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-jrhv7" (UID: "098692c5-9775-4c5a-9da0-5ecddb242ab6") : secret "openshift-state-metrics-tls" not found May 21 21:23:31.641712 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.641575 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc5561be-0755-4d68-a1b7-5086ba5e366b-root\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.642229 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.641737 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fbsx5\" (UniqueName: \"kubernetes.io/projected/098692c5-9775-4c5a-9da0-5ecddb242ab6-kube-api-access-fbsx5\") pod \"openshift-state-metrics-9c959559f-jrhv7\" (UID: \"098692c5-9775-4c5a-9da0-5ecddb242ab6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-jrhv7" May 21 21:23:31.642229 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.641773 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc5561be-0755-4d68-a1b7-5086ba5e366b-node-exporter-textfile\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.642229 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.642039 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc5561be-0755-4d68-a1b7-5086ba5e366b-node-exporter-accelerators-collector-config\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.642229 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.642112 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc5561be-0755-4d68-a1b7-5086ba5e366b-metrics-client-ca\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.642447 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.642250 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/098692c5-9775-4c5a-9da0-5ecddb242ab6-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-jrhv7\" (UID: \"098692c5-9775-4c5a-9da0-5ecddb242ab6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-jrhv7" May 21 21:23:31.643801 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.643775 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc5561be-0755-4d68-a1b7-5086ba5e366b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:31.643922 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.643811 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/098692c5-9775-4c5a-9da0-5ecddb242ab6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-jrhv7\" (UID: \"098692c5-9775-4c5a-9da0-5ecddb242ab6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-jrhv7" May 21 21:23:31.651261 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.651231 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbsx5\" (UniqueName: \"kubernetes.io/projected/098692c5-9775-4c5a-9da0-5ecddb242ab6-kube-api-access-fbsx5\") pod \"openshift-state-metrics-9c959559f-jrhv7\" (UID: \"098692c5-9775-4c5a-9da0-5ecddb242ab6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-jrhv7" May 21 21:23:31.651547 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:31.651525 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vhmk\" (UniqueName: \"kubernetes.io/projected/bc5561be-0755-4d68-a1b7-5086ba5e366b-kube-api-access-8vhmk\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:32.148025 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:32.147991 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc5561be-0755-4d68-a1b7-5086ba5e366b-node-exporter-tls\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:32.148394 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:32.148034 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/098692c5-9775-4c5a-9da0-5ecddb242ab6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-jrhv7\" (UID: \"098692c5-9775-4c5a-9da0-5ecddb242ab6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-jrhv7" May 21 21:23:32.150505 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:32.150468 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc5561be-0755-4d68-a1b7-5086ba5e366b-node-exporter-tls\") pod \"node-exporter-5j6h6\" (UID: \"bc5561be-0755-4d68-a1b7-5086ba5e366b\") " pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:32.150635 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:32.150550 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/098692c5-9775-4c5a-9da0-5ecddb242ab6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-jrhv7\" (UID: \"098692c5-9775-4c5a-9da0-5ecddb242ab6\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-jrhv7" May 21 21:23:32.399498 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:32.399416 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-jrhv7" May 21 21:23:32.424300 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:32.424263 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5j6h6" May 21 21:23:32.433260 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:23:32.433230 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc5561be_0755_4d68_a1b7_5086ba5e366b.slice/crio-3b8f516f9553446232a957e6fc1fab8c8624e79f42f065ebaf1f17b1b6daaaf6 WatchSource:0}: Error finding container 3b8f516f9553446232a957e6fc1fab8c8624e79f42f065ebaf1f17b1b6daaaf6: Status 404 returned error can't find the container with id 3b8f516f9553446232a957e6fc1fab8c8624e79f42f065ebaf1f17b1b6daaaf6 May 21 21:23:32.547172 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:32.547147 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-jrhv7"] May 21 21:23:32.550073 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:23:32.550031 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod098692c5_9775_4c5a_9da0_5ecddb242ab6.slice/crio-830cbd67fe142c86d58c048722783c5c787011572658ab66dc73abd0a12fd1e0 WatchSource:0}: Error finding container 830cbd67fe142c86d58c048722783c5c787011572658ab66dc73abd0a12fd1e0: Status 404 returned error can't find the container with id 830cbd67fe142c86d58c048722783c5c787011572658ab66dc73abd0a12fd1e0 May 21 21:23:33.292724 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:33.292669 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-jrhv7" event={"ID":"098692c5-9775-4c5a-9da0-5ecddb242ab6","Type":"ContainerStarted","Data":"c1c9de637257212f70e5ea89ed17e8d2de105bae8dcd9a4e0f511727554e71a6"} May 21 21:23:33.293093 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:33.292736 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-jrhv7" event={"ID":"098692c5-9775-4c5a-9da0-5ecddb242ab6","Type":"ContainerStarted","Data":"1faa71e3a553df5ae1c1e4a1edb88eea7fd757fcbde792103e667af926434ccd"} May 21 21:23:33.293093 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:33.292752 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-jrhv7" event={"ID":"098692c5-9775-4c5a-9da0-5ecddb242ab6","Type":"ContainerStarted","Data":"830cbd67fe142c86d58c048722783c5c787011572658ab66dc73abd0a12fd1e0"} May 21 21:23:33.294286 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:33.294252 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5j6h6" event={"ID":"bc5561be-0755-4d68-a1b7-5086ba5e366b","Type":"ContainerStarted","Data":"3b8f516f9553446232a957e6fc1fab8c8624e79f42f065ebaf1f17b1b6daaaf6"} May 21 21:23:34.302256 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:34.302219 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-jrhv7" event={"ID":"098692c5-9775-4c5a-9da0-5ecddb242ab6","Type":"ContainerStarted","Data":"2e1c7bfd7b4fd1cb0f174efc44e23a1232334c98d8a9ed8f59ea5320b6ba375c"} May 21 21:23:34.303518 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:34.303495 2572 generic.go:358] "Generic (PLEG): container finished" podID="bc5561be-0755-4d68-a1b7-5086ba5e366b" containerID="0fe4ce0702a7e2c8278fa3bf3eadf476a6f62f934dff45d515dc26e896d2a68d" exitCode=0 May 21 21:23:34.303627 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:34.303547 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5j6h6" event={"ID":"bc5561be-0755-4d68-a1b7-5086ba5e366b","Type":"ContainerDied","Data":"0fe4ce0702a7e2c8278fa3bf3eadf476a6f62f934dff45d515dc26e896d2a68d"} May 21 21:23:34.334396 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:34.334337 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-jrhv7" podStartSLOduration=2.204340342 podStartE2EDuration="3.334319225s" podCreationTimestamp="2026-05-21 21:23:31 +0000 UTC" firstStartedPulling="2026-05-21 21:23:32.690457846 +0000 UTC m=+148.512055246" lastFinishedPulling="2026-05-21 21:23:33.820436728 +0000 UTC m=+149.642034129" observedRunningTime="2026-05-21 21:23:34.333516406 +0000 UTC m=+150.155113826" watchObservedRunningTime="2026-05-21 21:23:34.334319225 +0000 UTC m=+150.155916649" May 21 21:23:35.308293 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:35.308246 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5j6h6" event={"ID":"bc5561be-0755-4d68-a1b7-5086ba5e366b","Type":"ContainerStarted","Data":"bd72d3c79c5c1583191ea18ea56b637480a78839ae8c8066656963e915d57f0e"} May 21 21:23:35.308717 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:35.308296 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5j6h6" event={"ID":"bc5561be-0755-4d68-a1b7-5086ba5e366b","Type":"ContainerStarted","Data":"1494764ca2c106f2d3b4082a4e0cb591c6f680f832ba6c2393da9e1288b8de70"} May 21 21:23:35.333626 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:35.333561 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5j6h6" podStartSLOduration=3.537870983 podStartE2EDuration="4.333545792s" podCreationTimestamp="2026-05-21 21:23:31 +0000 UTC" firstStartedPulling="2026-05-21 21:23:32.435115978 +0000 UTC m=+148.256713383" lastFinishedPulling="2026-05-21 21:23:33.230790779 +0000 UTC m=+149.052388192" observedRunningTime="2026-05-21 21:23:35.332274517 +0000 UTC m=+151.153871939" watchObservedRunningTime="2026-05-21 21:23:35.333545792 +0000 UTC m=+151.155143226" May 21 21:23:35.966593 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:35.966555 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-657bfbcd57-xc7zf"] May 21 21:23:35.977600 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:35.977569 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:23:35.983210 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:35.983178 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 21 21:23:35.983500 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:35.983481 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 21 21:23:35.983734 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:35.983716 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 21 21:23:35.983819 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:35.983768 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fthovjb55trgh\"" May 21 21:23:35.983932 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:35.983914 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-wn5cb\"" May 21 21:23:35.984036 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:35.984017 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 21 21:23:35.984983 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:35.984956 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-657bfbcd57-xc7zf"] May 21 21:23:36.078516 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.078480 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2bbc955c-9aa1-4d28-ad27-fad35594d8e7-metrics-server-audit-profiles\") pod \"metrics-server-657bfbcd57-xc7zf\" (UID: \"2bbc955c-9aa1-4d28-ad27-fad35594d8e7\") " pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:23:36.078516 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.078531 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2bbc955c-9aa1-4d28-ad27-fad35594d8e7-audit-log\") pod \"metrics-server-657bfbcd57-xc7zf\" (UID: \"2bbc955c-9aa1-4d28-ad27-fad35594d8e7\") " pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:23:36.078734 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.078624 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bbc955c-9aa1-4d28-ad27-fad35594d8e7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-657bfbcd57-xc7zf\" (UID: \"2bbc955c-9aa1-4d28-ad27-fad35594d8e7\") " pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:23:36.078734 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.078667 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2bbc955c-9aa1-4d28-ad27-fad35594d8e7-secret-metrics-server-client-certs\") pod \"metrics-server-657bfbcd57-xc7zf\" (UID: \"2bbc955c-9aa1-4d28-ad27-fad35594d8e7\") " pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:23:36.078734 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.078703 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2bbc955c-9aa1-4d28-ad27-fad35594d8e7-secret-metrics-server-tls\") pod \"metrics-server-657bfbcd57-xc7zf\" (UID: \"2bbc955c-9aa1-4d28-ad27-fad35594d8e7\") " pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:23:36.078897 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.078736 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jd2c\" (UniqueName: \"kubernetes.io/projected/2bbc955c-9aa1-4d28-ad27-fad35594d8e7-kube-api-access-9jd2c\") pod \"metrics-server-657bfbcd57-xc7zf\" (UID: \"2bbc955c-9aa1-4d28-ad27-fad35594d8e7\") " pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:23:36.078897 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.078830 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bbc955c-9aa1-4d28-ad27-fad35594d8e7-client-ca-bundle\") pod \"metrics-server-657bfbcd57-xc7zf\" (UID: \"2bbc955c-9aa1-4d28-ad27-fad35594d8e7\") " pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:23:36.179257 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.179213 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2bbc955c-9aa1-4d28-ad27-fad35594d8e7-secret-metrics-server-client-certs\") pod \"metrics-server-657bfbcd57-xc7zf\" (UID: \"2bbc955c-9aa1-4d28-ad27-fad35594d8e7\") " pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:23:36.179257 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.179259 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2bbc955c-9aa1-4d28-ad27-fad35594d8e7-secret-metrics-server-tls\") pod \"metrics-server-657bfbcd57-xc7zf\" (UID: \"2bbc955c-9aa1-4d28-ad27-fad35594d8e7\") " pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:23:36.179519 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.179285 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9jd2c\" (UniqueName: \"kubernetes.io/projected/2bbc955c-9aa1-4d28-ad27-fad35594d8e7-kube-api-access-9jd2c\") pod \"metrics-server-657bfbcd57-xc7zf\" (UID: \"2bbc955c-9aa1-4d28-ad27-fad35594d8e7\") " pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:23:36.179519 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.179322 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bbc955c-9aa1-4d28-ad27-fad35594d8e7-client-ca-bundle\") pod \"metrics-server-657bfbcd57-xc7zf\" (UID: \"2bbc955c-9aa1-4d28-ad27-fad35594d8e7\") " pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:23:36.179519 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.179371 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2bbc955c-9aa1-4d28-ad27-fad35594d8e7-metrics-server-audit-profiles\") pod \"metrics-server-657bfbcd57-xc7zf\" (UID: \"2bbc955c-9aa1-4d28-ad27-fad35594d8e7\") " pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:23:36.179519 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.179414 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2bbc955c-9aa1-4d28-ad27-fad35594d8e7-audit-log\") pod \"metrics-server-657bfbcd57-xc7zf\" (UID: \"2bbc955c-9aa1-4d28-ad27-fad35594d8e7\") " pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:23:36.179519 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.179500 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bbc955c-9aa1-4d28-ad27-fad35594d8e7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-657bfbcd57-xc7zf\" (UID: \"2bbc955c-9aa1-4d28-ad27-fad35594d8e7\") " pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:23:36.179933 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.179908 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2bbc955c-9aa1-4d28-ad27-fad35594d8e7-audit-log\") pod \"metrics-server-657bfbcd57-xc7zf\" (UID: \"2bbc955c-9aa1-4d28-ad27-fad35594d8e7\") " pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:23:36.180330 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.180268 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bbc955c-9aa1-4d28-ad27-fad35594d8e7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-657bfbcd57-xc7zf\" (UID: \"2bbc955c-9aa1-4d28-ad27-fad35594d8e7\") " pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:23:36.180513 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.180486 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2bbc955c-9aa1-4d28-ad27-fad35594d8e7-metrics-server-audit-profiles\") pod \"metrics-server-657bfbcd57-xc7zf\" (UID: \"2bbc955c-9aa1-4d28-ad27-fad35594d8e7\") " pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:23:36.182286 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.182263 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bbc955c-9aa1-4d28-ad27-fad35594d8e7-client-ca-bundle\") pod \"metrics-server-657bfbcd57-xc7zf\" (UID: \"2bbc955c-9aa1-4d28-ad27-fad35594d8e7\") " pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:23:36.182359 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.182288 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2bbc955c-9aa1-4d28-ad27-fad35594d8e7-secret-metrics-server-tls\") pod \"metrics-server-657bfbcd57-xc7zf\" (UID: \"2bbc955c-9aa1-4d28-ad27-fad35594d8e7\") " pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:23:36.182359 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.182316 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2bbc955c-9aa1-4d28-ad27-fad35594d8e7-secret-metrics-server-client-certs\") pod \"metrics-server-657bfbcd57-xc7zf\" (UID: \"2bbc955c-9aa1-4d28-ad27-fad35594d8e7\") " pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:23:36.194193 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.194161 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jd2c\" (UniqueName: \"kubernetes.io/projected/2bbc955c-9aa1-4d28-ad27-fad35594d8e7-kube-api-access-9jd2c\") pod \"metrics-server-657bfbcd57-xc7zf\" (UID: \"2bbc955c-9aa1-4d28-ad27-fad35594d8e7\") " pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:23:36.233481 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.233395 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-dspmd"] May 21 21:23:36.236224 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.236199 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-dspmd" May 21 21:23:36.238495 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.238472 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 21 21:23:36.238636 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.238619 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-qgktg\"" May 21 21:23:36.243455 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.243430 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-dspmd"] May 21 21:23:36.280660 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.280619 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0cbfcde1-e5f8-47e1-b228-90b0a60afc92-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-dspmd\" (UID: \"0cbfcde1-e5f8-47e1-b228-90b0a60afc92\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-dspmd" May 21 21:23:36.289221 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.289190 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:23:36.381402 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.381368 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0cbfcde1-e5f8-47e1-b228-90b0a60afc92-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-dspmd\" (UID: \"0cbfcde1-e5f8-47e1-b228-90b0a60afc92\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-dspmd" May 21 21:23:36.384126 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.384101 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0cbfcde1-e5f8-47e1-b228-90b0a60afc92-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-dspmd\" (UID: \"0cbfcde1-e5f8-47e1-b228-90b0a60afc92\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-dspmd" May 21 21:23:36.425547 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.422669 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-657bfbcd57-xc7zf"] May 21 21:23:36.547345 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.547259 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-dspmd" May 21 21:23:36.648165 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.648131 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-676bb5d57c-xdjzd"] May 21 21:23:36.651105 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.651081 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:36.653783 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.653745 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 21 21:23:36.653922 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.653799 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 21 21:23:36.654056 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.653939 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 21 21:23:36.654056 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.653946 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-g6ncp\"" May 21 21:23:36.654240 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.654222 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 21 21:23:36.654319 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.654229 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 21 21:23:36.659407 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.659386 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 21 21:23:36.664673 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.664643 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-676bb5d57c-xdjzd"] May 21 21:23:36.684025 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.683991 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-dspmd"] May 21 21:23:36.684319 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.684292 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a6ad1813-debe-456f-8ee6-69135253e24f-federate-client-tls\") pod \"telemeter-client-676bb5d57c-xdjzd\" (UID: \"a6ad1813-debe-456f-8ee6-69135253e24f\") " pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:36.684430 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.684411 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6ad1813-debe-456f-8ee6-69135253e24f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-676bb5d57c-xdjzd\" (UID: \"a6ad1813-debe-456f-8ee6-69135253e24f\") " pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:36.684499 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.684480 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a6ad1813-debe-456f-8ee6-69135253e24f-secret-telemeter-client\") pod \"telemeter-client-676bb5d57c-xdjzd\" (UID: \"a6ad1813-debe-456f-8ee6-69135253e24f\") " pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:36.684555 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.684529 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6ad1813-debe-456f-8ee6-69135253e24f-serving-certs-ca-bundle\") pod \"telemeter-client-676bb5d57c-xdjzd\" (UID: \"a6ad1813-debe-456f-8ee6-69135253e24f\") " pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:36.684597 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.684558 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfknk\" (UniqueName: \"kubernetes.io/projected/a6ad1813-debe-456f-8ee6-69135253e24f-kube-api-access-hfknk\") pod \"telemeter-client-676bb5d57c-xdjzd\" (UID: \"a6ad1813-debe-456f-8ee6-69135253e24f\") " pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:36.684633 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.684590 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6ad1813-debe-456f-8ee6-69135253e24f-metrics-client-ca\") pod \"telemeter-client-676bb5d57c-xdjzd\" (UID: \"a6ad1813-debe-456f-8ee6-69135253e24f\") " pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:36.684633 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.684627 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a6ad1813-debe-456f-8ee6-69135253e24f-telemeter-client-tls\") pod \"telemeter-client-676bb5d57c-xdjzd\" (UID: \"a6ad1813-debe-456f-8ee6-69135253e24f\") " pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:36.684759 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.684644 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6ad1813-debe-456f-8ee6-69135253e24f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-676bb5d57c-xdjzd\" (UID: \"a6ad1813-debe-456f-8ee6-69135253e24f\") " pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:36.686975 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:23:36.686946 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cbfcde1_e5f8_47e1_b228_90b0a60afc92.slice/crio-835bb044cd1c32d2421e1fdedd1769a228264cedec889acafe8ae5b7a6619c98 WatchSource:0}: Error finding container 835bb044cd1c32d2421e1fdedd1769a228264cedec889acafe8ae5b7a6619c98: Status 404 returned error can't find the container with id 835bb044cd1c32d2421e1fdedd1769a228264cedec889acafe8ae5b7a6619c98 May 21 21:23:36.785773 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.785727 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6ad1813-debe-456f-8ee6-69135253e24f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-676bb5d57c-xdjzd\" (UID: \"a6ad1813-debe-456f-8ee6-69135253e24f\") " pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:36.785976 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.785790 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a6ad1813-debe-456f-8ee6-69135253e24f-secret-telemeter-client\") pod \"telemeter-client-676bb5d57c-xdjzd\" (UID: \"a6ad1813-debe-456f-8ee6-69135253e24f\") " pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:36.785976 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.785821 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6ad1813-debe-456f-8ee6-69135253e24f-serving-certs-ca-bundle\") pod \"telemeter-client-676bb5d57c-xdjzd\" (UID: \"a6ad1813-debe-456f-8ee6-69135253e24f\") " pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:36.785976 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.785839 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hfknk\" (UniqueName: \"kubernetes.io/projected/a6ad1813-debe-456f-8ee6-69135253e24f-kube-api-access-hfknk\") pod \"telemeter-client-676bb5d57c-xdjzd\" (UID: \"a6ad1813-debe-456f-8ee6-69135253e24f\") " pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:36.786140 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.785989 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6ad1813-debe-456f-8ee6-69135253e24f-metrics-client-ca\") pod \"telemeter-client-676bb5d57c-xdjzd\" (UID: \"a6ad1813-debe-456f-8ee6-69135253e24f\") " pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:36.786140 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.786038 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a6ad1813-debe-456f-8ee6-69135253e24f-telemeter-client-tls\") pod \"telemeter-client-676bb5d57c-xdjzd\" (UID: \"a6ad1813-debe-456f-8ee6-69135253e24f\") " pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:36.786140 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.786066 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6ad1813-debe-456f-8ee6-69135253e24f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-676bb5d57c-xdjzd\" (UID: \"a6ad1813-debe-456f-8ee6-69135253e24f\") " pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:36.786233 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.786157 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a6ad1813-debe-456f-8ee6-69135253e24f-federate-client-tls\") pod \"telemeter-client-676bb5d57c-xdjzd\" (UID: \"a6ad1813-debe-456f-8ee6-69135253e24f\") " pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:36.786747 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.786716 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6ad1813-debe-456f-8ee6-69135253e24f-serving-certs-ca-bundle\") pod \"telemeter-client-676bb5d57c-xdjzd\" (UID: \"a6ad1813-debe-456f-8ee6-69135253e24f\") " pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:36.786894 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.786732 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6ad1813-debe-456f-8ee6-69135253e24f-metrics-client-ca\") pod \"telemeter-client-676bb5d57c-xdjzd\" (UID: \"a6ad1813-debe-456f-8ee6-69135253e24f\") " pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:36.787002 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.786973 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6ad1813-debe-456f-8ee6-69135253e24f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-676bb5d57c-xdjzd\" (UID: \"a6ad1813-debe-456f-8ee6-69135253e24f\") " pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:36.788640 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.788615 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a6ad1813-debe-456f-8ee6-69135253e24f-secret-telemeter-client\") pod \"telemeter-client-676bb5d57c-xdjzd\" (UID: \"a6ad1813-debe-456f-8ee6-69135253e24f\") " pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:36.788774 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.788756 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a6ad1813-debe-456f-8ee6-69135253e24f-federate-client-tls\") pod \"telemeter-client-676bb5d57c-xdjzd\" (UID: \"a6ad1813-debe-456f-8ee6-69135253e24f\") " pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:36.788926 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.788908 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6ad1813-debe-456f-8ee6-69135253e24f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-676bb5d57c-xdjzd\" (UID: \"a6ad1813-debe-456f-8ee6-69135253e24f\") " pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:36.789131 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.789112 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a6ad1813-debe-456f-8ee6-69135253e24f-telemeter-client-tls\") pod \"telemeter-client-676bb5d57c-xdjzd\" (UID: \"a6ad1813-debe-456f-8ee6-69135253e24f\") " pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:36.799865 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.799800 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfknk\" (UniqueName: \"kubernetes.io/projected/a6ad1813-debe-456f-8ee6-69135253e24f-kube-api-access-hfknk\") pod \"telemeter-client-676bb5d57c-xdjzd\" (UID: \"a6ad1813-debe-456f-8ee6-69135253e24f\") " pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:36.961756 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:36.961710 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" May 21 21:23:37.098183 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.097932 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-676bb5d57c-xdjzd"] May 21 21:23:37.100189 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:23:37.100159 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6ad1813_debe_456f_8ee6_69135253e24f.slice/crio-f9840b7ff9206c55679bd8953c4cd5076855a4b44e410453c8ecfdd020b6a0f5 WatchSource:0}: Error finding container f9840b7ff9206c55679bd8953c4cd5076855a4b44e410453c8ecfdd020b6a0f5: Status 404 returned error can't find the container with id f9840b7ff9206c55679bd8953c4cd5076855a4b44e410453c8ecfdd020b6a0f5 May 21 21:23:37.315409 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.315365 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-dspmd" event={"ID":"0cbfcde1-e5f8-47e1-b228-90b0a60afc92","Type":"ContainerStarted","Data":"835bb044cd1c32d2421e1fdedd1769a228264cedec889acafe8ae5b7a6619c98"} May 21 21:23:37.316638 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.316588 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" event={"ID":"2bbc955c-9aa1-4d28-ad27-fad35594d8e7","Type":"ContainerStarted","Data":"66fe2312cc0381319185d49e9c689af61d4a637752a3b29f3cf80eb22aaaa1c8"} May 21 21:23:37.317837 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.317812 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" event={"ID":"a6ad1813-debe-456f-8ee6-69135253e24f","Type":"ContainerStarted","Data":"f9840b7ff9206c55679bd8953c4cd5076855a4b44e410453c8ecfdd020b6a0f5"} May 21 21:23:37.796823 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.794787 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 21:23:37.798500 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.798472 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.801046 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.801017 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3657sonaagdu1\"" May 21 21:23:37.801046 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.801038 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 21 21:23:37.802069 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.801146 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 21 21:23:37.802069 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.801398 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 21 21:23:37.804459 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.803860 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 21 21:23:37.804848 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.804618 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 21 21:23:37.804848 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.804661 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8qz7c\"" May 21 21:23:37.805058 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.804906 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 21 21:23:37.805397 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.805321 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 21 21:23:37.805528 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.805424 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 21 21:23:37.805528 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.805454 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 21 21:23:37.805755 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.805585 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 21 21:23:37.807310 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.807241 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 21 21:23:37.811255 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.811207 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 21:23:37.811547 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.811520 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 21 21:23:37.897181 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.897137 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.897355 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.897210 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/759b69d1-6853-4f29-8bca-137ff6e52630-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.897355 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.897246 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.897355 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.897306 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzglk\" (UniqueName: \"kubernetes.io/projected/759b69d1-6853-4f29-8bca-137ff6e52630-kube-api-access-zzglk\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.897355 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.897336 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.897567 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.897368 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.897567 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.897393 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.897567 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.897444 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.897567 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.897497 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-config\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.897567 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.897522 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.897567 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.897547 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.897895 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.897573 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.897895 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.897597 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.897895 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.897622 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/759b69d1-6853-4f29-8bca-137ff6e52630-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.897895 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.897652 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.897895 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.897681 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.897895 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.897743 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/759b69d1-6853-4f29-8bca-137ff6e52630-config-out\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.897895 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.897769 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-web-config\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.999084 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.999019 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-config\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.999084 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.999077 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.999421 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.999105 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.999421 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.999133 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.999421 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.999156 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.999421 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.999181 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/759b69d1-6853-4f29-8bca-137ff6e52630-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.999421 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.999212 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.999421 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.999240 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.999421 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.999281 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/759b69d1-6853-4f29-8bca-137ff6e52630-config-out\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.999421 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.999311 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-web-config\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.999421 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.999356 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.999421 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.999396 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/759b69d1-6853-4f29-8bca-137ff6e52630-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:37.999421 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.999423 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:38.000582 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.999479 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zzglk\" (UniqueName: \"kubernetes.io/projected/759b69d1-6853-4f29-8bca-137ff6e52630-kube-api-access-zzglk\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:38.000582 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.999506 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:38.000582 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.999539 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:38.000582 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.999564 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:38.000582 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:37.999617 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:38.000868 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:38.000589 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/759b69d1-6853-4f29-8bca-137ff6e52630-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:38.001639 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:38.001288 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:38.004322 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:38.004282 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:38.004432 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:38.004355 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:38.005054 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:38.004547 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/759b69d1-6853-4f29-8bca-137ff6e52630-config-out\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:38.006583 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:38.006259 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:38.007089 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:38.006757 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:38.007622 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:38.007596 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:38.008346 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:38.008299 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:38.008966 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:38.008540 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:38.008966 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:38.008912 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:38.008966 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:38.008926 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-config\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:38.009165 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:38.009057 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:38.009721 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:38.009657 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/759b69d1-6853-4f29-8bca-137ff6e52630-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:38.010578 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:38.010556 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:38.011907 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:38.011762 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:38.014362 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:38.014319 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzglk\" (UniqueName: \"kubernetes.io/projected/759b69d1-6853-4f29-8bca-137ff6e52630-kube-api-access-zzglk\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:38.014916 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:38.014888 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-web-config\") pod \"prometheus-k8s-0\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:38.128983 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:38.128803 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:38.870454 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:38.870391 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 21:23:39.256195 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:23:39.256157 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod759b69d1_6853_4f29_8bca_137ff6e52630.slice/crio-10e48c1edb7c8d841870bf9376130fd41a34f4caccef46ef64d5f98bbd5fb8d6 WatchSource:0}: Error finding container 10e48c1edb7c8d841870bf9376130fd41a34f4caccef46ef64d5f98bbd5fb8d6: Status 404 returned error can't find the container with id 10e48c1edb7c8d841870bf9376130fd41a34f4caccef46ef64d5f98bbd5fb8d6 May 21 21:23:39.324508 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:39.324471 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" event={"ID":"2bbc955c-9aa1-4d28-ad27-fad35594d8e7","Type":"ContainerStarted","Data":"baddbdeae71ee52ff0442c7bcbf9d3ec9eb270591fcd21e7456da6f4744de76e"} May 21 21:23:39.325941 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:39.325908 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-dspmd" event={"ID":"0cbfcde1-e5f8-47e1-b228-90b0a60afc92","Type":"ContainerStarted","Data":"7edd9541113e2b87718433acec011d2c79de706a27f2bce6261e14d4247effee"} May 21 21:23:39.326088 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:39.325952 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-dspmd" May 21 21:23:39.327037 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:39.327009 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"759b69d1-6853-4f29-8bca-137ff6e52630","Type":"ContainerStarted","Data":"10e48c1edb7c8d841870bf9376130fd41a34f4caccef46ef64d5f98bbd5fb8d6"} May 21 21:23:39.330975 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:39.330951 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-dspmd" May 21 21:23:39.357792 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:39.357746 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" podStartSLOduration=2.073586758 podStartE2EDuration="4.35772791s" podCreationTimestamp="2026-05-21 21:23:35 +0000 UTC" firstStartedPulling="2026-05-21 21:23:36.42718702 +0000 UTC m=+152.248784418" lastFinishedPulling="2026-05-21 21:23:38.711328156 +0000 UTC m=+154.532925570" observedRunningTime="2026-05-21 21:23:39.355831069 +0000 UTC m=+155.177428490" watchObservedRunningTime="2026-05-21 21:23:39.35772791 +0000 UTC m=+155.179325346" May 21 21:23:39.384536 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:39.384482 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-dspmd" podStartSLOduration=1.361151438 podStartE2EDuration="3.384468028s" podCreationTimestamp="2026-05-21 21:23:36 +0000 UTC" firstStartedPulling="2026-05-21 21:23:36.688801241 +0000 UTC m=+152.510398639" lastFinishedPulling="2026-05-21 21:23:38.712117825 +0000 UTC m=+154.533715229" observedRunningTime="2026-05-21 21:23:39.383369917 +0000 UTC m=+155.204967339" watchObservedRunningTime="2026-05-21 21:23:39.384468028 +0000 UTC m=+155.206065448" May 21 21:23:40.331347 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:40.331310 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" event={"ID":"a6ad1813-debe-456f-8ee6-69135253e24f","Type":"ContainerStarted","Data":"2f8af938b809301557fbb55480fa6cef17fbf352598307043ac05f64841df8f1"} May 21 21:23:40.331347 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:40.331352 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" event={"ID":"a6ad1813-debe-456f-8ee6-69135253e24f","Type":"ContainerStarted","Data":"fbdc314f239550fa63acde90f4b6aa9e82d9406360fa24d6e758beafccdc7df4"} May 21 21:23:40.332507 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:40.332488 2572 generic.go:358] "Generic (PLEG): container finished" podID="759b69d1-6853-4f29-8bca-137ff6e52630" containerID="50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf" exitCode=0 May 21 21:23:40.332595 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:40.332572 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"759b69d1-6853-4f29-8bca-137ff6e52630","Type":"ContainerDied","Data":"50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf"} May 21 21:23:41.337418 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:41.337373 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" event={"ID":"a6ad1813-debe-456f-8ee6-69135253e24f","Type":"ContainerStarted","Data":"cd18f05613e4dca3471cd3ddceec7acbd2e95cbe1c4f4078450aaa6a1a243a13"} May 21 21:23:41.359847 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:41.359790 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-676bb5d57c-xdjzd" podStartSLOduration=2.238116093 podStartE2EDuration="5.359773646s" podCreationTimestamp="2026-05-21 21:23:36 +0000 UTC" firstStartedPulling="2026-05-21 21:23:37.102054531 +0000 UTC m=+152.923651930" lastFinishedPulling="2026-05-21 21:23:40.223712083 +0000 UTC m=+156.045309483" observedRunningTime="2026-05-21 21:23:41.358779009 +0000 UTC m=+157.180376430" watchObservedRunningTime="2026-05-21 21:23:41.359773646 +0000 UTC m=+157.181371066" May 21 21:23:41.561880 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:23:41.561829 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-8457d49484-g8pbv" podUID="ce43e05d-855e-40d9-88e7-7a5b58791fa6" May 21 21:23:41.584157 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:23:41.584107 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-8ltkf" podUID="56a356d3-0c79-4cff-8256-bc5aee2db13c" May 21 21:23:41.603402 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:23:41.603332 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2w7p5" podUID="01b78fa7-270f-479b-b579-915de407c411" May 21 21:23:41.742249 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:41.742212 2572 scope.go:117] "RemoveContainer" containerID="b9df8bc200c2b1ab0ed7f40cdb26b0d84ff5d4220146ea8a6536c948f3d6308e" May 21 21:23:42.343667 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.343638 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-s7b5h_5b3e1a90-2f91-4105-bcc6-64375d2527d2/console-operator/2.log" May 21 21:23:42.344142 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.343767 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" event={"ID":"5b3e1a90-2f91-4105-bcc6-64375d2527d2","Type":"ContainerStarted","Data":"4e0b3d035e7b1d796bc41f3e20d57579c47b137d05fd40af9c6e553941be52f7"} May 21 21:23:42.344142 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.343866 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8ltkf" May 21 21:23:42.344524 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.344502 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" May 21 21:23:42.364667 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.364607 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" podStartSLOduration=52.685293672 podStartE2EDuration="55.364585323s" podCreationTimestamp="2026-05-21 21:22:47 +0000 UTC" firstStartedPulling="2026-05-21 21:22:48.085552712 +0000 UTC m=+103.907150111" lastFinishedPulling="2026-05-21 21:22:50.764844349 +0000 UTC m=+106.586441762" observedRunningTime="2026-05-21 21:23:42.362600181 +0000 UTC m=+158.184197628" watchObservedRunningTime="2026-05-21 21:23:42.364585323 +0000 UTC m=+158.186182752" May 21 21:23:42.619798 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.619071 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8457d49484-g8pbv"] May 21 21:23:42.619798 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.619186 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:23:42.626936 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.626908 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:23:42.752008 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.751975 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce43e05d-855e-40d9-88e7-7a5b58791fa6-ca-trust-extracted\") pod \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " May 21 21:23:42.752214 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.752056 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mrsr\" (UniqueName: \"kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-kube-api-access-7mrsr\") pod \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " May 21 21:23:42.752214 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.752092 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce43e05d-855e-40d9-88e7-7a5b58791fa6-image-registry-private-configuration\") pod \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " May 21 21:23:42.752214 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.752128 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-certificates\") pod \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " May 21 21:23:42.752214 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.752202 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-bound-sa-token\") pod \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " May 21 21:23:42.752421 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.752245 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce43e05d-855e-40d9-88e7-7a5b58791fa6-trusted-ca\") pod \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " May 21 21:23:42.752421 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.752282 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce43e05d-855e-40d9-88e7-7a5b58791fa6-installation-pull-secrets\") pod \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\" (UID: \"ce43e05d-855e-40d9-88e7-7a5b58791fa6\") " May 21 21:23:42.752421 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.752337 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce43e05d-855e-40d9-88e7-7a5b58791fa6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ce43e05d-855e-40d9-88e7-7a5b58791fa6" (UID: "ce43e05d-855e-40d9-88e7-7a5b58791fa6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 21:23:42.752596 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.752577 2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce43e05d-855e-40d9-88e7-7a5b58791fa6-ca-trust-extracted\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:23:42.752648 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.752546 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ce43e05d-855e-40d9-88e7-7a5b58791fa6" (UID: "ce43e05d-855e-40d9-88e7-7a5b58791fa6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 21:23:42.752872 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.752828 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce43e05d-855e-40d9-88e7-7a5b58791fa6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ce43e05d-855e-40d9-88e7-7a5b58791fa6" (UID: "ce43e05d-855e-40d9-88e7-7a5b58791fa6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 21:23:42.755235 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.755177 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce43e05d-855e-40d9-88e7-7a5b58791fa6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ce43e05d-855e-40d9-88e7-7a5b58791fa6" (UID: "ce43e05d-855e-40d9-88e7-7a5b58791fa6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 21:23:42.755371 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.755260 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce43e05d-855e-40d9-88e7-7a5b58791fa6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ce43e05d-855e-40d9-88e7-7a5b58791fa6" (UID: "ce43e05d-855e-40d9-88e7-7a5b58791fa6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 21:23:42.755675 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.755631 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-kube-api-access-7mrsr" (OuterVolumeSpecName: "kube-api-access-7mrsr") pod "ce43e05d-855e-40d9-88e7-7a5b58791fa6" (UID: "ce43e05d-855e-40d9-88e7-7a5b58791fa6"). InnerVolumeSpecName "kube-api-access-7mrsr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 21:23:42.755822 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.755770 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ce43e05d-855e-40d9-88e7-7a5b58791fa6" (UID: "ce43e05d-855e-40d9-88e7-7a5b58791fa6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 21:23:42.771980 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.771948 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-s7b5h" May 21 21:23:42.854053 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.854006 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mrsr\" (UniqueName: \"kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-kube-api-access-7mrsr\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:23:42.854223 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.854062 2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce43e05d-855e-40d9-88e7-7a5b58791fa6-image-registry-private-configuration\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:23:42.854223 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.854082 2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-certificates\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:23:42.854223 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.854098 2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-bound-sa-token\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:23:42.854223 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.854114 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce43e05d-855e-40d9-88e7-7a5b58791fa6-trusted-ca\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:23:42.854223 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:42.854128 2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce43e05d-855e-40d9-88e7-7a5b58791fa6-installation-pull-secrets\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:23:43.346968 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:43.346931 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8457d49484-g8pbv" May 21 21:23:43.389492 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:43.389454 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8457d49484-g8pbv"] May 21 21:23:43.393664 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:43.393628 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8457d49484-g8pbv"] May 21 21:23:43.461322 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:43.461285 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce43e05d-855e-40d9-88e7-7a5b58791fa6-registry-tls\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:23:44.352176 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:44.352120 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"759b69d1-6853-4f29-8bca-137ff6e52630","Type":"ContainerStarted","Data":"d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503"} May 21 21:23:44.352176 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:44.352177 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"759b69d1-6853-4f29-8bca-137ff6e52630","Type":"ContainerStarted","Data":"2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897"} May 21 21:23:44.744778 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:44.744745 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce43e05d-855e-40d9-88e7-7a5b58791fa6" path="/var/lib/kubelet/pods/ce43e05d-855e-40d9-88e7-7a5b58791fa6/volumes" May 21 21:23:46.363320 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:46.363219 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"759b69d1-6853-4f29-8bca-137ff6e52630","Type":"ContainerStarted","Data":"9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68"} May 21 21:23:46.363320 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:46.363259 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"759b69d1-6853-4f29-8bca-137ff6e52630","Type":"ContainerStarted","Data":"0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed"} May 21 21:23:46.363320 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:46.363270 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"759b69d1-6853-4f29-8bca-137ff6e52630","Type":"ContainerStarted","Data":"791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf"} May 21 21:23:46.363320 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:46.363317 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"759b69d1-6853-4f29-8bca-137ff6e52630","Type":"ContainerStarted","Data":"201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4"} May 21 21:23:46.391706 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:46.391639 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.820181118 podStartE2EDuration="9.391620061s" podCreationTimestamp="2026-05-21 21:23:37 +0000 UTC" firstStartedPulling="2026-05-21 21:23:39.258176518 +0000 UTC m=+155.079773917" lastFinishedPulling="2026-05-21 21:23:45.829615461 +0000 UTC m=+161.651212860" observedRunningTime="2026-05-21 21:23:46.390246769 +0000 UTC m=+162.211844209" watchObservedRunningTime="2026-05-21 21:23:46.391620061 +0000 UTC m=+162.213217483" May 21 21:23:46.492645 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:46.492581 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert\") pod \"ingress-canary-8ltkf\" (UID: \"56a356d3-0c79-4cff-8256-bc5aee2db13c\") " pod="openshift-ingress-canary/ingress-canary-8ltkf" May 21 21:23:46.492880 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:46.492866 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls\") pod \"dns-default-2w7p5\" (UID: \"01b78fa7-270f-479b-b579-915de407c411\") " pod="openshift-dns/dns-default-2w7p5" May 21 21:23:46.495229 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:46.495200 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01b78fa7-270f-479b-b579-915de407c411-metrics-tls\") pod \"dns-default-2w7p5\" (UID: \"01b78fa7-270f-479b-b579-915de407c411\") " pod="openshift-dns/dns-default-2w7p5" May 21 21:23:46.495467 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:46.495444 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56a356d3-0c79-4cff-8256-bc5aee2db13c-cert\") pod \"ingress-canary-8ltkf\" (UID: \"56a356d3-0c79-4cff-8256-bc5aee2db13c\") " pod="openshift-ingress-canary/ingress-canary-8ltkf" May 21 21:23:46.547842 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:46.547808 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6c5qz\"" May 21 21:23:46.555950 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:46.555923 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8ltkf" May 21 21:23:46.682486 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:46.682458 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8ltkf"] May 21 21:23:46.684874 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:23:46.684837 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56a356d3_0c79_4cff_8256_bc5aee2db13c.slice/crio-f55a3568e90d746b45b5da2f0654bdb09bb771888598930ec5030394c87fab71 WatchSource:0}: Error finding container f55a3568e90d746b45b5da2f0654bdb09bb771888598930ec5030394c87fab71: Status 404 returned error can't find the container with id f55a3568e90d746b45b5da2f0654bdb09bb771888598930ec5030394c87fab71 May 21 21:23:47.368425 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:47.368381 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8ltkf" event={"ID":"56a356d3-0c79-4cff-8256-bc5aee2db13c","Type":"ContainerStarted","Data":"f55a3568e90d746b45b5da2f0654bdb09bb771888598930ec5030394c87fab71"} May 21 21:23:48.130071 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:48.130015 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 21:23:49.375405 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:49.375369 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8ltkf" event={"ID":"56a356d3-0c79-4cff-8256-bc5aee2db13c","Type":"ContainerStarted","Data":"f18c7be69f58fb6bed0b737ca3bea4cc5af9af832ad329ec5981567d73cfeba2"} May 21 21:23:49.394532 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:49.394476 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8ltkf" podStartSLOduration=129.5613837 podStartE2EDuration="2m11.394455233s" podCreationTimestamp="2026-05-21 21:21:38 +0000 UTC" firstStartedPulling="2026-05-21 21:23:46.686751622 +0000 UTC m=+162.508349024" lastFinishedPulling="2026-05-21 21:23:48.519823157 +0000 UTC m=+164.341420557" observedRunningTime="2026-05-21 21:23:49.394339704 +0000 UTC m=+165.215937127" watchObservedRunningTime="2026-05-21 21:23:49.394455233 +0000 UTC m=+165.216052656" May 21 21:23:53.739021 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:53.738986 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2w7p5" May 21 21:23:53.743761 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:53.743743 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bvcxl\"" May 21 21:23:53.749677 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:53.749648 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2w7p5" May 21 21:23:53.899943 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:53.899912 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2w7p5"] May 21 21:23:53.903187 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:23:53.903160 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01b78fa7_270f_479b_b579_915de407c411.slice/crio-6636a8b1d668411a3254a09467cb204d7a1504838d46b4626d888b11fdc25663 WatchSource:0}: Error finding container 6636a8b1d668411a3254a09467cb204d7a1504838d46b4626d888b11fdc25663: Status 404 returned error can't find the container with id 6636a8b1d668411a3254a09467cb204d7a1504838d46b4626d888b11fdc25663 May 21 21:23:54.391504 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:54.391470 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2w7p5" event={"ID":"01b78fa7-270f-479b-b579-915de407c411","Type":"ContainerStarted","Data":"6636a8b1d668411a3254a09467cb204d7a1504838d46b4626d888b11fdc25663"} May 21 21:23:55.396279 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:55.396247 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2w7p5" event={"ID":"01b78fa7-270f-479b-b579-915de407c411","Type":"ContainerStarted","Data":"ee157a104ae32e7c43211ef64b190a18bae55012cc52fb944cf604f918c5ee0f"} May 21 21:23:56.290319 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:56.290280 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:23:56.290319 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:56.290324 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:23:56.400547 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:56.400516 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2w7p5" event={"ID":"01b78fa7-270f-479b-b579-915de407c411","Type":"ContainerStarted","Data":"b580bd9d9a86492eaf6958bd190fbfaafdf425cbcebba9bc43316c1c2274b6d0"} May 21 21:23:56.400938 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:56.400659 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2w7p5" May 21 21:23:56.420872 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:23:56.420823 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-2w7p5" podStartSLOduration=137.089239697 podStartE2EDuration="2m18.420807625s" podCreationTimestamp="2026-05-21 21:21:38 +0000 UTC" firstStartedPulling="2026-05-21 21:23:53.904940501 +0000 UTC m=+169.726537899" lastFinishedPulling="2026-05-21 21:23:55.236508427 +0000 UTC m=+171.058105827" observedRunningTime="2026-05-21 21:23:56.419543252 +0000 UTC m=+172.241140676" watchObservedRunningTime="2026-05-21 21:23:56.420807625 +0000 UTC m=+172.242405045" May 21 21:24:06.406069 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:06.406034 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2w7p5" May 21 21:24:16.294600 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:16.294570 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:24:16.298720 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:16.298676 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-657bfbcd57-xc7zf" May 21 21:24:26.493473 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:26.493440 2572 generic.go:358] "Generic (PLEG): container finished" podID="330c5249-5f06-42ef-a15b-2a83a215bb8b" containerID="1eef774be144d1faa32b2d753d61751c3cd107077002218cb22586245daa2970" exitCode=0 May 21 21:24:26.493883 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:26.493480 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-tns2g" event={"ID":"330c5249-5f06-42ef-a15b-2a83a215bb8b","Type":"ContainerDied","Data":"1eef774be144d1faa32b2d753d61751c3cd107077002218cb22586245daa2970"} May 21 21:24:26.493883 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:26.493847 2572 scope.go:117] "RemoveContainer" containerID="1eef774be144d1faa32b2d753d61751c3cd107077002218cb22586245daa2970" May 21 21:24:27.497987 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:27.497947 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-tns2g" event={"ID":"330c5249-5f06-42ef-a15b-2a83a215bb8b","Type":"ContainerStarted","Data":"c12ec63a7bb165253f444839b50f64516e84d0dfe8e81eb508ff6d7ca7718455"} May 21 21:24:38.129110 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:38.129060 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:38.145005 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:38.144977 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:38.552512 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:38.552473 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:56.558140 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.558091 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 21:24:56.558816 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.558777 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="prometheus" containerID="cri-o://2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897" gracePeriod=600 May 21 21:24:56.558929 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.558818 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="kube-rbac-proxy" containerID="cri-o://0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed" gracePeriod=600 May 21 21:24:56.558929 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.558820 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="config-reloader" containerID="cri-o://d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503" gracePeriod=600 May 21 21:24:56.558929 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.558848 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="thanos-sidecar" containerID="cri-o://201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4" gracePeriod=600 May 21 21:24:56.559079 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.558871 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68" gracePeriod=600 May 21 21:24:56.559079 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.558772 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="kube-rbac-proxy-web" containerID="cri-o://791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf" gracePeriod=600 May 21 21:24:56.819072 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.819045 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:56.890601 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.890563 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-web-config\") pod \"759b69d1-6853-4f29-8bca-137ff6e52630\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " May 21 21:24:56.890812 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.890672 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-metrics-client-certs\") pod \"759b69d1-6853-4f29-8bca-137ff6e52630\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " May 21 21:24:56.890812 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.890735 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-prometheus-trusted-ca-bundle\") pod \"759b69d1-6853-4f29-8bca-137ff6e52630\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " May 21 21:24:56.890812 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.890765 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/759b69d1-6853-4f29-8bca-137ff6e52630-config-out\") pod \"759b69d1-6853-4f29-8bca-137ff6e52630\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " May 21 21:24:56.890812 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.890801 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-grpc-tls\") pod \"759b69d1-6853-4f29-8bca-137ff6e52630\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " May 21 21:24:56.891013 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.890824 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-config\") pod \"759b69d1-6853-4f29-8bca-137ff6e52630\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " May 21 21:24:56.891013 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.890855 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-configmap-kubelet-serving-ca-bundle\") pod \"759b69d1-6853-4f29-8bca-137ff6e52630\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " May 21 21:24:56.891013 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.890904 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-kube-rbac-proxy\") pod \"759b69d1-6853-4f29-8bca-137ff6e52630\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " May 21 21:24:56.891013 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.890928 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-configmap-serving-certs-ca-bundle\") pod \"759b69d1-6853-4f29-8bca-137ff6e52630\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " May 21 21:24:56.891013 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.890968 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-prometheus-k8s-rulefiles-0\") pod \"759b69d1-6853-4f29-8bca-137ff6e52630\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " May 21 21:24:56.891013 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.891005 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzglk\" (UniqueName: \"kubernetes.io/projected/759b69d1-6853-4f29-8bca-137ff6e52630-kube-api-access-zzglk\") pod \"759b69d1-6853-4f29-8bca-137ff6e52630\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " May 21 21:24:56.891288 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.891050 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"759b69d1-6853-4f29-8bca-137ff6e52630\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " May 21 21:24:56.891288 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.891076 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"759b69d1-6853-4f29-8bca-137ff6e52630\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " May 21 21:24:56.891288 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.891109 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-prometheus-k8s-tls\") pod \"759b69d1-6853-4f29-8bca-137ff6e52630\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " May 21 21:24:56.891288 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.891147 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-thanos-prometheus-http-client-file\") pod \"759b69d1-6853-4f29-8bca-137ff6e52630\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " May 21 21:24:56.891288 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.891179 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-configmap-metrics-client-ca\") pod \"759b69d1-6853-4f29-8bca-137ff6e52630\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " May 21 21:24:56.891288 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.891210 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/759b69d1-6853-4f29-8bca-137ff6e52630-tls-assets\") pod \"759b69d1-6853-4f29-8bca-137ff6e52630\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " May 21 21:24:56.891288 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.891235 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/759b69d1-6853-4f29-8bca-137ff6e52630-prometheus-k8s-db\") pod \"759b69d1-6853-4f29-8bca-137ff6e52630\" (UID: \"759b69d1-6853-4f29-8bca-137ff6e52630\") " May 21 21:24:56.892053 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.892022 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "759b69d1-6853-4f29-8bca-137ff6e52630" (UID: "759b69d1-6853-4f29-8bca-137ff6e52630"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 21:24:56.894988 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.893389 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "759b69d1-6853-4f29-8bca-137ff6e52630" (UID: "759b69d1-6853-4f29-8bca-137ff6e52630"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 21:24:56.894988 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.893671 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "759b69d1-6853-4f29-8bca-137ff6e52630" (UID: "759b69d1-6853-4f29-8bca-137ff6e52630"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 21:24:56.894988 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.893940 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "759b69d1-6853-4f29-8bca-137ff6e52630" (UID: "759b69d1-6853-4f29-8bca-137ff6e52630"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 21:24:56.895239 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.895197 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "759b69d1-6853-4f29-8bca-137ff6e52630" (UID: "759b69d1-6853-4f29-8bca-137ff6e52630"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 21:24:56.896746 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.895745 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "759b69d1-6853-4f29-8bca-137ff6e52630" (UID: "759b69d1-6853-4f29-8bca-137ff6e52630"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 21:24:56.896746 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.896617 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/759b69d1-6853-4f29-8bca-137ff6e52630-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "759b69d1-6853-4f29-8bca-137ff6e52630" (UID: "759b69d1-6853-4f29-8bca-137ff6e52630"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 21:24:56.896922 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.896759 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "759b69d1-6853-4f29-8bca-137ff6e52630" (UID: "759b69d1-6853-4f29-8bca-137ff6e52630"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 21:24:56.897740 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.897712 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "759b69d1-6853-4f29-8bca-137ff6e52630" (UID: "759b69d1-6853-4f29-8bca-137ff6e52630"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 21:24:56.899595 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.899552 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "759b69d1-6853-4f29-8bca-137ff6e52630" (UID: "759b69d1-6853-4f29-8bca-137ff6e52630"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 21:24:56.900006 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.899925 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/759b69d1-6853-4f29-8bca-137ff6e52630-config-out" (OuterVolumeSpecName: "config-out") pod "759b69d1-6853-4f29-8bca-137ff6e52630" (UID: "759b69d1-6853-4f29-8bca-137ff6e52630"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 21:24:56.900006 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.899945 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/759b69d1-6853-4f29-8bca-137ff6e52630-kube-api-access-zzglk" (OuterVolumeSpecName: "kube-api-access-zzglk") pod "759b69d1-6853-4f29-8bca-137ff6e52630" (UID: "759b69d1-6853-4f29-8bca-137ff6e52630"). InnerVolumeSpecName "kube-api-access-zzglk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 21:24:56.900006 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.899995 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/759b69d1-6853-4f29-8bca-137ff6e52630-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "759b69d1-6853-4f29-8bca-137ff6e52630" (UID: "759b69d1-6853-4f29-8bca-137ff6e52630"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 21:24:56.900437 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.900412 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "759b69d1-6853-4f29-8bca-137ff6e52630" (UID: "759b69d1-6853-4f29-8bca-137ff6e52630"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 21:24:56.900556 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.900520 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "759b69d1-6853-4f29-8bca-137ff6e52630" (UID: "759b69d1-6853-4f29-8bca-137ff6e52630"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 21:24:56.901198 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.901159 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "759b69d1-6853-4f29-8bca-137ff6e52630" (UID: "759b69d1-6853-4f29-8bca-137ff6e52630"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 21:24:56.901466 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.901448 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-config" (OuterVolumeSpecName: "config") pod "759b69d1-6853-4f29-8bca-137ff6e52630" (UID: "759b69d1-6853-4f29-8bca-137ff6e52630"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 21:24:56.913271 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.913227 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-web-config" (OuterVolumeSpecName: "web-config") pod "759b69d1-6853-4f29-8bca-137ff6e52630" (UID: "759b69d1-6853-4f29-8bca-137ff6e52630"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 21:24:56.992893 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.992836 2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:24:56.992893 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.992886 2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:24:56.992893 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.992899 2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:24:56.992893 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.992909 2572 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:24:56.993180 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.992919 2572 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-configmap-metrics-client-ca\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:24:56.993180 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.992930 2572 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/759b69d1-6853-4f29-8bca-137ff6e52630-tls-assets\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:24:56.993180 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.992939 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/759b69d1-6853-4f29-8bca-137ff6e52630-prometheus-k8s-db\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:24:56.993180 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.992948 2572 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-web-config\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:24:56.993180 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.992956 2572 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-metrics-client-certs\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:24:56.993180 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.992966 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:24:56.993180 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.992975 2572 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/759b69d1-6853-4f29-8bca-137ff6e52630-config-out\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:24:56.993180 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.992983 2572 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-grpc-tls\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:24:56.993180 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.992991 2572 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-config\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:24:56.993180 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.992999 2572 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:24:56.993180 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.993010 2572 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/759b69d1-6853-4f29-8bca-137ff6e52630-secret-kube-rbac-proxy\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:24:56.993180 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.993018 2572 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:24:56.993180 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.993027 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/759b69d1-6853-4f29-8bca-137ff6e52630-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:24:56.993180 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:56.993036 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzglk\" (UniqueName: \"kubernetes.io/projected/759b69d1-6853-4f29-8bca-137ff6e52630-kube-api-access-zzglk\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:24:57.595547 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.595509 2572 generic.go:358] "Generic (PLEG): container finished" podID="759b69d1-6853-4f29-8bca-137ff6e52630" containerID="9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68" exitCode=0 May 21 21:24:57.595547 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.595535 2572 generic.go:358] "Generic (PLEG): container finished" podID="759b69d1-6853-4f29-8bca-137ff6e52630" containerID="0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed" exitCode=0 May 21 21:24:57.595547 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.595543 2572 generic.go:358] "Generic (PLEG): container finished" podID="759b69d1-6853-4f29-8bca-137ff6e52630" containerID="791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf" exitCode=0 May 21 21:24:57.595547 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.595551 2572 generic.go:358] "Generic (PLEG): container finished" podID="759b69d1-6853-4f29-8bca-137ff6e52630" containerID="201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4" exitCode=0 May 21 21:24:57.596160 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.595557 2572 generic.go:358] "Generic (PLEG): container finished" podID="759b69d1-6853-4f29-8bca-137ff6e52630" containerID="d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503" exitCode=0 May 21 21:24:57.596160 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.595567 2572 generic.go:358] "Generic (PLEG): container finished" podID="759b69d1-6853-4f29-8bca-137ff6e52630" containerID="2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897" exitCode=0 May 21 21:24:57.596160 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.595590 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"759b69d1-6853-4f29-8bca-137ff6e52630","Type":"ContainerDied","Data":"9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68"} May 21 21:24:57.596160 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.595618 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:57.596160 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.595630 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"759b69d1-6853-4f29-8bca-137ff6e52630","Type":"ContainerDied","Data":"0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed"} May 21 21:24:57.596160 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.595643 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"759b69d1-6853-4f29-8bca-137ff6e52630","Type":"ContainerDied","Data":"791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf"} May 21 21:24:57.596160 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.595652 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"759b69d1-6853-4f29-8bca-137ff6e52630","Type":"ContainerDied","Data":"201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4"} May 21 21:24:57.596160 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.595660 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"759b69d1-6853-4f29-8bca-137ff6e52630","Type":"ContainerDied","Data":"d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503"} May 21 21:24:57.596160 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.595669 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"759b69d1-6853-4f29-8bca-137ff6e52630","Type":"ContainerDied","Data":"2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897"} May 21 21:24:57.596160 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.595678 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"759b69d1-6853-4f29-8bca-137ff6e52630","Type":"ContainerDied","Data":"10e48c1edb7c8d841870bf9376130fd41a34f4caccef46ef64d5f98bbd5fb8d6"} May 21 21:24:57.596160 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.595720 2572 scope.go:117] "RemoveContainer" containerID="9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68" May 21 21:24:57.603423 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.603403 2572 scope.go:117] "RemoveContainer" containerID="0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed" May 21 21:24:57.610576 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.610558 2572 scope.go:117] "RemoveContainer" containerID="791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf" May 21 21:24:57.617109 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.617092 2572 scope.go:117] "RemoveContainer" containerID="201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4" May 21 21:24:57.623509 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.623488 2572 scope.go:117] "RemoveContainer" containerID="d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503" May 21 21:24:57.629740 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.629724 2572 scope.go:117] "RemoveContainer" containerID="2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897" May 21 21:24:57.632763 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.632738 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 21:24:57.637562 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.637541 2572 scope.go:117] "RemoveContainer" containerID="50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf" May 21 21:24:57.643730 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.643714 2572 scope.go:117] "RemoveContainer" containerID="9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68" May 21 21:24:57.643952 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:24:57.643931 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68\": container with ID starting with 9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68 not found: ID does not exist" containerID="9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68" May 21 21:24:57.643998 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.643960 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68"} err="failed to get container status \"9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68\": rpc error: code = NotFound desc = could not find container \"9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68\": container with ID starting with 9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68 not found: ID does not exist" May 21 21:24:57.643998 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.643992 2572 scope.go:117] "RemoveContainer" containerID="0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed" May 21 21:24:57.644205 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:24:57.644190 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed\": container with ID starting with 0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed not found: ID does not exist" containerID="0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed" May 21 21:24:57.644259 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.644207 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed"} err="failed to get container status \"0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed\": rpc error: code = NotFound desc = could not find container \"0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed\": container with ID starting with 0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed not found: ID does not exist" May 21 21:24:57.644259 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.644219 2572 scope.go:117] "RemoveContainer" containerID="791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf" May 21 21:24:57.644402 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:24:57.644387 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf\": container with ID starting with 791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf not found: ID does not exist" containerID="791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf" May 21 21:24:57.644436 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.644407 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf"} err="failed to get container status \"791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf\": rpc error: code = NotFound desc = could not find container \"791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf\": container with ID starting with 791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf not found: ID does not exist" May 21 21:24:57.644436 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.644419 2572 scope.go:117] "RemoveContainer" containerID="201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4" May 21 21:24:57.644621 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:24:57.644606 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4\": container with ID starting with 201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4 not found: ID does not exist" containerID="201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4" May 21 21:24:57.644660 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.644624 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4"} err="failed to get container status \"201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4\": rpc error: code = NotFound desc = could not find container \"201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4\": container with ID starting with 201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4 not found: ID does not exist" May 21 21:24:57.644660 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.644637 2572 scope.go:117] "RemoveContainer" containerID="d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503" May 21 21:24:57.644830 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:24:57.644814 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503\": container with ID starting with d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503 not found: ID does not exist" containerID="d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503" May 21 21:24:57.644871 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.644833 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503"} err="failed to get container status \"d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503\": rpc error: code = NotFound desc = could not find container \"d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503\": container with ID starting with d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503 not found: ID does not exist" May 21 21:24:57.644871 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.644844 2572 scope.go:117] "RemoveContainer" containerID="2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897" May 21 21:24:57.645030 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:24:57.645015 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897\": container with ID starting with 2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897 not found: ID does not exist" containerID="2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897" May 21 21:24:57.645067 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.645032 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897"} err="failed to get container status \"2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897\": rpc error: code = NotFound desc = could not find container \"2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897\": container with ID starting with 2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897 not found: ID does not exist" May 21 21:24:57.645067 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.645044 2572 scope.go:117] "RemoveContainer" containerID="50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf" May 21 21:24:57.645255 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:24:57.645240 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf\": container with ID starting with 50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf not found: ID does not exist" containerID="50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf" May 21 21:24:57.645303 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.645257 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf"} err="failed to get container status \"50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf\": rpc error: code = NotFound desc = could not find container \"50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf\": container with ID starting with 50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf not found: ID does not exist" May 21 21:24:57.645303 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.645270 2572 scope.go:117] "RemoveContainer" containerID="9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68" May 21 21:24:57.645451 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.645435 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68"} err="failed to get container status \"9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68\": rpc error: code = NotFound desc = could not find container \"9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68\": container with ID starting with 9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68 not found: ID does not exist" May 21 21:24:57.645492 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.645451 2572 scope.go:117] "RemoveContainer" containerID="0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed" May 21 21:24:57.645637 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.645621 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed"} err="failed to get container status \"0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed\": rpc error: code = NotFound desc = could not find container \"0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed\": container with ID starting with 0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed not found: ID does not exist" May 21 21:24:57.645637 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.645636 2572 scope.go:117] "RemoveContainer" containerID="791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf" May 21 21:24:57.645944 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.645881 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf"} err="failed to get container status \"791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf\": rpc error: code = NotFound desc = could not find container \"791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf\": container with ID starting with 791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf not found: ID does not exist" May 21 21:24:57.645944 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.645904 2572 scope.go:117] "RemoveContainer" containerID="201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4" May 21 21:24:57.646175 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.646152 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4"} err="failed to get container status \"201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4\": rpc error: code = NotFound desc = could not find container \"201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4\": container with ID starting with 201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4 not found: ID does not exist" May 21 21:24:57.646249 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.646177 2572 scope.go:117] "RemoveContainer" containerID="d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503" May 21 21:24:57.646471 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.646452 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503"} err="failed to get container status \"d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503\": rpc error: code = NotFound desc = could not find container \"d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503\": container with ID starting with d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503 not found: ID does not exist" May 21 21:24:57.646523 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.646471 2572 scope.go:117] "RemoveContainer" containerID="2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897" May 21 21:24:57.646728 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.646683 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897"} err="failed to get container status \"2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897\": rpc error: code = NotFound desc = could not find container \"2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897\": container with ID starting with 2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897 not found: ID does not exist" May 21 21:24:57.646728 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.646728 2572 scope.go:117] "RemoveContainer" containerID="50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf" May 21 21:24:57.646970 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.646949 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf"} err="failed to get container status \"50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf\": rpc error: code = NotFound desc = could not find container \"50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf\": container with ID starting with 50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf not found: ID does not exist" May 21 21:24:57.646970 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.646970 2572 scope.go:117] "RemoveContainer" containerID="9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68" May 21 21:24:57.647223 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.647199 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68"} err="failed to get container status \"9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68\": rpc error: code = NotFound desc = could not find container \"9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68\": container with ID starting with 9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68 not found: ID does not exist" May 21 21:24:57.647304 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.647224 2572 scope.go:117] "RemoveContainer" containerID="0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed" May 21 21:24:57.647461 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.647442 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed"} err="failed to get container status \"0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed\": rpc error: code = NotFound desc = could not find container \"0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed\": container with ID starting with 0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed not found: ID does not exist" May 21 21:24:57.647522 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.647461 2572 scope.go:117] "RemoveContainer" containerID="791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf" May 21 21:24:57.647715 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.647681 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf"} err="failed to get container status \"791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf\": rpc error: code = NotFound desc = could not find container \"791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf\": container with ID starting with 791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf not found: ID does not exist" May 21 21:24:57.647781 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.647715 2572 scope.go:117] "RemoveContainer" containerID="201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4" May 21 21:24:57.648015 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.647987 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4"} err="failed to get container status \"201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4\": rpc error: code = NotFound desc = could not find container \"201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4\": container with ID starting with 201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4 not found: ID does not exist" May 21 21:24:57.648015 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.648015 2572 scope.go:117] "RemoveContainer" containerID="d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503" May 21 21:24:57.648306 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.648276 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503"} err="failed to get container status \"d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503\": rpc error: code = NotFound desc = could not find container \"d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503\": container with ID starting with d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503 not found: ID does not exist" May 21 21:24:57.648400 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.648306 2572 scope.go:117] "RemoveContainer" containerID="2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897" May 21 21:24:57.648880 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.648575 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897"} err="failed to get container status \"2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897\": rpc error: code = NotFound desc = could not find container \"2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897\": container with ID starting with 2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897 not found: ID does not exist" May 21 21:24:57.648880 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.648605 2572 scope.go:117] "RemoveContainer" containerID="50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf" May 21 21:24:57.649018 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.648892 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf"} err="failed to get container status \"50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf\": rpc error: code = NotFound desc = could not find container \"50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf\": container with ID starting with 50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf not found: ID does not exist" May 21 21:24:57.649018 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.648916 2572 scope.go:117] "RemoveContainer" containerID="9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68" May 21 21:24:57.649218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.649181 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68"} err="failed to get container status \"9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68\": rpc error: code = NotFound desc = could not find container \"9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68\": container with ID starting with 9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68 not found: ID does not exist" May 21 21:24:57.649218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.649206 2572 scope.go:117] "RemoveContainer" containerID="0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed" May 21 21:24:57.649452 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.649431 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed"} err="failed to get container status \"0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed\": rpc error: code = NotFound desc = could not find container \"0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed\": container with ID starting with 0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed not found: ID does not exist" May 21 21:24:57.649523 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.649452 2572 scope.go:117] "RemoveContainer" containerID="791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf" May 21 21:24:57.649676 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.649657 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf"} err="failed to get container status \"791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf\": rpc error: code = NotFound desc = could not find container \"791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf\": container with ID starting with 791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf not found: ID does not exist" May 21 21:24:57.649753 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.649676 2572 scope.go:117] "RemoveContainer" containerID="201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4" May 21 21:24:57.649947 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.649928 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4"} err="failed to get container status \"201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4\": rpc error: code = NotFound desc = could not find container \"201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4\": container with ID starting with 201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4 not found: ID does not exist" May 21 21:24:57.649995 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.649947 2572 scope.go:117] "RemoveContainer" containerID="d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503" May 21 21:24:57.650194 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.650176 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503"} err="failed to get container status \"d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503\": rpc error: code = NotFound desc = could not find container \"d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503\": container with ID starting with d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503 not found: ID does not exist" May 21 21:24:57.650245 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.650195 2572 scope.go:117] "RemoveContainer" containerID="2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897" May 21 21:24:57.650310 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.650286 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 21:24:57.650433 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.650416 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897"} err="failed to get container status \"2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897\": rpc error: code = NotFound desc = could not find container \"2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897\": container with ID starting with 2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897 not found: ID does not exist" May 21 21:24:57.650478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.650438 2572 scope.go:117] "RemoveContainer" containerID="50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf" May 21 21:24:57.650651 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.650633 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf"} err="failed to get container status \"50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf\": rpc error: code = NotFound desc = could not find container \"50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf\": container with ID starting with 50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf not found: ID does not exist" May 21 21:24:57.650651 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.650650 2572 scope.go:117] "RemoveContainer" containerID="9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68" May 21 21:24:57.650880 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.650863 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68"} err="failed to get container status \"9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68\": rpc error: code = NotFound desc = could not find container \"9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68\": container with ID starting with 9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68 not found: ID does not exist" May 21 21:24:57.650927 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.650882 2572 scope.go:117] "RemoveContainer" containerID="0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed" May 21 21:24:57.651104 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.651082 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed"} err="failed to get container status \"0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed\": rpc error: code = NotFound desc = could not find container \"0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed\": container with ID starting with 0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed not found: ID does not exist" May 21 21:24:57.651148 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.651105 2572 scope.go:117] "RemoveContainer" containerID="791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf" May 21 21:24:57.651312 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.651291 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf"} err="failed to get container status \"791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf\": rpc error: code = NotFound desc = could not find container \"791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf\": container with ID starting with 791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf not found: ID does not exist" May 21 21:24:57.651312 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.651314 2572 scope.go:117] "RemoveContainer" containerID="201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4" May 21 21:24:57.651572 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.651547 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4"} err="failed to get container status \"201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4\": rpc error: code = NotFound desc = could not find container \"201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4\": container with ID starting with 201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4 not found: ID does not exist" May 21 21:24:57.651572 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.651563 2572 scope.go:117] "RemoveContainer" containerID="d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503" May 21 21:24:57.651783 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.651758 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503"} err="failed to get container status \"d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503\": rpc error: code = NotFound desc = could not find container \"d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503\": container with ID starting with d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503 not found: ID does not exist" May 21 21:24:57.651783 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.651778 2572 scope.go:117] "RemoveContainer" containerID="2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897" May 21 21:24:57.651992 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.651970 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897"} err="failed to get container status \"2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897\": rpc error: code = NotFound desc = could not find container \"2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897\": container with ID starting with 2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897 not found: ID does not exist" May 21 21:24:57.652051 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.651993 2572 scope.go:117] "RemoveContainer" containerID="50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf" May 21 21:24:57.652186 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.652167 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf"} err="failed to get container status \"50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf\": rpc error: code = NotFound desc = could not find container \"50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf\": container with ID starting with 50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf not found: ID does not exist" May 21 21:24:57.652261 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.652187 2572 scope.go:117] "RemoveContainer" containerID="9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68" May 21 21:24:57.652391 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.652373 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68"} err="failed to get container status \"9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68\": rpc error: code = NotFound desc = could not find container \"9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68\": container with ID starting with 9cfd2326bbedfd1f8a5862c12ab45952f8abcb6b1677c2b5427aef1345052d68 not found: ID does not exist" May 21 21:24:57.652447 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.652392 2572 scope.go:117] "RemoveContainer" containerID="0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed" May 21 21:24:57.652585 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.652566 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed"} err="failed to get container status \"0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed\": rpc error: code = NotFound desc = could not find container \"0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed\": container with ID starting with 0c7aac7461bb872da8807fd323c0e5ceb61f3f6e852897063b7e2432560fbfed not found: ID does not exist" May 21 21:24:57.652662 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.652586 2572 scope.go:117] "RemoveContainer" containerID="791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf" May 21 21:24:57.652843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.652827 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf"} err="failed to get container status \"791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf\": rpc error: code = NotFound desc = could not find container \"791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf\": container with ID starting with 791ca560ef4621cacc214ab123a23b1720a33e247d9683089d0933c837904acf not found: ID does not exist" May 21 21:24:57.652913 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.652845 2572 scope.go:117] "RemoveContainer" containerID="201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4" May 21 21:24:57.653024 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.653007 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4"} err="failed to get container status \"201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4\": rpc error: code = NotFound desc = could not find container \"201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4\": container with ID starting with 201b588b3670eee8bc53b153ecaa8b39c8c0cb0f7107390740544afd1f01b2a4 not found: ID does not exist" May 21 21:24:57.653076 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.653025 2572 scope.go:117] "RemoveContainer" containerID="d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503" May 21 21:24:57.653218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.653200 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503"} err="failed to get container status \"d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503\": rpc error: code = NotFound desc = could not find container \"d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503\": container with ID starting with d314e18ab057e32cbe6a0c1d02677bafa1a787c316b6f908801b141842055503 not found: ID does not exist" May 21 21:24:57.653286 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.653219 2572 scope.go:117] "RemoveContainer" containerID="2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897" May 21 21:24:57.653432 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.653417 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897"} err="failed to get container status \"2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897\": rpc error: code = NotFound desc = could not find container \"2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897\": container with ID starting with 2e266c7f755cfa2a1c957c3155400c073f568d82a5e2da7a38efc95a7dd89897 not found: ID does not exist" May 21 21:24:57.653472 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.653432 2572 scope.go:117] "RemoveContainer" containerID="50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf" May 21 21:24:57.653626 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.653611 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf"} err="failed to get container status \"50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf\": rpc error: code = NotFound desc = could not find container \"50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf\": container with ID starting with 50665d7a48f6cf7aa1e4158895efff033058f39b75862e9d6e6ed57b3e615aaf not found: ID does not exist" May 21 21:24:57.743254 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.743224 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 21:24:57.743539 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.743527 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="kube-rbac-proxy-thanos" May 21 21:24:57.743606 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.743540 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="kube-rbac-proxy-thanos" May 21 21:24:57.743606 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.743551 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="thanos-sidecar" May 21 21:24:57.743606 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.743556 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="thanos-sidecar" May 21 21:24:57.743606 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.743573 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="prometheus" May 21 21:24:57.743606 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.743579 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="prometheus" May 21 21:24:57.743606 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.743585 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="kube-rbac-proxy" May 21 21:24:57.743606 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.743590 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="kube-rbac-proxy" May 21 21:24:57.743606 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.743598 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="config-reloader" May 21 21:24:57.743606 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.743603 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="config-reloader" May 21 21:24:57.743606 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.743609 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="init-config-reloader" May 21 21:24:57.743902 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.743614 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="init-config-reloader" May 21 21:24:57.743902 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.743624 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="kube-rbac-proxy-web" May 21 21:24:57.743902 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.743629 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="kube-rbac-proxy-web" May 21 21:24:57.743902 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.743676 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="kube-rbac-proxy-web" May 21 21:24:57.743902 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.743699 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="kube-rbac-proxy-thanos" May 21 21:24:57.743902 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.743706 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="config-reloader" May 21 21:24:57.743902 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.743713 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="kube-rbac-proxy" May 21 21:24:57.743902 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.743720 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="prometheus" May 21 21:24:57.743902 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.743727 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" containerName="thanos-sidecar" May 21 21:24:57.748727 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.748683 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:57.760082 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.760059 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 21 21:24:57.760082 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.760059 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 21 21:24:57.760340 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.760326 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 21 21:24:57.761105 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.761088 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 21 21:24:57.761155 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.761108 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 21 21:24:57.761155 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.761088 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 21 21:24:57.761726 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.761706 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 21 21:24:57.762564 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.762549 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8qz7c\"" May 21 21:24:57.763139 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.763121 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3657sonaagdu1\"" May 21 21:24:57.763483 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.763469 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 21 21:24:57.763801 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.763740 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 21 21:24:57.763992 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.763977 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 21 21:24:57.764301 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.764277 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 21 21:24:57.770468 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.770445 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 21 21:24:57.814218 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.814186 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 21:24:57.907299 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.907260 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-config\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:57.907498 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.907320 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8a70c40-8708-43b9-83c1-59fdae6543da-config-out\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:57.907498 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.907353 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:57.907498 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.907373 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:57.907498 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.907449 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:57.907728 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.907505 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8a70c40-8708-43b9-83c1-59fdae6543da-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:57.907728 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.907549 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:57.907728 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.907578 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8a70c40-8708-43b9-83c1-59fdae6543da-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:57.907728 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.907643 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8a70c40-8708-43b9-83c1-59fdae6543da-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:57.907728 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.907675 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c8a70c40-8708-43b9-83c1-59fdae6543da-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:57.907947 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.907729 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:57.907947 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.907768 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8a70c40-8708-43b9-83c1-59fdae6543da-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:57.907947 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.907816 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c8a70c40-8708-43b9-83c1-59fdae6543da-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:57.907947 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.907859 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-web-config\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:57.907947 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.907894 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8a70c40-8708-43b9-83c1-59fdae6543da-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:57.907947 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.907923 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:57.908232 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.907966 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:57.908232 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:57.908012 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnnnh\" (UniqueName: \"kubernetes.io/projected/c8a70c40-8708-43b9-83c1-59fdae6543da-kube-api-access-tnnnh\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.008635 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.008593 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8a70c40-8708-43b9-83c1-59fdae6543da-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.008635 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.008649 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c8a70c40-8708-43b9-83c1-59fdae6543da-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.008938 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.008684 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.008938 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.008740 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8a70c40-8708-43b9-83c1-59fdae6543da-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.008938 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.008868 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c8a70c40-8708-43b9-83c1-59fdae6543da-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.008938 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.008933 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-web-config\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.009133 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.008970 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8a70c40-8708-43b9-83c1-59fdae6543da-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.009133 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.009092 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.009233 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.009149 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.009233 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.009196 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tnnnh\" (UniqueName: \"kubernetes.io/projected/c8a70c40-8708-43b9-83c1-59fdae6543da-kube-api-access-tnnnh\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.009233 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.009229 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-config\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.009384 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.009262 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8a70c40-8708-43b9-83c1-59fdae6543da-config-out\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.009384 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.009290 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.009384 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.009314 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.009384 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.009343 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.009384 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.009372 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8a70c40-8708-43b9-83c1-59fdae6543da-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.009609 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.009409 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.009609 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.009436 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8a70c40-8708-43b9-83c1-59fdae6543da-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.009609 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.009485 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8a70c40-8708-43b9-83c1-59fdae6543da-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.009609 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.009515 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8a70c40-8708-43b9-83c1-59fdae6543da-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.009860 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.009624 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c8a70c40-8708-43b9-83c1-59fdae6543da-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.010194 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.010165 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8a70c40-8708-43b9-83c1-59fdae6543da-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.011903 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.011810 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8a70c40-8708-43b9-83c1-59fdae6543da-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.012020 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.011967 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.012589 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.012239 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.012589 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.012255 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-config\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.012589 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.012524 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-web-config\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.013415 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.013177 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.013415 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.013257 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.013822 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.013796 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8a70c40-8708-43b9-83c1-59fdae6543da-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.014049 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.014021 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c8a70c40-8708-43b9-83c1-59fdae6543da-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.014150 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.014131 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8a70c40-8708-43b9-83c1-59fdae6543da-config-out\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.014592 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.014561 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.014661 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.014636 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.015195 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.015174 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c8a70c40-8708-43b9-83c1-59fdae6543da-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.021536 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.021509 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnnnh\" (UniqueName: \"kubernetes.io/projected/c8a70c40-8708-43b9-83c1-59fdae6543da-kube-api-access-tnnnh\") pod \"prometheus-k8s-0\" (UID: \"c8a70c40-8708-43b9-83c1-59fdae6543da\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.058668 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.058629 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 21:24:58.242034 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.241928 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 21:24:58.246651 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:24:58.246623 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8a70c40_8708_43b9_83c1_59fdae6543da.slice/crio-eb2841e7aa0edeff1a7213c3fe0a9aeaf6a39d9d64f306479d054cf0c00083a4 WatchSource:0}: Error finding container eb2841e7aa0edeff1a7213c3fe0a9aeaf6a39d9d64f306479d054cf0c00083a4: Status 404 returned error can't find the container with id eb2841e7aa0edeff1a7213c3fe0a9aeaf6a39d9d64f306479d054cf0c00083a4 May 21 21:24:58.600332 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.600235 2572 generic.go:358] "Generic (PLEG): container finished" podID="c8a70c40-8708-43b9-83c1-59fdae6543da" containerID="96fcfd8b13674612d2f623e29ff965fd6407fee25bf6a807894a28a0bde113cd" exitCode=0 May 21 21:24:58.600332 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.600271 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c8a70c40-8708-43b9-83c1-59fdae6543da","Type":"ContainerDied","Data":"96fcfd8b13674612d2f623e29ff965fd6407fee25bf6a807894a28a0bde113cd"} May 21 21:24:58.600332 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.600316 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c8a70c40-8708-43b9-83c1-59fdae6543da","Type":"ContainerStarted","Data":"eb2841e7aa0edeff1a7213c3fe0a9aeaf6a39d9d64f306479d054cf0c00083a4"} May 21 21:24:58.745718 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:58.745667 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="759b69d1-6853-4f29-8bca-137ff6e52630" path="/var/lib/kubelet/pods/759b69d1-6853-4f29-8bca-137ff6e52630/volumes" May 21 21:24:59.607568 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:59.607533 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c8a70c40-8708-43b9-83c1-59fdae6543da","Type":"ContainerStarted","Data":"b0590e41385e53fe3a3e219718ba37f2372b773f210b3d2fddbd00b43ac65d2e"} May 21 21:24:59.607976 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:59.607571 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c8a70c40-8708-43b9-83c1-59fdae6543da","Type":"ContainerStarted","Data":"dcdd7a3ddbf8bc06eed08c514d8983e877a84ad11b97b23bb2935f5417b882cc"} May 21 21:24:59.607976 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:59.607598 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c8a70c40-8708-43b9-83c1-59fdae6543da","Type":"ContainerStarted","Data":"4b07047d68d400e91961dba0d021aab2c7a6e67eabe7620fe30af73fd7fc89ef"} May 21 21:24:59.607976 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:59.607609 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c8a70c40-8708-43b9-83c1-59fdae6543da","Type":"ContainerStarted","Data":"d91d2a4395fe8af2c9aed1507e643c4a5339b40f3d9415674e303ecaa1243aed"} May 21 21:24:59.607976 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:59.607621 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c8a70c40-8708-43b9-83c1-59fdae6543da","Type":"ContainerStarted","Data":"580a6b97132db80b5b506492f839113276479c9a35b2434e3fd74c25bf200719"} May 21 21:24:59.607976 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:59.607633 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c8a70c40-8708-43b9-83c1-59fdae6543da","Type":"ContainerStarted","Data":"c1263ef08de8e7df1447f1a576e986ba3899f72408e0169f0e2d85d786a30e80"} May 21 21:24:59.670257 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:24:59.670201 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.670179825 podStartE2EDuration="2.670179825s" podCreationTimestamp="2026-05-21 21:24:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:24:59.669082612 +0000 UTC m=+235.490680033" watchObservedRunningTime="2026-05-21 21:24:59.670179825 +0000 UTC m=+235.491777246" May 21 21:25:03.059239 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:25:03.059191 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 21:25:58.059089 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:25:58.059024 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 21 21:25:58.075169 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:25:58.075134 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 21 21:25:58.801818 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:25:58.801790 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 21:26:04.606311 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:04.606275 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-s7b5h_5b3e1a90-2f91-4105-bcc6-64375d2527d2/console-operator/2.log" May 21 21:26:04.609476 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:04.609451 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-s7b5h_5b3e1a90-2f91-4105-bcc6-64375d2527d2/console-operator/2.log" May 21 21:26:04.612403 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:04.612379 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cs2zq_c8ddeadf-53c9-4198-8334-76cbdd1832c2/ovn-acl-logging/0.log" May 21 21:26:04.615807 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:04.615789 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cs2zq_c8ddeadf-53c9-4198-8334-76cbdd1832c2/ovn-acl-logging/0.log" May 21 21:26:04.616268 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:04.616241 2572 kubelet.go:1628] "Image garbage collection succeeded" May 21 21:26:23.948204 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:23.948163 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-ctv4m"] May 21 21:26:23.951726 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:23.951706 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-ctv4m" May 21 21:26:23.965017 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:23.964986 2572 status_manager.go:895] "Failed to get status for pod" podUID="dc7b5dd8-7853-4222-a02d-d441ba9cbbbf" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-ctv4m" err="pods \"openshift-lws-operator-bfc7f696d-ctv4m\" is forbidden: User \"system:node:ip-10-0-133-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-133-99.ec2.internal' and this object" May 21 21:26:23.965142 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:26:23.965024 2572 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-133-99.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-133-99.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" May 21 21:26:23.965142 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:26:23.965036 2572 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"openshift-lws-operator-dockercfg-47phj\" is forbidden: User \"system:node:ip-10-0-133-99.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-133-99.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-47phj\"" type="*v1.Secret" May 21 21:26:23.965142 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:26:23.965024 2572 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-133-99.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-133-99.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" May 21 21:26:23.988100 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:23.988066 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-ctv4m"] May 21 21:26:24.065928 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:24.065886 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc7b5dd8-7853-4222-a02d-d441ba9cbbbf-tmp\") pod \"openshift-lws-operator-bfc7f696d-ctv4m\" (UID: \"dc7b5dd8-7853-4222-a02d-d441ba9cbbbf\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-ctv4m" May 21 21:26:24.066097 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:24.065949 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phj4d\" (UniqueName: \"kubernetes.io/projected/dc7b5dd8-7853-4222-a02d-d441ba9cbbbf-kube-api-access-phj4d\") pod \"openshift-lws-operator-bfc7f696d-ctv4m\" (UID: \"dc7b5dd8-7853-4222-a02d-d441ba9cbbbf\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-ctv4m" May 21 21:26:24.167260 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:24.167224 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc7b5dd8-7853-4222-a02d-d441ba9cbbbf-tmp\") pod \"openshift-lws-operator-bfc7f696d-ctv4m\" (UID: \"dc7b5dd8-7853-4222-a02d-d441ba9cbbbf\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-ctv4m" May 21 21:26:24.167433 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:24.167284 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-phj4d\" (UniqueName: \"kubernetes.io/projected/dc7b5dd8-7853-4222-a02d-d441ba9cbbbf-kube-api-access-phj4d\") pod \"openshift-lws-operator-bfc7f696d-ctv4m\" (UID: \"dc7b5dd8-7853-4222-a02d-d441ba9cbbbf\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-ctv4m" May 21 21:26:24.167601 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:24.167580 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc7b5dd8-7853-4222-a02d-d441ba9cbbbf-tmp\") pod \"openshift-lws-operator-bfc7f696d-ctv4m\" (UID: \"dc7b5dd8-7853-4222-a02d-d441ba9cbbbf\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-ctv4m" May 21 21:26:24.849071 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:24.849040 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-47phj\"" May 21 21:26:24.872994 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:24.872963 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 21:26:25.180475 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:25.180446 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 21:26:25.189892 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:25.189864 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phj4d\" (UniqueName: \"kubernetes.io/projected/dc7b5dd8-7853-4222-a02d-d441ba9cbbbf-kube-api-access-phj4d\") pod \"openshift-lws-operator-bfc7f696d-ctv4m\" (UID: \"dc7b5dd8-7853-4222-a02d-d441ba9cbbbf\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-ctv4m" May 21 21:26:25.469309 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:25.469216 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-ctv4m" May 21 21:26:25.626426 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:25.626394 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-ctv4m"] May 21 21:26:25.630087 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:26:25.630061 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc7b5dd8_7853_4222_a02d_d441ba9cbbbf.slice/crio-256c30fa8ebf5ada007c48bff6e6e9f7a8bcea90e28d63e8ff46a3ef789b755a WatchSource:0}: Error finding container 256c30fa8ebf5ada007c48bff6e6e9f7a8bcea90e28d63e8ff46a3ef789b755a: Status 404 returned error can't find the container with id 256c30fa8ebf5ada007c48bff6e6e9f7a8bcea90e28d63e8ff46a3ef789b755a May 21 21:26:25.631623 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:25.631606 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 21:26:25.867712 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:25.867615 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-ctv4m" event={"ID":"dc7b5dd8-7853-4222-a02d-d441ba9cbbbf","Type":"ContainerStarted","Data":"256c30fa8ebf5ada007c48bff6e6e9f7a8bcea90e28d63e8ff46a3ef789b755a"} May 21 21:26:28.879111 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:28.879073 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-ctv4m" event={"ID":"dc7b5dd8-7853-4222-a02d-d441ba9cbbbf","Type":"ContainerStarted","Data":"e87148f16362806360c0ddf8df6eb15da4e8c67d57682b91110c825377980159"} May 21 21:26:28.913045 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:28.912983 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-ctv4m" podStartSLOduration=3.197278391 podStartE2EDuration="5.912965096s" podCreationTimestamp="2026-05-21 21:26:23 +0000 UTC" firstStartedPulling="2026-05-21 21:26:25.63174655 +0000 UTC m=+321.453343949" lastFinishedPulling="2026-05-21 21:26:28.347433255 +0000 UTC m=+324.169030654" observedRunningTime="2026-05-21 21:26:28.911198435 +0000 UTC m=+324.732795855" watchObservedRunningTime="2026-05-21 21:26:28.912965096 +0000 UTC m=+324.734562516" May 21 21:26:48.355997 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:48.355911 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79646d69f8-7x8ks"] May 21 21:26:48.359871 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:48.359849 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-7x8ks" May 21 21:26:48.370099 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:48.370075 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 21:26:48.376126 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:48.376103 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 21:26:48.377131 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:48.377114 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 21:26:48.377222 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:48.377206 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 21:26:48.378025 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:48.378011 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2wqfn\"" May 21 21:26:48.391835 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:48.391806 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/69195729-25bf-4c33-8618-2a796a6e3976-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79646d69f8-7x8ks\" (UID: \"69195729-25bf-4c33-8618-2a796a6e3976\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-7x8ks" May 21 21:26:48.391996 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:48.391864 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmg58\" (UniqueName: \"kubernetes.io/projected/69195729-25bf-4c33-8618-2a796a6e3976-kube-api-access-jmg58\") pod \"opendatahub-operator-controller-manager-79646d69f8-7x8ks\" (UID: \"69195729-25bf-4c33-8618-2a796a6e3976\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-7x8ks" May 21 21:26:48.391996 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:48.391902 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/69195729-25bf-4c33-8618-2a796a6e3976-webhook-cert\") pod \"opendatahub-operator-controller-manager-79646d69f8-7x8ks\" (UID: \"69195729-25bf-4c33-8618-2a796a6e3976\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-7x8ks" May 21 21:26:48.397738 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:48.397708 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79646d69f8-7x8ks"] May 21 21:26:48.492682 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:48.492636 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/69195729-25bf-4c33-8618-2a796a6e3976-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79646d69f8-7x8ks\" (UID: \"69195729-25bf-4c33-8618-2a796a6e3976\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-7x8ks" May 21 21:26:48.492916 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:48.492744 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jmg58\" (UniqueName: \"kubernetes.io/projected/69195729-25bf-4c33-8618-2a796a6e3976-kube-api-access-jmg58\") pod \"opendatahub-operator-controller-manager-79646d69f8-7x8ks\" (UID: \"69195729-25bf-4c33-8618-2a796a6e3976\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-7x8ks" May 21 21:26:48.492916 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:48.492784 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/69195729-25bf-4c33-8618-2a796a6e3976-webhook-cert\") pod \"opendatahub-operator-controller-manager-79646d69f8-7x8ks\" (UID: \"69195729-25bf-4c33-8618-2a796a6e3976\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-7x8ks" May 21 21:26:48.495176 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:48.495147 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/69195729-25bf-4c33-8618-2a796a6e3976-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79646d69f8-7x8ks\" (UID: \"69195729-25bf-4c33-8618-2a796a6e3976\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-7x8ks" May 21 21:26:48.495288 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:48.495232 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/69195729-25bf-4c33-8618-2a796a6e3976-webhook-cert\") pod \"opendatahub-operator-controller-manager-79646d69f8-7x8ks\" (UID: \"69195729-25bf-4c33-8618-2a796a6e3976\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-7x8ks" May 21 21:26:48.510983 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:48.510949 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmg58\" (UniqueName: \"kubernetes.io/projected/69195729-25bf-4c33-8618-2a796a6e3976-kube-api-access-jmg58\") pod \"opendatahub-operator-controller-manager-79646d69f8-7x8ks\" (UID: \"69195729-25bf-4c33-8618-2a796a6e3976\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-7x8ks" May 21 21:26:48.669720 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:48.669671 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-7x8ks" May 21 21:26:48.894443 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:26:48.894409 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69195729_25bf_4c33_8618_2a796a6e3976.slice/crio-fb35b2b96b5846292f3339fb20d82e5c7fdb46f0dfbaf81ebcdc16265401697f WatchSource:0}: Error finding container fb35b2b96b5846292f3339fb20d82e5c7fdb46f0dfbaf81ebcdc16265401697f: Status 404 returned error can't find the container with id fb35b2b96b5846292f3339fb20d82e5c7fdb46f0dfbaf81ebcdc16265401697f May 21 21:26:48.915855 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:48.915816 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79646d69f8-7x8ks"] May 21 21:26:48.938051 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:48.937948 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-7x8ks" event={"ID":"69195729-25bf-4c33-8618-2a796a6e3976","Type":"ContainerStarted","Data":"fb35b2b96b5846292f3339fb20d82e5c7fdb46f0dfbaf81ebcdc16265401697f"} May 21 21:26:51.955898 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:51.955842 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-7x8ks" event={"ID":"69195729-25bf-4c33-8618-2a796a6e3976","Type":"ContainerStarted","Data":"640adecaaf70fdf01953596d46db9db2d783d4bcd0df94986c02551ac3584d6e"} May 21 21:26:51.956422 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:51.956047 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-7x8ks" May 21 21:26:52.010206 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:52.010147 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-7x8ks" podStartSLOduration=1.560687518 podStartE2EDuration="4.010132764s" podCreationTimestamp="2026-05-21 21:26:48 +0000 UTC" firstStartedPulling="2026-05-21 21:26:48.89627736 +0000 UTC m=+344.717874759" lastFinishedPulling="2026-05-21 21:26:51.345722606 +0000 UTC m=+347.167320005" observedRunningTime="2026-05-21 21:26:52.009280466 +0000 UTC m=+347.830877892" watchObservedRunningTime="2026-05-21 21:26:52.010132764 +0000 UTC m=+347.831730184" May 21 21:26:52.737445 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:52.737404 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c58594cc-ktjq4"] May 21 21:26:52.741109 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:52.741078 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c58594cc-ktjq4" May 21 21:26:52.750490 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:52.750472 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 21:26:52.753674 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:52.753656 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fwvrx\"" May 21 21:26:52.767380 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:52.767357 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 21:26:52.770226 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:52.770210 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 21:26:52.808767 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:52.808733 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c58594cc-ktjq4"] May 21 21:26:52.832522 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:52.832480 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b2755a1b-bd83-4aca-8f8a-50c5a3d02191-metrics-cert\") pod \"lws-controller-manager-5c58594cc-ktjq4\" (UID: \"b2755a1b-bd83-4aca-8f8a-50c5a3d02191\") " pod="openshift-lws-operator/lws-controller-manager-5c58594cc-ktjq4" May 21 21:26:52.832738 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:52.832548 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f82cb\" (UniqueName: \"kubernetes.io/projected/b2755a1b-bd83-4aca-8f8a-50c5a3d02191-kube-api-access-f82cb\") pod \"lws-controller-manager-5c58594cc-ktjq4\" (UID: \"b2755a1b-bd83-4aca-8f8a-50c5a3d02191\") " pod="openshift-lws-operator/lws-controller-manager-5c58594cc-ktjq4" May 21 21:26:52.832738 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:52.832594 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2755a1b-bd83-4aca-8f8a-50c5a3d02191-cert\") pod \"lws-controller-manager-5c58594cc-ktjq4\" (UID: \"b2755a1b-bd83-4aca-8f8a-50c5a3d02191\") " pod="openshift-lws-operator/lws-controller-manager-5c58594cc-ktjq4" May 21 21:26:52.832738 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:52.832621 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b2755a1b-bd83-4aca-8f8a-50c5a3d02191-manager-config\") pod \"lws-controller-manager-5c58594cc-ktjq4\" (UID: \"b2755a1b-bd83-4aca-8f8a-50c5a3d02191\") " pod="openshift-lws-operator/lws-controller-manager-5c58594cc-ktjq4" May 21 21:26:52.933388 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:52.933354 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b2755a1b-bd83-4aca-8f8a-50c5a3d02191-metrics-cert\") pod \"lws-controller-manager-5c58594cc-ktjq4\" (UID: \"b2755a1b-bd83-4aca-8f8a-50c5a3d02191\") " pod="openshift-lws-operator/lws-controller-manager-5c58594cc-ktjq4" May 21 21:26:52.933579 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:52.933410 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f82cb\" (UniqueName: \"kubernetes.io/projected/b2755a1b-bd83-4aca-8f8a-50c5a3d02191-kube-api-access-f82cb\") pod \"lws-controller-manager-5c58594cc-ktjq4\" (UID: \"b2755a1b-bd83-4aca-8f8a-50c5a3d02191\") " pod="openshift-lws-operator/lws-controller-manager-5c58594cc-ktjq4" May 21 21:26:52.933579 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:52.933438 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2755a1b-bd83-4aca-8f8a-50c5a3d02191-cert\") pod \"lws-controller-manager-5c58594cc-ktjq4\" (UID: \"b2755a1b-bd83-4aca-8f8a-50c5a3d02191\") " pod="openshift-lws-operator/lws-controller-manager-5c58594cc-ktjq4" May 21 21:26:52.933579 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:52.933459 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b2755a1b-bd83-4aca-8f8a-50c5a3d02191-manager-config\") pod \"lws-controller-manager-5c58594cc-ktjq4\" (UID: \"b2755a1b-bd83-4aca-8f8a-50c5a3d02191\") " pod="openshift-lws-operator/lws-controller-manager-5c58594cc-ktjq4" May 21 21:26:52.934131 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:52.934109 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b2755a1b-bd83-4aca-8f8a-50c5a3d02191-manager-config\") pod \"lws-controller-manager-5c58594cc-ktjq4\" (UID: \"b2755a1b-bd83-4aca-8f8a-50c5a3d02191\") " pod="openshift-lws-operator/lws-controller-manager-5c58594cc-ktjq4" May 21 21:26:52.935886 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:52.935865 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2755a1b-bd83-4aca-8f8a-50c5a3d02191-cert\") pod \"lws-controller-manager-5c58594cc-ktjq4\" (UID: \"b2755a1b-bd83-4aca-8f8a-50c5a3d02191\") " pod="openshift-lws-operator/lws-controller-manager-5c58594cc-ktjq4" May 21 21:26:52.936060 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:52.936041 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b2755a1b-bd83-4aca-8f8a-50c5a3d02191-metrics-cert\") pod \"lws-controller-manager-5c58594cc-ktjq4\" (UID: \"b2755a1b-bd83-4aca-8f8a-50c5a3d02191\") " pod="openshift-lws-operator/lws-controller-manager-5c58594cc-ktjq4" May 21 21:26:52.995527 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:52.995457 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f82cb\" (UniqueName: \"kubernetes.io/projected/b2755a1b-bd83-4aca-8f8a-50c5a3d02191-kube-api-access-f82cb\") pod \"lws-controller-manager-5c58594cc-ktjq4\" (UID: \"b2755a1b-bd83-4aca-8f8a-50c5a3d02191\") " pod="openshift-lws-operator/lws-controller-manager-5c58594cc-ktjq4" May 21 21:26:53.050668 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:53.050630 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c58594cc-ktjq4" May 21 21:26:53.212340 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:53.212308 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c58594cc-ktjq4"] May 21 21:26:53.218200 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:26:53.218165 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2755a1b_bd83_4aca_8f8a_50c5a3d02191.slice/crio-f478357ebc81d2150cd6e5e5200507378a0d8f3c666218493e043c9c9f0016d6 WatchSource:0}: Error finding container f478357ebc81d2150cd6e5e5200507378a0d8f3c666218493e043c9c9f0016d6: Status 404 returned error can't find the container with id f478357ebc81d2150cd6e5e5200507378a0d8f3c666218493e043c9c9f0016d6 May 21 21:26:53.964226 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:53.964189 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c58594cc-ktjq4" event={"ID":"b2755a1b-bd83-4aca-8f8a-50c5a3d02191","Type":"ContainerStarted","Data":"f478357ebc81d2150cd6e5e5200507378a0d8f3c666218493e043c9c9f0016d6"} May 21 21:26:55.972418 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:55.972383 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c58594cc-ktjq4" event={"ID":"b2755a1b-bd83-4aca-8f8a-50c5a3d02191","Type":"ContainerStarted","Data":"e7a238f2d5100507415b16637a7a0ff2e4d66d4ba3c8c608b3ea43e47ece5eda"} May 21 21:26:55.972875 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:26:55.972505 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5c58594cc-ktjq4" May 21 21:27:02.961503 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:27:02.961473 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-7x8ks" May 21 21:27:02.995626 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:27:02.995571 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5c58594cc-ktjq4" podStartSLOduration=9.169816915 podStartE2EDuration="10.995556067s" podCreationTimestamp="2026-05-21 21:26:52 +0000 UTC" firstStartedPulling="2026-05-21 21:26:53.219887595 +0000 UTC m=+349.041484993" lastFinishedPulling="2026-05-21 21:26:55.045626725 +0000 UTC m=+350.867224145" observedRunningTime="2026-05-21 21:26:56.015767006 +0000 UTC m=+351.837364426" watchObservedRunningTime="2026-05-21 21:27:02.995556067 +0000 UTC m=+358.817153515" May 21 21:27:06.977671 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:27:06.977630 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5c58594cc-ktjq4" May 21 21:27:08.078972 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:27:08.078936 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8bb597df6-8jbv6"] May 21 21:27:08.082313 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:27:08.082293 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8bb597df6-8jbv6" May 21 21:27:08.084654 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:27:08.084621 2572 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-creds\" is forbidden: User \"system:node:ip-10-0-133-99.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-99.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" type="*v1.Secret" May 21 21:27:08.085209 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:27:08.085187 2572 status_manager.go:895] "Failed to get status for pod" podUID="c476a754-eeba-4d49-acbb-fbf9950428c0" pod="openshift-ingress/kube-auth-proxy-8bb597df6-8jbv6" err="pods \"kube-auth-proxy-8bb597df6-8jbv6\" is forbidden: User \"system:node:ip-10-0-133-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-99.ec2.internal' and this object" May 21 21:27:08.085860 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:27:08.085839 2572 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-tls\" is forbidden: User \"system:node:ip-10-0-133-99.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-99.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" type="*v1.Secret" May 21 21:27:08.086891 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:27:08.086871 2572 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-dockercfg-42kfg\" is forbidden: User \"system:node:ip-10-0-133-99.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-99.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-42kfg\"" type="*v1.Secret" May 21 21:27:08.106428 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:27:08.106399 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8bb597df6-8jbv6"] May 21 21:27:08.173282 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:27:08.173239 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c476a754-eeba-4d49-acbb-fbf9950428c0-tmp\") pod \"kube-auth-proxy-8bb597df6-8jbv6\" (UID: \"c476a754-eeba-4d49-acbb-fbf9950428c0\") " pod="openshift-ingress/kube-auth-proxy-8bb597df6-8jbv6" May 21 21:27:08.173470 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:27:08.173345 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqzmg\" (UniqueName: \"kubernetes.io/projected/c476a754-eeba-4d49-acbb-fbf9950428c0-kube-api-access-sqzmg\") pod \"kube-auth-proxy-8bb597df6-8jbv6\" (UID: \"c476a754-eeba-4d49-acbb-fbf9950428c0\") " pod="openshift-ingress/kube-auth-proxy-8bb597df6-8jbv6" May 21 21:27:08.173470 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:27:08.173384 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c476a754-eeba-4d49-acbb-fbf9950428c0-tls-certs\") pod \"kube-auth-proxy-8bb597df6-8jbv6\" (UID: \"c476a754-eeba-4d49-acbb-fbf9950428c0\") " pod="openshift-ingress/kube-auth-proxy-8bb597df6-8jbv6" May 21 21:27:08.274584 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:27:08.274543 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sqzmg\" (UniqueName: \"kubernetes.io/projected/c476a754-eeba-4d49-acbb-fbf9950428c0-kube-api-access-sqzmg\") pod \"kube-auth-proxy-8bb597df6-8jbv6\" (UID: \"c476a754-eeba-4d49-acbb-fbf9950428c0\") " pod="openshift-ingress/kube-auth-proxy-8bb597df6-8jbv6" May 21 21:27:08.274790 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:27:08.274608 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c476a754-eeba-4d49-acbb-fbf9950428c0-tls-certs\") pod \"kube-auth-proxy-8bb597df6-8jbv6\" (UID: \"c476a754-eeba-4d49-acbb-fbf9950428c0\") " pod="openshift-ingress/kube-auth-proxy-8bb597df6-8jbv6" May 21 21:27:08.274790 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:27:08.274657 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c476a754-eeba-4d49-acbb-fbf9950428c0-tmp\") pod \"kube-auth-proxy-8bb597df6-8jbv6\" (UID: \"c476a754-eeba-4d49-acbb-fbf9950428c0\") " pod="openshift-ingress/kube-auth-proxy-8bb597df6-8jbv6" May 21 21:27:08.276955 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:27:08.276925 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c476a754-eeba-4d49-acbb-fbf9950428c0-tmp\") pod \"kube-auth-proxy-8bb597df6-8jbv6\" (UID: \"c476a754-eeba-4d49-acbb-fbf9950428c0\") " pod="openshift-ingress/kube-auth-proxy-8bb597df6-8jbv6" May 21 21:27:08.298134 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:27:08.298107 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqzmg\" (UniqueName: \"kubernetes.io/projected/c476a754-eeba-4d49-acbb-fbf9950428c0-kube-api-access-sqzmg\") pod \"kube-auth-proxy-8bb597df6-8jbv6\" (UID: \"c476a754-eeba-4d49-acbb-fbf9950428c0\") " pod="openshift-ingress/kube-auth-proxy-8bb597df6-8jbv6" May 21 21:27:09.104721 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:27:09.104274 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-42kfg\"" May 21 21:27:09.225997 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:27:09.225957 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 21:27:09.237590 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:27:09.237551 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c476a754-eeba-4d49-acbb-fbf9950428c0-tls-certs\") pod \"kube-auth-proxy-8bb597df6-8jbv6\" (UID: \"c476a754-eeba-4d49-acbb-fbf9950428c0\") " pod="openshift-ingress/kube-auth-proxy-8bb597df6-8jbv6" May 21 21:27:09.291781 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:27:09.291740 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8bb597df6-8jbv6" May 21 21:27:09.441991 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:27:09.441955 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8bb597df6-8jbv6"] May 21 21:27:09.445037 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:27:09.445007 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc476a754_eeba_4d49_acbb_fbf9950428c0.slice/crio-8c7ae5de200ac7f7fbbf22f39bdafe6b46a006a31e55007e8b1d4f7414ef61b7 WatchSource:0}: Error finding container 8c7ae5de200ac7f7fbbf22f39bdafe6b46a006a31e55007e8b1d4f7414ef61b7: Status 404 returned error can't find the container with id 8c7ae5de200ac7f7fbbf22f39bdafe6b46a006a31e55007e8b1d4f7414ef61b7 May 21 21:27:09.667447 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:27:09.667410 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 21:27:10.021391 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:27:10.021240 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8bb597df6-8jbv6" event={"ID":"c476a754-eeba-4d49-acbb-fbf9950428c0","Type":"ContainerStarted","Data":"8c7ae5de200ac7f7fbbf22f39bdafe6b46a006a31e55007e8b1d4f7414ef61b7"} May 21 21:27:12.031656 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:27:12.031622 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8bb597df6-8jbv6" event={"ID":"c476a754-eeba-4d49-acbb-fbf9950428c0","Type":"ContainerStarted","Data":"291572f044be360963287d19dbc3270f930e6ad6d6ef0e27288aacfd154c4bd7"} May 21 21:27:12.063960 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:27:12.063900 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8bb597df6-8jbv6" podStartSLOduration=1.5443994 podStartE2EDuration="4.063885382s" podCreationTimestamp="2026-05-21 21:27:08 +0000 UTC" firstStartedPulling="2026-05-21 21:27:09.44667768 +0000 UTC m=+365.268275078" lastFinishedPulling="2026-05-21 21:27:11.966163656 +0000 UTC m=+367.787761060" observedRunningTime="2026-05-21 21:27:12.062167563 +0000 UTC m=+367.883764984" watchObservedRunningTime="2026-05-21 21:27:12.063885382 +0000 UTC m=+367.885482829" May 21 21:28:59.714029 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:28:59.713984 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-82n9v"] May 21 21:28:59.717696 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:28:59.717661 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-82n9v" May 21 21:28:59.720433 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:28:59.720405 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 21:28:59.720577 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:28:59.720440 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 21:28:59.720577 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:28:59.720451 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lzdrl\"" May 21 21:28:59.730249 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:28:59.730219 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-82n9v"] May 21 21:28:59.755860 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:28:59.755827 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9lcs\" (UniqueName: \"kubernetes.io/projected/05b3b778-f0e9-4e45-88aa-3b669d041fdd-kube-api-access-g9lcs\") pod \"kuadrant-operator-controller-manager-84b657d985-82n9v\" (UID: \"05b3b778-f0e9-4e45-88aa-3b669d041fdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-82n9v" May 21 21:28:59.756031 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:28:59.755887 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05b3b778-f0e9-4e45-88aa-3b669d041fdd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-82n9v\" (UID: \"05b3b778-f0e9-4e45-88aa-3b669d041fdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-82n9v" May 21 21:28:59.856827 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:28:59.856788 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g9lcs\" (UniqueName: \"kubernetes.io/projected/05b3b778-f0e9-4e45-88aa-3b669d041fdd-kube-api-access-g9lcs\") pod \"kuadrant-operator-controller-manager-84b657d985-82n9v\" (UID: \"05b3b778-f0e9-4e45-88aa-3b669d041fdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-82n9v" May 21 21:28:59.857004 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:28:59.856845 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05b3b778-f0e9-4e45-88aa-3b669d041fdd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-82n9v\" (UID: \"05b3b778-f0e9-4e45-88aa-3b669d041fdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-82n9v" May 21 21:28:59.857212 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:28:59.857195 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05b3b778-f0e9-4e45-88aa-3b669d041fdd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-82n9v\" (UID: \"05b3b778-f0e9-4e45-88aa-3b669d041fdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-82n9v" May 21 21:28:59.867774 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:28:59.867744 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9lcs\" (UniqueName: \"kubernetes.io/projected/05b3b778-f0e9-4e45-88aa-3b669d041fdd-kube-api-access-g9lcs\") pod \"kuadrant-operator-controller-manager-84b657d985-82n9v\" (UID: \"05b3b778-f0e9-4e45-88aa-3b669d041fdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-82n9v" May 21 21:29:00.028266 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:00.028152 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-82n9v" May 21 21:29:00.168207 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:00.168144 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-82n9v"] May 21 21:29:00.170972 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:29:00.170939 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b3b778_f0e9_4e45_88aa_3b669d041fdd.slice/crio-29885e86937fe1a0e639ad3dddf8b4ed927779b7fec76551c85444b9ff759669 WatchSource:0}: Error finding container 29885e86937fe1a0e639ad3dddf8b4ed927779b7fec76551c85444b9ff759669: Status 404 returned error can't find the container with id 29885e86937fe1a0e639ad3dddf8b4ed927779b7fec76551c85444b9ff759669 May 21 21:29:00.220108 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:00.220075 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-82n9v"] May 21 21:29:00.228321 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:00.228287 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-82n9v"] May 21 21:29:05.403706 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:05.403651 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-82n9v" podUID="05b3b778-f0e9-4e45-88aa-3b669d041fdd" containerName="manager" containerID="cri-o://2291247aafd236a9816482f57f895a548571b60ea7c6e8808c86719307137e2f" gracePeriod=2 May 21 21:29:05.406939 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:05.406906 2572 status_manager.go:895] "Failed to get status for pod" podUID="05b3b778-f0e9-4e45-88aa-3b669d041fdd" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-82n9v" err="pods \"kuadrant-operator-controller-manager-84b657d985-82n9v\" is forbidden: User \"system:node:ip-10-0-133-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-99.ec2.internal' and this object" May 21 21:29:05.640462 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:05.640438 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-82n9v" May 21 21:29:05.643055 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:05.643017 2572 status_manager.go:895] "Failed to get status for pod" podUID="05b3b778-f0e9-4e45-88aa-3b669d041fdd" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-82n9v" err="pods \"kuadrant-operator-controller-manager-84b657d985-82n9v\" is forbidden: User \"system:node:ip-10-0-133-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-99.ec2.internal' and this object" May 21 21:29:05.713772 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:05.713622 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05b3b778-f0e9-4e45-88aa-3b669d041fdd-extensions-socket-volume\") pod \"05b3b778-f0e9-4e45-88aa-3b669d041fdd\" (UID: \"05b3b778-f0e9-4e45-88aa-3b669d041fdd\") " May 21 21:29:05.713772 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:05.713743 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9lcs\" (UniqueName: \"kubernetes.io/projected/05b3b778-f0e9-4e45-88aa-3b669d041fdd-kube-api-access-g9lcs\") pod \"05b3b778-f0e9-4e45-88aa-3b669d041fdd\" (UID: \"05b3b778-f0e9-4e45-88aa-3b669d041fdd\") " May 21 21:29:05.714005 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:05.713960 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b3b778-f0e9-4e45-88aa-3b669d041fdd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "05b3b778-f0e9-4e45-88aa-3b669d041fdd" (UID: "05b3b778-f0e9-4e45-88aa-3b669d041fdd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 21:29:05.715955 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:05.715924 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05b3b778-f0e9-4e45-88aa-3b669d041fdd-kube-api-access-g9lcs" (OuterVolumeSpecName: "kube-api-access-g9lcs") pod "05b3b778-f0e9-4e45-88aa-3b669d041fdd" (UID: "05b3b778-f0e9-4e45-88aa-3b669d041fdd"). InnerVolumeSpecName "kube-api-access-g9lcs". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 21:29:05.815267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:05.815228 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05b3b778-f0e9-4e45-88aa-3b669d041fdd-extensions-socket-volume\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:29:05.815267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:05.815261 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9lcs\" (UniqueName: \"kubernetes.io/projected/05b3b778-f0e9-4e45-88aa-3b669d041fdd-kube-api-access-g9lcs\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:29:06.408069 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:06.408033 2572 generic.go:358] "Generic (PLEG): container finished" podID="05b3b778-f0e9-4e45-88aa-3b669d041fdd" containerID="2291247aafd236a9816482f57f895a548571b60ea7c6e8808c86719307137e2f" exitCode=2 May 21 21:29:06.408574 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:06.408086 2572 scope.go:117] "RemoveContainer" containerID="2291247aafd236a9816482f57f895a548571b60ea7c6e8808c86719307137e2f" May 21 21:29:06.408574 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:06.408103 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-82n9v" May 21 21:29:06.410375 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:06.410333 2572 status_manager.go:895] "Failed to get status for pod" podUID="05b3b778-f0e9-4e45-88aa-3b669d041fdd" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-82n9v" err="pods \"kuadrant-operator-controller-manager-84b657d985-82n9v\" is forbidden: User \"system:node:ip-10-0-133-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-99.ec2.internal' and this object" May 21 21:29:06.417001 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:06.416976 2572 scope.go:117] "RemoveContainer" containerID="2291247aafd236a9816482f57f895a548571b60ea7c6e8808c86719307137e2f" May 21 21:29:06.417323 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:29:06.417298 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2291247aafd236a9816482f57f895a548571b60ea7c6e8808c86719307137e2f\": container with ID starting with 2291247aafd236a9816482f57f895a548571b60ea7c6e8808c86719307137e2f not found: ID does not exist" containerID="2291247aafd236a9816482f57f895a548571b60ea7c6e8808c86719307137e2f" May 21 21:29:06.417385 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:06.417336 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2291247aafd236a9816482f57f895a548571b60ea7c6e8808c86719307137e2f"} err="failed to get container status \"2291247aafd236a9816482f57f895a548571b60ea7c6e8808c86719307137e2f\": rpc error: code = NotFound desc = could not find container \"2291247aafd236a9816482f57f895a548571b60ea7c6e8808c86719307137e2f\": container with ID starting with 2291247aafd236a9816482f57f895a548571b60ea7c6e8808c86719307137e2f not found: ID does not exist" May 21 21:29:06.419244 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:06.419217 2572 status_manager.go:895] "Failed to get status for pod" podUID="05b3b778-f0e9-4e45-88aa-3b669d041fdd" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-82n9v" err="pods \"kuadrant-operator-controller-manager-84b657d985-82n9v\" is forbidden: User \"system:node:ip-10-0-133-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-99.ec2.internal' and this object" May 21 21:29:06.744681 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:06.744598 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05b3b778-f0e9-4e45-88aa-3b669d041fdd" path="/var/lib/kubelet/pods/05b3b778-f0e9-4e45-88aa-3b669d041fdd/volumes" May 21 21:29:49.146936 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:49.146903 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-px7s6"] May 21 21:29:49.147357 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:49.147272 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05b3b778-f0e9-4e45-88aa-3b669d041fdd" containerName="manager" May 21 21:29:49.147357 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:49.147284 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="05b3b778-f0e9-4e45-88aa-3b669d041fdd" containerName="manager" May 21 21:29:49.147357 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:49.147354 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="05b3b778-f0e9-4e45-88aa-3b669d041fdd" containerName="manager" May 21 21:29:49.149352 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:49.149337 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-px7s6" May 21 21:29:49.151908 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:49.151883 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wprb5\"" May 21 21:29:49.151908 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:49.151883 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 21 21:29:49.152044 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:49.151911 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 21:29:49.152792 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:49.152777 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 21:29:49.160982 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:49.160962 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-px7s6"] May 21 21:29:49.209295 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:49.209267 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4lfp\" (UniqueName: \"kubernetes.io/projected/e5aaf66b-3f42-4f2f-96e0-97fd547b8225-kube-api-access-q4lfp\") pod \"limitador-limitador-7d549b5b-px7s6\" (UID: \"e5aaf66b-3f42-4f2f-96e0-97fd547b8225\") " pod="kuadrant-system/limitador-limitador-7d549b5b-px7s6" May 21 21:29:49.209427 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:49.209330 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5aaf66b-3f42-4f2f-96e0-97fd547b8225-config-file\") pod \"limitador-limitador-7d549b5b-px7s6\" (UID: \"e5aaf66b-3f42-4f2f-96e0-97fd547b8225\") " pod="kuadrant-system/limitador-limitador-7d549b5b-px7s6" May 21 21:29:49.243184 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:49.243154 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-px7s6"] May 21 21:29:49.310515 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:49.310489 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5aaf66b-3f42-4f2f-96e0-97fd547b8225-config-file\") pod \"limitador-limitador-7d549b5b-px7s6\" (UID: \"e5aaf66b-3f42-4f2f-96e0-97fd547b8225\") " pod="kuadrant-system/limitador-limitador-7d549b5b-px7s6" May 21 21:29:49.310674 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:49.310556 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q4lfp\" (UniqueName: \"kubernetes.io/projected/e5aaf66b-3f42-4f2f-96e0-97fd547b8225-kube-api-access-q4lfp\") pod \"limitador-limitador-7d549b5b-px7s6\" (UID: \"e5aaf66b-3f42-4f2f-96e0-97fd547b8225\") " pod="kuadrant-system/limitador-limitador-7d549b5b-px7s6" May 21 21:29:49.311163 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:49.311140 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5aaf66b-3f42-4f2f-96e0-97fd547b8225-config-file\") pod \"limitador-limitador-7d549b5b-px7s6\" (UID: \"e5aaf66b-3f42-4f2f-96e0-97fd547b8225\") " pod="kuadrant-system/limitador-limitador-7d549b5b-px7s6" May 21 21:29:49.319426 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:49.319402 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4lfp\" (UniqueName: \"kubernetes.io/projected/e5aaf66b-3f42-4f2f-96e0-97fd547b8225-kube-api-access-q4lfp\") pod \"limitador-limitador-7d549b5b-px7s6\" (UID: \"e5aaf66b-3f42-4f2f-96e0-97fd547b8225\") " pod="kuadrant-system/limitador-limitador-7d549b5b-px7s6" May 21 21:29:49.458853 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:49.458763 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-px7s6" May 21 21:29:49.584161 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:49.584136 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-px7s6"] May 21 21:29:49.586855 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:29:49.586826 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5aaf66b_3f42_4f2f_96e0_97fd547b8225.slice/crio-c2c5574d313aac09447bddf63b6e0b018dfce845b83835f45ed9a8fe55fb27ae WatchSource:0}: Error finding container c2c5574d313aac09447bddf63b6e0b018dfce845b83835f45ed9a8fe55fb27ae: Status 404 returned error can't find the container with id c2c5574d313aac09447bddf63b6e0b018dfce845b83835f45ed9a8fe55fb27ae May 21 21:29:49.968901 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:49.968869 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-q2kjm"] May 21 21:29:49.971603 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:49.971587 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-q2kjm" May 21 21:29:49.974663 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:49.974638 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rsqsc\"" May 21 21:29:49.981747 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:49.981724 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-q2kjm"] May 21 21:29:50.117356 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:50.117318 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh7n7\" (UniqueName: \"kubernetes.io/projected/b0835c44-bfbe-40db-a42e-5217d09a0724-kube-api-access-zh7n7\") pod \"authorino-f99f4b5cd-q2kjm\" (UID: \"b0835c44-bfbe-40db-a42e-5217d09a0724\") " pod="kuadrant-system/authorino-f99f4b5cd-q2kjm" May 21 21:29:50.218793 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:50.218762 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zh7n7\" (UniqueName: \"kubernetes.io/projected/b0835c44-bfbe-40db-a42e-5217d09a0724-kube-api-access-zh7n7\") pod \"authorino-f99f4b5cd-q2kjm\" (UID: \"b0835c44-bfbe-40db-a42e-5217d09a0724\") " pod="kuadrant-system/authorino-f99f4b5cd-q2kjm" May 21 21:29:50.227350 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:50.227296 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh7n7\" (UniqueName: \"kubernetes.io/projected/b0835c44-bfbe-40db-a42e-5217d09a0724-kube-api-access-zh7n7\") pod \"authorino-f99f4b5cd-q2kjm\" (UID: \"b0835c44-bfbe-40db-a42e-5217d09a0724\") " pod="kuadrant-system/authorino-f99f4b5cd-q2kjm" May 21 21:29:50.282264 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:50.282234 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-q2kjm" May 21 21:29:50.450427 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:50.450383 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-q2kjm"] May 21 21:29:50.454234 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:29:50.454190 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0835c44_bfbe_40db_a42e_5217d09a0724.slice/crio-dbc6103d65bdba44807e19aafb715f7c04c9cf350109f7f0321b255ff2216fbc WatchSource:0}: Error finding container dbc6103d65bdba44807e19aafb715f7c04c9cf350109f7f0321b255ff2216fbc: Status 404 returned error can't find the container with id dbc6103d65bdba44807e19aafb715f7c04c9cf350109f7f0321b255ff2216fbc May 21 21:29:50.557454 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:50.557367 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-px7s6" event={"ID":"e5aaf66b-3f42-4f2f-96e0-97fd547b8225","Type":"ContainerStarted","Data":"c2c5574d313aac09447bddf63b6e0b018dfce845b83835f45ed9a8fe55fb27ae"} May 21 21:29:50.559050 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:50.558992 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-q2kjm" event={"ID":"b0835c44-bfbe-40db-a42e-5217d09a0724","Type":"ContainerStarted","Data":"dbc6103d65bdba44807e19aafb715f7c04c9cf350109f7f0321b255ff2216fbc"} May 21 21:29:54.576455 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:54.576411 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-q2kjm" event={"ID":"b0835c44-bfbe-40db-a42e-5217d09a0724","Type":"ContainerStarted","Data":"0560da8a75d940b81cd4a7bc6539dbda2a2abb909b350f4cc361e3f884129171"} May 21 21:29:54.577810 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:54.577788 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-px7s6" event={"ID":"e5aaf66b-3f42-4f2f-96e0-97fd547b8225","Type":"ContainerStarted","Data":"478eea18ed2bd726aa32af330236c568629ccdf6af769ee36da0debb79c76d4c"} May 21 21:29:54.577891 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:54.577838 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-px7s6" May 21 21:29:54.595606 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:54.595560 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-q2kjm" podStartSLOduration=1.926435404 podStartE2EDuration="5.59554822s" podCreationTimestamp="2026-05-21 21:29:49 +0000 UTC" firstStartedPulling="2026-05-21 21:29:50.456428361 +0000 UTC m=+526.278025765" lastFinishedPulling="2026-05-21 21:29:54.125541167 +0000 UTC m=+529.947138581" observedRunningTime="2026-05-21 21:29:54.594512435 +0000 UTC m=+530.416109858" watchObservedRunningTime="2026-05-21 21:29:54.59554822 +0000 UTC m=+530.417145640" May 21 21:29:54.614963 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:54.614909 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-px7s6" podStartSLOduration=1.092981624 podStartE2EDuration="5.614890655s" podCreationTimestamp="2026-05-21 21:29:49 +0000 UTC" firstStartedPulling="2026-05-21 21:29:49.588717604 +0000 UTC m=+525.410315005" lastFinishedPulling="2026-05-21 21:29:54.110626637 +0000 UTC m=+529.932224036" observedRunningTime="2026-05-21 21:29:54.611960349 +0000 UTC m=+530.433557771" watchObservedRunningTime="2026-05-21 21:29:54.614890655 +0000 UTC m=+530.436488077" May 21 21:29:54.973417 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:54.973385 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-q2kjm"] May 21 21:29:56.584195 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:56.584156 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-q2kjm" podUID="b0835c44-bfbe-40db-a42e-5217d09a0724" containerName="authorino" containerID="cri-o://0560da8a75d940b81cd4a7bc6539dbda2a2abb909b350f4cc361e3f884129171" gracePeriod=30 May 21 21:29:56.828256 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:56.828232 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-q2kjm" May 21 21:29:56.982910 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:56.982876 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zh7n7\" (UniqueName: \"kubernetes.io/projected/b0835c44-bfbe-40db-a42e-5217d09a0724-kube-api-access-zh7n7\") pod \"b0835c44-bfbe-40db-a42e-5217d09a0724\" (UID: \"b0835c44-bfbe-40db-a42e-5217d09a0724\") " May 21 21:29:56.985020 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:56.984992 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0835c44-bfbe-40db-a42e-5217d09a0724-kube-api-access-zh7n7" (OuterVolumeSpecName: "kube-api-access-zh7n7") pod "b0835c44-bfbe-40db-a42e-5217d09a0724" (UID: "b0835c44-bfbe-40db-a42e-5217d09a0724"). InnerVolumeSpecName "kube-api-access-zh7n7". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 21:29:57.084405 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:57.084367 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zh7n7\" (UniqueName: \"kubernetes.io/projected/b0835c44-bfbe-40db-a42e-5217d09a0724-kube-api-access-zh7n7\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:29:57.588877 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:57.588841 2572 generic.go:358] "Generic (PLEG): container finished" podID="b0835c44-bfbe-40db-a42e-5217d09a0724" containerID="0560da8a75d940b81cd4a7bc6539dbda2a2abb909b350f4cc361e3f884129171" exitCode=0 May 21 21:29:57.589267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:57.588895 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-q2kjm" May 21 21:29:57.589267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:57.588898 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-q2kjm" event={"ID":"b0835c44-bfbe-40db-a42e-5217d09a0724","Type":"ContainerDied","Data":"0560da8a75d940b81cd4a7bc6539dbda2a2abb909b350f4cc361e3f884129171"} May 21 21:29:57.589267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:57.588933 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-q2kjm" event={"ID":"b0835c44-bfbe-40db-a42e-5217d09a0724","Type":"ContainerDied","Data":"dbc6103d65bdba44807e19aafb715f7c04c9cf350109f7f0321b255ff2216fbc"} May 21 21:29:57.589267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:57.588948 2572 scope.go:117] "RemoveContainer" containerID="0560da8a75d940b81cd4a7bc6539dbda2a2abb909b350f4cc361e3f884129171" May 21 21:29:57.603555 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:57.603535 2572 scope.go:117] "RemoveContainer" containerID="0560da8a75d940b81cd4a7bc6539dbda2a2abb909b350f4cc361e3f884129171" May 21 21:29:57.603826 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:29:57.603804 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0560da8a75d940b81cd4a7bc6539dbda2a2abb909b350f4cc361e3f884129171\": container with ID starting with 0560da8a75d940b81cd4a7bc6539dbda2a2abb909b350f4cc361e3f884129171 not found: ID does not exist" containerID="0560da8a75d940b81cd4a7bc6539dbda2a2abb909b350f4cc361e3f884129171" May 21 21:29:57.603901 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:57.603833 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0560da8a75d940b81cd4a7bc6539dbda2a2abb909b350f4cc361e3f884129171"} err="failed to get container status \"0560da8a75d940b81cd4a7bc6539dbda2a2abb909b350f4cc361e3f884129171\": rpc error: code = NotFound desc = could not find container \"0560da8a75d940b81cd4a7bc6539dbda2a2abb909b350f4cc361e3f884129171\": container with ID starting with 0560da8a75d940b81cd4a7bc6539dbda2a2abb909b350f4cc361e3f884129171 not found: ID does not exist" May 21 21:29:57.613294 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:57.613269 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-q2kjm"] May 21 21:29:57.617509 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:57.617484 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-q2kjm"] May 21 21:29:58.744402 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:29:58.744368 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0835c44-bfbe-40db-a42e-5217d09a0724" path="/var/lib/kubelet/pods/b0835c44-bfbe-40db-a42e-5217d09a0724/volumes" May 21 21:30:05.582315 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:05.582287 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-px7s6" May 21 21:30:05.986044 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:05.985997 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-px7s6"] May 21 21:30:05.986250 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:05.986206 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-px7s6" podUID="e5aaf66b-3f42-4f2f-96e0-97fd547b8225" containerName="limitador" containerID="cri-o://478eea18ed2bd726aa32af330236c568629ccdf6af769ee36da0debb79c76d4c" gracePeriod=30 May 21 21:30:06.529645 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:06.529624 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-px7s6" May 21 21:30:06.620837 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:06.620759 2572 generic.go:358] "Generic (PLEG): container finished" podID="e5aaf66b-3f42-4f2f-96e0-97fd547b8225" containerID="478eea18ed2bd726aa32af330236c568629ccdf6af769ee36da0debb79c76d4c" exitCode=0 May 21 21:30:06.620837 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:06.620796 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-px7s6" event={"ID":"e5aaf66b-3f42-4f2f-96e0-97fd547b8225","Type":"ContainerDied","Data":"478eea18ed2bd726aa32af330236c568629ccdf6af769ee36da0debb79c76d4c"} May 21 21:30:06.620837 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:06.620825 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-px7s6" May 21 21:30:06.620837 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:06.620834 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-px7s6" event={"ID":"e5aaf66b-3f42-4f2f-96e0-97fd547b8225","Type":"ContainerDied","Data":"c2c5574d313aac09447bddf63b6e0b018dfce845b83835f45ed9a8fe55fb27ae"} May 21 21:30:06.621348 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:06.620850 2572 scope.go:117] "RemoveContainer" containerID="478eea18ed2bd726aa32af330236c568629ccdf6af769ee36da0debb79c76d4c" May 21 21:30:06.628846 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:06.628793 2572 scope.go:117] "RemoveContainer" containerID="478eea18ed2bd726aa32af330236c568629ccdf6af769ee36da0debb79c76d4c" May 21 21:30:06.629045 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:30:06.629026 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"478eea18ed2bd726aa32af330236c568629ccdf6af769ee36da0debb79c76d4c\": container with ID starting with 478eea18ed2bd726aa32af330236c568629ccdf6af769ee36da0debb79c76d4c not found: ID does not exist" containerID="478eea18ed2bd726aa32af330236c568629ccdf6af769ee36da0debb79c76d4c" May 21 21:30:06.629090 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:06.629054 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"478eea18ed2bd726aa32af330236c568629ccdf6af769ee36da0debb79c76d4c"} err="failed to get container status \"478eea18ed2bd726aa32af330236c568629ccdf6af769ee36da0debb79c76d4c\": rpc error: code = NotFound desc = could not find container \"478eea18ed2bd726aa32af330236c568629ccdf6af769ee36da0debb79c76d4c\": container with ID starting with 478eea18ed2bd726aa32af330236c568629ccdf6af769ee36da0debb79c76d4c not found: ID does not exist" May 21 21:30:06.671178 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:06.671154 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5aaf66b-3f42-4f2f-96e0-97fd547b8225-config-file\") pod \"e5aaf66b-3f42-4f2f-96e0-97fd547b8225\" (UID: \"e5aaf66b-3f42-4f2f-96e0-97fd547b8225\") " May 21 21:30:06.671287 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:06.671208 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4lfp\" (UniqueName: \"kubernetes.io/projected/e5aaf66b-3f42-4f2f-96e0-97fd547b8225-kube-api-access-q4lfp\") pod \"e5aaf66b-3f42-4f2f-96e0-97fd547b8225\" (UID: \"e5aaf66b-3f42-4f2f-96e0-97fd547b8225\") " May 21 21:30:06.671522 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:06.671500 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5aaf66b-3f42-4f2f-96e0-97fd547b8225-config-file" (OuterVolumeSpecName: "config-file") pod "e5aaf66b-3f42-4f2f-96e0-97fd547b8225" (UID: "e5aaf66b-3f42-4f2f-96e0-97fd547b8225"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 21:30:06.673107 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:06.673088 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5aaf66b-3f42-4f2f-96e0-97fd547b8225-kube-api-access-q4lfp" (OuterVolumeSpecName: "kube-api-access-q4lfp") pod "e5aaf66b-3f42-4f2f-96e0-97fd547b8225" (UID: "e5aaf66b-3f42-4f2f-96e0-97fd547b8225"). InnerVolumeSpecName "kube-api-access-q4lfp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 21:30:06.772381 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:06.772353 2572 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5aaf66b-3f42-4f2f-96e0-97fd547b8225-config-file\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:30:06.772381 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:06.772378 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4lfp\" (UniqueName: \"kubernetes.io/projected/e5aaf66b-3f42-4f2f-96e0-97fd547b8225-kube-api-access-q4lfp\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:30:06.938105 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:06.938073 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-px7s6"] May 21 21:30:06.942006 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:06.941980 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-px7s6"] May 21 21:30:08.743843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:08.743809 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5aaf66b-3f42-4f2f-96e0-97fd547b8225" path="/var/lib/kubelet/pods/e5aaf66b-3f42-4f2f-96e0-97fd547b8225/volumes" May 21 21:30:09.595466 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:09.595424 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-xjsx9"] May 21 21:30:09.596240 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:09.596214 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5aaf66b-3f42-4f2f-96e0-97fd547b8225" containerName="limitador" May 21 21:30:09.596240 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:09.596241 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5aaf66b-3f42-4f2f-96e0-97fd547b8225" containerName="limitador" May 21 21:30:09.596398 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:09.596293 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0835c44-bfbe-40db-a42e-5217d09a0724" containerName="authorino" May 21 21:30:09.596398 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:09.596302 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0835c44-bfbe-40db-a42e-5217d09a0724" containerName="authorino" May 21 21:30:09.596511 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:09.596443 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5aaf66b-3f42-4f2f-96e0-97fd547b8225" containerName="limitador" May 21 21:30:09.596511 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:09.596458 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0835c44-bfbe-40db-a42e-5217d09a0724" containerName="authorino" May 21 21:30:09.605965 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:09.605938 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-xjsx9" May 21 21:30:09.609264 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:09.609234 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 21 21:30:09.609362 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:09.609266 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4lphr\"" May 21 21:30:09.616975 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:09.616951 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-xjsx9"] May 21 21:30:09.699020 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:09.698984 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/73d4b74c-0e43-4db4-a045-3570a341dcb1-data\") pod \"postgres-68c4fbbd6f-xjsx9\" (UID: \"73d4b74c-0e43-4db4-a045-3570a341dcb1\") " pod="opendatahub/postgres-68c4fbbd6f-xjsx9" May 21 21:30:09.699188 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:09.699079 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k6cp\" (UniqueName: \"kubernetes.io/projected/73d4b74c-0e43-4db4-a045-3570a341dcb1-kube-api-access-9k6cp\") pod \"postgres-68c4fbbd6f-xjsx9\" (UID: \"73d4b74c-0e43-4db4-a045-3570a341dcb1\") " pod="opendatahub/postgres-68c4fbbd6f-xjsx9" May 21 21:30:09.799631 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:09.799599 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9k6cp\" (UniqueName: \"kubernetes.io/projected/73d4b74c-0e43-4db4-a045-3570a341dcb1-kube-api-access-9k6cp\") pod \"postgres-68c4fbbd6f-xjsx9\" (UID: \"73d4b74c-0e43-4db4-a045-3570a341dcb1\") " pod="opendatahub/postgres-68c4fbbd6f-xjsx9" May 21 21:30:09.800039 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:09.799641 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/73d4b74c-0e43-4db4-a045-3570a341dcb1-data\") pod \"postgres-68c4fbbd6f-xjsx9\" (UID: \"73d4b74c-0e43-4db4-a045-3570a341dcb1\") " pod="opendatahub/postgres-68c4fbbd6f-xjsx9" May 21 21:30:09.800039 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:09.800026 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/73d4b74c-0e43-4db4-a045-3570a341dcb1-data\") pod \"postgres-68c4fbbd6f-xjsx9\" (UID: \"73d4b74c-0e43-4db4-a045-3570a341dcb1\") " pod="opendatahub/postgres-68c4fbbd6f-xjsx9" May 21 21:30:09.812199 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:09.812170 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k6cp\" (UniqueName: \"kubernetes.io/projected/73d4b74c-0e43-4db4-a045-3570a341dcb1-kube-api-access-9k6cp\") pod \"postgres-68c4fbbd6f-xjsx9\" (UID: \"73d4b74c-0e43-4db4-a045-3570a341dcb1\") " pod="opendatahub/postgres-68c4fbbd6f-xjsx9" May 21 21:30:09.916666 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:09.916630 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-xjsx9" May 21 21:30:10.041118 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:10.041093 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-xjsx9"] May 21 21:30:10.043458 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:30:10.043423 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73d4b74c_0e43_4db4_a045_3570a341dcb1.slice/crio-9065e770e7ceb71137bee7cf408d656345a67cf02ecca3959f30b65ca89ccb4c WatchSource:0}: Error finding container 9065e770e7ceb71137bee7cf408d656345a67cf02ecca3959f30b65ca89ccb4c: Status 404 returned error can't find the container with id 9065e770e7ceb71137bee7cf408d656345a67cf02ecca3959f30b65ca89ccb4c May 21 21:30:10.634149 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:10.634112 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-xjsx9" event={"ID":"73d4b74c-0e43-4db4-a045-3570a341dcb1","Type":"ContainerStarted","Data":"9065e770e7ceb71137bee7cf408d656345a67cf02ecca3959f30b65ca89ccb4c"} May 21 21:30:15.655177 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:15.655144 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-xjsx9" event={"ID":"73d4b74c-0e43-4db4-a045-3570a341dcb1","Type":"ContainerStarted","Data":"cc76a9d4f840d3adc753f04b4789cee47e1d027850a0b9aebde5491c8c93c0b4"} May 21 21:30:15.655813 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:15.655297 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-xjsx9" May 21 21:30:15.675427 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:15.675376 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-xjsx9" podStartSLOduration=1.523111685 podStartE2EDuration="6.675359012s" podCreationTimestamp="2026-05-21 21:30:09 +0000 UTC" firstStartedPulling="2026-05-21 21:30:10.044644405 +0000 UTC m=+545.866241804" lastFinishedPulling="2026-05-21 21:30:15.196891729 +0000 UTC m=+551.018489131" observedRunningTime="2026-05-21 21:30:15.675022131 +0000 UTC m=+551.496619553" watchObservedRunningTime="2026-05-21 21:30:15.675359012 +0000 UTC m=+551.496956435" May 21 21:30:21.686615 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:21.686587 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-xjsx9" May 21 21:30:22.265411 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.265378 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-kxwbh"] May 21 21:30:22.268886 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.268869 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-kxwbh" May 21 21:30:22.271649 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.271628 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 21:30:22.271793 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.271655 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rsqsc\"" May 21 21:30:22.272538 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.272522 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 21:30:22.283012 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.282984 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-kxwbh"] May 21 21:30:22.310167 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.310132 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw64r\" (UniqueName: \"kubernetes.io/projected/1be0cc7f-e772-4423-b0d2-e36afe4c63f6-kube-api-access-mw64r\") pod \"authorino-8b475cf9f-kxwbh\" (UID: \"1be0cc7f-e772-4423-b0d2-e36afe4c63f6\") " pod="kuadrant-system/authorino-8b475cf9f-kxwbh" May 21 21:30:22.410596 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.410559 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mw64r\" (UniqueName: \"kubernetes.io/projected/1be0cc7f-e772-4423-b0d2-e36afe4c63f6-kube-api-access-mw64r\") pod \"authorino-8b475cf9f-kxwbh\" (UID: \"1be0cc7f-e772-4423-b0d2-e36afe4c63f6\") " pod="kuadrant-system/authorino-8b475cf9f-kxwbh" May 21 21:30:22.430854 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.430826 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw64r\" (UniqueName: \"kubernetes.io/projected/1be0cc7f-e772-4423-b0d2-e36afe4c63f6-kube-api-access-mw64r\") pod \"authorino-8b475cf9f-kxwbh\" (UID: \"1be0cc7f-e772-4423-b0d2-e36afe4c63f6\") " pod="kuadrant-system/authorino-8b475cf9f-kxwbh" May 21 21:30:22.512985 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.512952 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-kxwbh"] May 21 21:30:22.513163 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.513152 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-kxwbh" May 21 21:30:22.548254 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.548212 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-779f4c54d-krkjp"] May 21 21:30:22.552677 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.552655 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-779f4c54d-krkjp" May 21 21:30:22.567166 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.567138 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-779f4c54d-krkjp"] May 21 21:30:22.612318 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.612287 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cdq5\" (UniqueName: \"kubernetes.io/projected/91146c9a-82b1-40eb-ae27-e384b4d07b6c-kube-api-access-7cdq5\") pod \"authorino-779f4c54d-krkjp\" (UID: \"91146c9a-82b1-40eb-ae27-e384b4d07b6c\") " pod="kuadrant-system/authorino-779f4c54d-krkjp" May 21 21:30:22.654004 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.653970 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-kxwbh"] May 21 21:30:22.656111 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:30:22.656082 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1be0cc7f_e772_4423_b0d2_e36afe4c63f6.slice/crio-e0a290625722ee518f7df20f29381e0ffaadf578760753763c25b3ff168d6b02 WatchSource:0}: Error finding container e0a290625722ee518f7df20f29381e0ffaadf578760753763c25b3ff168d6b02: Status 404 returned error can't find the container with id e0a290625722ee518f7df20f29381e0ffaadf578760753763c25b3ff168d6b02 May 21 21:30:22.664919 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.664894 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-779f4c54d-krkjp"] May 21 21:30:22.665142 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:30:22.665124 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-7cdq5], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-779f4c54d-krkjp" podUID="91146c9a-82b1-40eb-ae27-e384b4d07b6c" May 21 21:30:22.680456 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.680430 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-kxwbh" event={"ID":"1be0cc7f-e772-4423-b0d2-e36afe4c63f6","Type":"ContainerStarted","Data":"e0a290625722ee518f7df20f29381e0ffaadf578760753763c25b3ff168d6b02"} May 21 21:30:22.680530 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.680457 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-779f4c54d-krkjp" May 21 21:30:22.685075 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.685058 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-779f4c54d-krkjp" May 21 21:30:22.712996 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.712972 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7cdq5\" (UniqueName: \"kubernetes.io/projected/91146c9a-82b1-40eb-ae27-e384b4d07b6c-kube-api-access-7cdq5\") pod \"authorino-779f4c54d-krkjp\" (UID: \"91146c9a-82b1-40eb-ae27-e384b4d07b6c\") " pod="kuadrant-system/authorino-779f4c54d-krkjp" May 21 21:30:22.723906 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.723889 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66645f74b4-24c8q"] May 21 21:30:22.727306 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.727291 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66645f74b4-24c8q" May 21 21:30:22.728578 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.728558 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cdq5\" (UniqueName: \"kubernetes.io/projected/91146c9a-82b1-40eb-ae27-e384b4d07b6c-kube-api-access-7cdq5\") pod \"authorino-779f4c54d-krkjp\" (UID: \"91146c9a-82b1-40eb-ae27-e384b4d07b6c\") " pod="kuadrant-system/authorino-779f4c54d-krkjp" May 21 21:30:22.729794 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.729780 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 21 21:30:22.737441 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.737419 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66645f74b4-24c8q"] May 21 21:30:22.814203 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.814120 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cdq5\" (UniqueName: \"kubernetes.io/projected/91146c9a-82b1-40eb-ae27-e384b4d07b6c-kube-api-access-7cdq5\") pod \"91146c9a-82b1-40eb-ae27-e384b4d07b6c\" (UID: \"91146c9a-82b1-40eb-ae27-e384b4d07b6c\") " May 21 21:30:22.814375 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.814276 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c24645e2-838e-4078-a01d-6ba8b08688f4-tls-cert\") pod \"authorino-66645f74b4-24c8q\" (UID: \"c24645e2-838e-4078-a01d-6ba8b08688f4\") " pod="kuadrant-system/authorino-66645f74b4-24c8q" May 21 21:30:22.814375 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.814324 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7svbr\" (UniqueName: \"kubernetes.io/projected/c24645e2-838e-4078-a01d-6ba8b08688f4-kube-api-access-7svbr\") pod \"authorino-66645f74b4-24c8q\" (UID: \"c24645e2-838e-4078-a01d-6ba8b08688f4\") " pod="kuadrant-system/authorino-66645f74b4-24c8q" May 21 21:30:22.816115 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.816083 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91146c9a-82b1-40eb-ae27-e384b4d07b6c-kube-api-access-7cdq5" (OuterVolumeSpecName: "kube-api-access-7cdq5") pod "91146c9a-82b1-40eb-ae27-e384b4d07b6c" (UID: "91146c9a-82b1-40eb-ae27-e384b4d07b6c"). InnerVolumeSpecName "kube-api-access-7cdq5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 21:30:22.915762 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.915709 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7svbr\" (UniqueName: \"kubernetes.io/projected/c24645e2-838e-4078-a01d-6ba8b08688f4-kube-api-access-7svbr\") pod \"authorino-66645f74b4-24c8q\" (UID: \"c24645e2-838e-4078-a01d-6ba8b08688f4\") " pod="kuadrant-system/authorino-66645f74b4-24c8q" May 21 21:30:22.915953 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.915846 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c24645e2-838e-4078-a01d-6ba8b08688f4-tls-cert\") pod \"authorino-66645f74b4-24c8q\" (UID: \"c24645e2-838e-4078-a01d-6ba8b08688f4\") " pod="kuadrant-system/authorino-66645f74b4-24c8q" May 21 21:30:22.915953 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.915892 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cdq5\" (UniqueName: \"kubernetes.io/projected/91146c9a-82b1-40eb-ae27-e384b4d07b6c-kube-api-access-7cdq5\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:30:22.918238 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.918213 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c24645e2-838e-4078-a01d-6ba8b08688f4-tls-cert\") pod \"authorino-66645f74b4-24c8q\" (UID: \"c24645e2-838e-4078-a01d-6ba8b08688f4\") " pod="kuadrant-system/authorino-66645f74b4-24c8q" May 21 21:30:22.924129 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:22.924107 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7svbr\" (UniqueName: \"kubernetes.io/projected/c24645e2-838e-4078-a01d-6ba8b08688f4-kube-api-access-7svbr\") pod \"authorino-66645f74b4-24c8q\" (UID: \"c24645e2-838e-4078-a01d-6ba8b08688f4\") " pod="kuadrant-system/authorino-66645f74b4-24c8q" May 21 21:30:23.044620 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:23.044594 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66645f74b4-24c8q" May 21 21:30:23.186969 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:23.186943 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66645f74b4-24c8q"] May 21 21:30:23.189931 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:30:23.189901 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc24645e2_838e_4078_a01d_6ba8b08688f4.slice/crio-dbcc4d8d0041915d5486f73ee4c8bae6ed3d5f9e3ad5ae2f384eb08a0d1cda45 WatchSource:0}: Error finding container dbcc4d8d0041915d5486f73ee4c8bae6ed3d5f9e3ad5ae2f384eb08a0d1cda45: Status 404 returned error can't find the container with id dbcc4d8d0041915d5486f73ee4c8bae6ed3d5f9e3ad5ae2f384eb08a0d1cda45 May 21 21:30:23.685775 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:23.685741 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66645f74b4-24c8q" event={"ID":"c24645e2-838e-4078-a01d-6ba8b08688f4","Type":"ContainerStarted","Data":"dbcc4d8d0041915d5486f73ee4c8bae6ed3d5f9e3ad5ae2f384eb08a0d1cda45"} May 21 21:30:23.686985 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:23.686960 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-kxwbh" event={"ID":"1be0cc7f-e772-4423-b0d2-e36afe4c63f6","Type":"ContainerStarted","Data":"d24fe0c93253d5cea077833a1c71e24df706d4a1acfd0d8e4fb8e2691ed558a1"} May 21 21:30:23.687125 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:23.686989 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-779f4c54d-krkjp" May 21 21:30:23.687125 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:23.687038 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-kxwbh" podUID="1be0cc7f-e772-4423-b0d2-e36afe4c63f6" containerName="authorino" containerID="cri-o://d24fe0c93253d5cea077833a1c71e24df706d4a1acfd0d8e4fb8e2691ed558a1" gracePeriod=30 May 21 21:30:23.703543 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:23.703507 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-kxwbh" podStartSLOduration=1.334549846 podStartE2EDuration="1.703495263s" podCreationTimestamp="2026-05-21 21:30:22 +0000 UTC" firstStartedPulling="2026-05-21 21:30:22.657776976 +0000 UTC m=+558.479374378" lastFinishedPulling="2026-05-21 21:30:23.026722386 +0000 UTC m=+558.848319795" observedRunningTime="2026-05-21 21:30:23.702275625 +0000 UTC m=+559.523873047" watchObservedRunningTime="2026-05-21 21:30:23.703495263 +0000 UTC m=+559.525092685" May 21 21:30:23.733406 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:23.733378 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-779f4c54d-krkjp"] May 21 21:30:23.737602 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:23.737578 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-779f4c54d-krkjp"] May 21 21:30:23.931577 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:23.931553 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-kxwbh" May 21 21:30:24.024943 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:24.024862 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mw64r\" (UniqueName: \"kubernetes.io/projected/1be0cc7f-e772-4423-b0d2-e36afe4c63f6-kube-api-access-mw64r\") pod \"1be0cc7f-e772-4423-b0d2-e36afe4c63f6\" (UID: \"1be0cc7f-e772-4423-b0d2-e36afe4c63f6\") " May 21 21:30:24.026796 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:24.026763 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1be0cc7f-e772-4423-b0d2-e36afe4c63f6-kube-api-access-mw64r" (OuterVolumeSpecName: "kube-api-access-mw64r") pod "1be0cc7f-e772-4423-b0d2-e36afe4c63f6" (UID: "1be0cc7f-e772-4423-b0d2-e36afe4c63f6"). InnerVolumeSpecName "kube-api-access-mw64r". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 21:30:24.126091 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:24.126055 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mw64r\" (UniqueName: \"kubernetes.io/projected/1be0cc7f-e772-4423-b0d2-e36afe4c63f6-kube-api-access-mw64r\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:30:24.691426 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:24.691335 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66645f74b4-24c8q" event={"ID":"c24645e2-838e-4078-a01d-6ba8b08688f4","Type":"ContainerStarted","Data":"0f2e3bd54b9470205a6fa0ba5a585c5107e2a5b4b84e5267ecdf19412605fa66"} May 21 21:30:24.692423 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:24.692399 2572 generic.go:358] "Generic (PLEG): container finished" podID="1be0cc7f-e772-4423-b0d2-e36afe4c63f6" containerID="d24fe0c93253d5cea077833a1c71e24df706d4a1acfd0d8e4fb8e2691ed558a1" exitCode=0 May 21 21:30:24.692547 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:24.692442 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-kxwbh" May 21 21:30:24.692547 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:24.692486 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-kxwbh" event={"ID":"1be0cc7f-e772-4423-b0d2-e36afe4c63f6","Type":"ContainerDied","Data":"d24fe0c93253d5cea077833a1c71e24df706d4a1acfd0d8e4fb8e2691ed558a1"} May 21 21:30:24.692547 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:24.692524 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-kxwbh" event={"ID":"1be0cc7f-e772-4423-b0d2-e36afe4c63f6","Type":"ContainerDied","Data":"e0a290625722ee518f7df20f29381e0ffaadf578760753763c25b3ff168d6b02"} May 21 21:30:24.692547 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:24.692543 2572 scope.go:117] "RemoveContainer" containerID="d24fe0c93253d5cea077833a1c71e24df706d4a1acfd0d8e4fb8e2691ed558a1" May 21 21:30:24.701085 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:24.701063 2572 scope.go:117] "RemoveContainer" containerID="d24fe0c93253d5cea077833a1c71e24df706d4a1acfd0d8e4fb8e2691ed558a1" May 21 21:30:24.701308 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:30:24.701293 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d24fe0c93253d5cea077833a1c71e24df706d4a1acfd0d8e4fb8e2691ed558a1\": container with ID starting with d24fe0c93253d5cea077833a1c71e24df706d4a1acfd0d8e4fb8e2691ed558a1 not found: ID does not exist" containerID="d24fe0c93253d5cea077833a1c71e24df706d4a1acfd0d8e4fb8e2691ed558a1" May 21 21:30:24.701361 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:24.701315 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d24fe0c93253d5cea077833a1c71e24df706d4a1acfd0d8e4fb8e2691ed558a1"} err="failed to get container status \"d24fe0c93253d5cea077833a1c71e24df706d4a1acfd0d8e4fb8e2691ed558a1\": rpc error: code = NotFound desc = could not find container \"d24fe0c93253d5cea077833a1c71e24df706d4a1acfd0d8e4fb8e2691ed558a1\": container with ID starting with d24fe0c93253d5cea077833a1c71e24df706d4a1acfd0d8e4fb8e2691ed558a1 not found: ID does not exist" May 21 21:30:24.709267 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:24.709225 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-66645f74b4-24c8q" podStartSLOduration=2.153594738 podStartE2EDuration="2.709212792s" podCreationTimestamp="2026-05-21 21:30:22 +0000 UTC" firstStartedPulling="2026-05-21 21:30:23.19133913 +0000 UTC m=+559.012936532" lastFinishedPulling="2026-05-21 21:30:23.746957184 +0000 UTC m=+559.568554586" observedRunningTime="2026-05-21 21:30:24.708303529 +0000 UTC m=+560.529900953" watchObservedRunningTime="2026-05-21 21:30:24.709212792 +0000 UTC m=+560.530810239" May 21 21:30:24.726932 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:24.726898 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-kxwbh"] May 21 21:30:24.733747 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:24.733723 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-kxwbh"] May 21 21:30:24.745575 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:24.745537 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1be0cc7f-e772-4423-b0d2-e36afe4c63f6" path="/var/lib/kubelet/pods/1be0cc7f-e772-4423-b0d2-e36afe4c63f6/volumes" May 21 21:30:24.745928 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:30:24.745908 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91146c9a-82b1-40eb-ae27-e384b4d07b6c" path="/var/lib/kubelet/pods/91146c9a-82b1-40eb-ae27-e384b4d07b6c/volumes" May 21 21:31:04.632436 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:04.632410 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-s7b5h_5b3e1a90-2f91-4105-bcc6-64375d2527d2/console-operator/2.log" May 21 21:31:04.632967 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:04.632554 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-s7b5h_5b3e1a90-2f91-4105-bcc6-64375d2527d2/console-operator/2.log" May 21 21:31:04.637795 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:04.637778 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cs2zq_c8ddeadf-53c9-4198-8334-76cbdd1832c2/ovn-acl-logging/0.log" May 21 21:31:04.637907 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:04.637816 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cs2zq_c8ddeadf-53c9-4198-8334-76cbdd1832c2/ovn-acl-logging/0.log" May 21 21:31:30.225942 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.225906 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc"] May 21 21:31:30.228345 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.226286 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1be0cc7f-e772-4423-b0d2-e36afe4c63f6" containerName="authorino" May 21 21:31:30.228345 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.226298 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1be0cc7f-e772-4423-b0d2-e36afe4c63f6" containerName="authorino" May 21 21:31:30.228345 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.226347 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="1be0cc7f-e772-4423-b0d2-e36afe4c63f6" containerName="authorino" May 21 21:31:30.229225 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.229202 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" May 21 21:31:30.231988 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.231964 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 21:31:30.232110 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.232088 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 21:31:30.232173 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.232159 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-p5j97\"" May 21 21:31:30.233048 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.233029 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 21 21:31:30.238517 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.238490 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc"] May 21 21:31:30.408919 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.408881 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdaa15b1-1cba-43c2-8806-13d5f5a5275a-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc\" (UID: \"cdaa15b1-1cba-43c2-8806-13d5f5a5275a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" May 21 21:31:30.409083 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.408932 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdaa15b1-1cba-43c2-8806-13d5f5a5275a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc\" (UID: \"cdaa15b1-1cba-43c2-8806-13d5f5a5275a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" May 21 21:31:30.409083 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.409019 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdaa15b1-1cba-43c2-8806-13d5f5a5275a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc\" (UID: \"cdaa15b1-1cba-43c2-8806-13d5f5a5275a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" May 21 21:31:30.409083 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.409050 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cdaa15b1-1cba-43c2-8806-13d5f5a5275a-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc\" (UID: \"cdaa15b1-1cba-43c2-8806-13d5f5a5275a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" May 21 21:31:30.409083 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.409069 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmjs6\" (UniqueName: \"kubernetes.io/projected/cdaa15b1-1cba-43c2-8806-13d5f5a5275a-kube-api-access-rmjs6\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc\" (UID: \"cdaa15b1-1cba-43c2-8806-13d5f5a5275a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" May 21 21:31:30.409237 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.409147 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdaa15b1-1cba-43c2-8806-13d5f5a5275a-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc\" (UID: \"cdaa15b1-1cba-43c2-8806-13d5f5a5275a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" May 21 21:31:30.510145 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.510054 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdaa15b1-1cba-43c2-8806-13d5f5a5275a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc\" (UID: \"cdaa15b1-1cba-43c2-8806-13d5f5a5275a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" May 21 21:31:30.510145 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.510096 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cdaa15b1-1cba-43c2-8806-13d5f5a5275a-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc\" (UID: \"cdaa15b1-1cba-43c2-8806-13d5f5a5275a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" May 21 21:31:30.510363 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.510150 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rmjs6\" (UniqueName: \"kubernetes.io/projected/cdaa15b1-1cba-43c2-8806-13d5f5a5275a-kube-api-access-rmjs6\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc\" (UID: \"cdaa15b1-1cba-43c2-8806-13d5f5a5275a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" May 21 21:31:30.510363 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.510219 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdaa15b1-1cba-43c2-8806-13d5f5a5275a-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc\" (UID: \"cdaa15b1-1cba-43c2-8806-13d5f5a5275a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" May 21 21:31:30.510363 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.510273 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdaa15b1-1cba-43c2-8806-13d5f5a5275a-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc\" (UID: \"cdaa15b1-1cba-43c2-8806-13d5f5a5275a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" May 21 21:31:30.510363 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.510315 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdaa15b1-1cba-43c2-8806-13d5f5a5275a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc\" (UID: \"cdaa15b1-1cba-43c2-8806-13d5f5a5275a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" May 21 21:31:30.510564 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.510472 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cdaa15b1-1cba-43c2-8806-13d5f5a5275a-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc\" (UID: \"cdaa15b1-1cba-43c2-8806-13d5f5a5275a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" May 21 21:31:30.510564 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.510530 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdaa15b1-1cba-43c2-8806-13d5f5a5275a-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc\" (UID: \"cdaa15b1-1cba-43c2-8806-13d5f5a5275a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" May 21 21:31:30.510640 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.510616 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdaa15b1-1cba-43c2-8806-13d5f5a5275a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc\" (UID: \"cdaa15b1-1cba-43c2-8806-13d5f5a5275a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" May 21 21:31:30.512372 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.512354 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdaa15b1-1cba-43c2-8806-13d5f5a5275a-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc\" (UID: \"cdaa15b1-1cba-43c2-8806-13d5f5a5275a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" May 21 21:31:30.512538 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.512522 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdaa15b1-1cba-43c2-8806-13d5f5a5275a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc\" (UID: \"cdaa15b1-1cba-43c2-8806-13d5f5a5275a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" May 21 21:31:30.518311 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.518289 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmjs6\" (UniqueName: \"kubernetes.io/projected/cdaa15b1-1cba-43c2-8806-13d5f5a5275a-kube-api-access-rmjs6\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc\" (UID: \"cdaa15b1-1cba-43c2-8806-13d5f5a5275a\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" May 21 21:31:30.539982 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.539957 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" May 21 21:31:30.666609 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.666583 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc"] May 21 21:31:30.668759 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:31:30.668733 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdaa15b1_1cba_43c2_8806_13d5f5a5275a.slice/crio-c5cbceab50ace76076b329a757f0f28285b5f1a550ea9ce090c59464821bf5a8 WatchSource:0}: Error finding container c5cbceab50ace76076b329a757f0f28285b5f1a550ea9ce090c59464821bf5a8: Status 404 returned error can't find the container with id c5cbceab50ace76076b329a757f0f28285b5f1a550ea9ce090c59464821bf5a8 May 21 21:31:30.671006 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.670986 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 21:31:30.899013 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:30.898982 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" event={"ID":"cdaa15b1-1cba-43c2-8806-13d5f5a5275a","Type":"ContainerStarted","Data":"c5cbceab50ace76076b329a757f0f28285b5f1a550ea9ce090c59464821bf5a8"} May 21 21:31:35.919624 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:35.919589 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" event={"ID":"cdaa15b1-1cba-43c2-8806-13d5f5a5275a","Type":"ContainerStarted","Data":"c3c6b173d96d0ba24a9b3c4f5932c8e7eb840219bac8f70f9de4fa3c30da58d7"} May 21 21:31:41.943356 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:41.943319 2572 generic.go:358] "Generic (PLEG): container finished" podID="cdaa15b1-1cba-43c2-8806-13d5f5a5275a" containerID="c3c6b173d96d0ba24a9b3c4f5932c8e7eb840219bac8f70f9de4fa3c30da58d7" exitCode=0 May 21 21:31:41.943760 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:41.943379 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" event={"ID":"cdaa15b1-1cba-43c2-8806-13d5f5a5275a","Type":"ContainerDied","Data":"c3c6b173d96d0ba24a9b3c4f5932c8e7eb840219bac8f70f9de4fa3c30da58d7"} May 21 21:31:43.952720 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:43.952668 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" event={"ID":"cdaa15b1-1cba-43c2-8806-13d5f5a5275a","Type":"ContainerStarted","Data":"9bcb3c39d31bd9c6f781fd1dfdf167275fe73f35d37e4c8637098bc017aed341"} May 21 21:31:43.953175 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:43.952913 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" May 21 21:31:43.975943 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:43.975898 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" podStartSLOduration=1.723152641 podStartE2EDuration="13.975885447s" podCreationTimestamp="2026-05-21 21:31:30 +0000 UTC" firstStartedPulling="2026-05-21 21:31:30.671104974 +0000 UTC m=+626.492702373" lastFinishedPulling="2026-05-21 21:31:42.923837777 +0000 UTC m=+638.745435179" observedRunningTime="2026-05-21 21:31:43.974751478 +0000 UTC m=+639.796348899" watchObservedRunningTime="2026-05-21 21:31:43.975885447 +0000 UTC m=+639.797482866" May 21 21:31:48.344162 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.344128 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z"] May 21 21:31:48.347350 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.347331 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" May 21 21:31:48.350610 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.350581 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 21 21:31:48.370177 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.370155 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z"] May 21 21:31:48.371469 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.371449 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/074ad470-8757-473f-906f-b6eb65813cc4-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z\" (UID: \"074ad470-8757-473f-906f-b6eb65813cc4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" May 21 21:31:48.371565 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.371484 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wddlf\" (UniqueName: \"kubernetes.io/projected/074ad470-8757-473f-906f-b6eb65813cc4-kube-api-access-wddlf\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z\" (UID: \"074ad470-8757-473f-906f-b6eb65813cc4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" May 21 21:31:48.371565 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.371520 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/074ad470-8757-473f-906f-b6eb65813cc4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z\" (UID: \"074ad470-8757-473f-906f-b6eb65813cc4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" May 21 21:31:48.371657 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.371581 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/074ad470-8757-473f-906f-b6eb65813cc4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z\" (UID: \"074ad470-8757-473f-906f-b6eb65813cc4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" May 21 21:31:48.371657 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.371602 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/074ad470-8757-473f-906f-b6eb65813cc4-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z\" (UID: \"074ad470-8757-473f-906f-b6eb65813cc4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" May 21 21:31:48.371780 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.371719 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/074ad470-8757-473f-906f-b6eb65813cc4-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z\" (UID: \"074ad470-8757-473f-906f-b6eb65813cc4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" May 21 21:31:48.472188 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.472158 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/074ad470-8757-473f-906f-b6eb65813cc4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z\" (UID: \"074ad470-8757-473f-906f-b6eb65813cc4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" May 21 21:31:48.472334 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.472213 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/074ad470-8757-473f-906f-b6eb65813cc4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z\" (UID: \"074ad470-8757-473f-906f-b6eb65813cc4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" May 21 21:31:48.472334 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.472241 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/074ad470-8757-473f-906f-b6eb65813cc4-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z\" (UID: \"074ad470-8757-473f-906f-b6eb65813cc4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" May 21 21:31:48.472334 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.472307 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/074ad470-8757-473f-906f-b6eb65813cc4-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z\" (UID: \"074ad470-8757-473f-906f-b6eb65813cc4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" May 21 21:31:48.472487 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.472336 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/074ad470-8757-473f-906f-b6eb65813cc4-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z\" (UID: \"074ad470-8757-473f-906f-b6eb65813cc4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" May 21 21:31:48.472487 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.472366 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wddlf\" (UniqueName: \"kubernetes.io/projected/074ad470-8757-473f-906f-b6eb65813cc4-kube-api-access-wddlf\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z\" (UID: \"074ad470-8757-473f-906f-b6eb65813cc4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" May 21 21:31:48.472773 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.472741 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/074ad470-8757-473f-906f-b6eb65813cc4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z\" (UID: \"074ad470-8757-473f-906f-b6eb65813cc4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" May 21 21:31:48.472773 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.472767 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/074ad470-8757-473f-906f-b6eb65813cc4-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z\" (UID: \"074ad470-8757-473f-906f-b6eb65813cc4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" May 21 21:31:48.472922 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.472814 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/074ad470-8757-473f-906f-b6eb65813cc4-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z\" (UID: \"074ad470-8757-473f-906f-b6eb65813cc4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" May 21 21:31:48.474384 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.474363 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/074ad470-8757-473f-906f-b6eb65813cc4-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z\" (UID: \"074ad470-8757-473f-906f-b6eb65813cc4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" May 21 21:31:48.474627 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.474611 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/074ad470-8757-473f-906f-b6eb65813cc4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z\" (UID: \"074ad470-8757-473f-906f-b6eb65813cc4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" May 21 21:31:48.481054 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.481036 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wddlf\" (UniqueName: \"kubernetes.io/projected/074ad470-8757-473f-906f-b6eb65813cc4-kube-api-access-wddlf\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z\" (UID: \"074ad470-8757-473f-906f-b6eb65813cc4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" May 21 21:31:48.657127 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.657093 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" May 21 21:31:48.790989 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.790961 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z"] May 21 21:31:48.792917 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:31:48.792889 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod074ad470_8757_473f_906f_b6eb65813cc4.slice/crio-e57f968dd07d8544870c231f71c5d3e77be4b7570387a4df6bfc0ef96f18ad38 WatchSource:0}: Error finding container e57f968dd07d8544870c231f71c5d3e77be4b7570387a4df6bfc0ef96f18ad38: Status 404 returned error can't find the container with id e57f968dd07d8544870c231f71c5d3e77be4b7570387a4df6bfc0ef96f18ad38 May 21 21:31:48.970411 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.970322 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" event={"ID":"074ad470-8757-473f-906f-b6eb65813cc4","Type":"ContainerStarted","Data":"662b4bd8eeae3dd95c54f9a944ebc50645a566e3ba88f1c1b7b2fdc02e170b71"} May 21 21:31:48.970411 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:48.970367 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" event={"ID":"074ad470-8757-473f-906f-b6eb65813cc4","Type":"ContainerStarted","Data":"e57f968dd07d8544870c231f71c5d3e77be4b7570387a4df6bfc0ef96f18ad38"} May 21 21:31:54.969402 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:54.969372 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc" May 21 21:31:54.991507 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:54.991472 2572 generic.go:358] "Generic (PLEG): container finished" podID="074ad470-8757-473f-906f-b6eb65813cc4" containerID="662b4bd8eeae3dd95c54f9a944ebc50645a566e3ba88f1c1b7b2fdc02e170b71" exitCode=0 May 21 21:31:54.991507 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:54.991501 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" event={"ID":"074ad470-8757-473f-906f-b6eb65813cc4","Type":"ContainerDied","Data":"662b4bd8eeae3dd95c54f9a944ebc50645a566e3ba88f1c1b7b2fdc02e170b71"} May 21 21:31:55.995980 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:55.995948 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" event={"ID":"074ad470-8757-473f-906f-b6eb65813cc4","Type":"ContainerStarted","Data":"9f812ce5ac75785e95fe44d9cdb0e6de100cc028a6a9092f967a5d5ed9c62065"} May 21 21:31:55.996343 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:55.996155 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" May 21 21:31:56.016820 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:31:56.016758 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" podStartSLOduration=7.815335516 podStartE2EDuration="8.016741925s" podCreationTimestamp="2026-05-21 21:31:48 +0000 UTC" firstStartedPulling="2026-05-21 21:31:54.992149317 +0000 UTC m=+650.813746716" lastFinishedPulling="2026-05-21 21:31:55.19355571 +0000 UTC m=+651.015153125" observedRunningTime="2026-05-21 21:31:56.015680832 +0000 UTC m=+651.837278265" watchObservedRunningTime="2026-05-21 21:31:56.016741925 +0000 UTC m=+651.838339346" May 21 21:32:07.012200 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:07.012172 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z" May 21 21:32:26.522886 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:26.522849 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66645f74b4-24c8q"] May 21 21:32:26.523474 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:26.523071 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-66645f74b4-24c8q" podUID="c24645e2-838e-4078-a01d-6ba8b08688f4" containerName="authorino" containerID="cri-o://0f2e3bd54b9470205a6fa0ba5a585c5107e2a5b4b84e5267ecdf19412605fa66" gracePeriod=30 May 21 21:32:26.773025 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:26.772962 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66645f74b4-24c8q" May 21 21:32:26.819526 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:26.819494 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c24645e2-838e-4078-a01d-6ba8b08688f4-tls-cert\") pod \"c24645e2-838e-4078-a01d-6ba8b08688f4\" (UID: \"c24645e2-838e-4078-a01d-6ba8b08688f4\") " May 21 21:32:26.819735 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:26.819654 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7svbr\" (UniqueName: \"kubernetes.io/projected/c24645e2-838e-4078-a01d-6ba8b08688f4-kube-api-access-7svbr\") pod \"c24645e2-838e-4078-a01d-6ba8b08688f4\" (UID: \"c24645e2-838e-4078-a01d-6ba8b08688f4\") " May 21 21:32:26.821495 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:26.821468 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c24645e2-838e-4078-a01d-6ba8b08688f4-kube-api-access-7svbr" (OuterVolumeSpecName: "kube-api-access-7svbr") pod "c24645e2-838e-4078-a01d-6ba8b08688f4" (UID: "c24645e2-838e-4078-a01d-6ba8b08688f4"). InnerVolumeSpecName "kube-api-access-7svbr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 21:32:26.829019 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:26.828991 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c24645e2-838e-4078-a01d-6ba8b08688f4-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c24645e2-838e-4078-a01d-6ba8b08688f4" (UID: "c24645e2-838e-4078-a01d-6ba8b08688f4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 21:32:26.920795 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:26.920765 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7svbr\" (UniqueName: \"kubernetes.io/projected/c24645e2-838e-4078-a01d-6ba8b08688f4-kube-api-access-7svbr\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:32:26.920795 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:26.920792 2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c24645e2-838e-4078-a01d-6ba8b08688f4-tls-cert\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:32:27.098193 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:27.098099 2572 generic.go:358] "Generic (PLEG): container finished" podID="c24645e2-838e-4078-a01d-6ba8b08688f4" containerID="0f2e3bd54b9470205a6fa0ba5a585c5107e2a5b4b84e5267ecdf19412605fa66" exitCode=0 May 21 21:32:27.098193 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:27.098134 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66645f74b4-24c8q" event={"ID":"c24645e2-838e-4078-a01d-6ba8b08688f4","Type":"ContainerDied","Data":"0f2e3bd54b9470205a6fa0ba5a585c5107e2a5b4b84e5267ecdf19412605fa66"} May 21 21:32:27.098193 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:27.098161 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66645f74b4-24c8q" May 21 21:32:27.098193 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:27.098173 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66645f74b4-24c8q" event={"ID":"c24645e2-838e-4078-a01d-6ba8b08688f4","Type":"ContainerDied","Data":"dbcc4d8d0041915d5486f73ee4c8bae6ed3d5f9e3ad5ae2f384eb08a0d1cda45"} May 21 21:32:27.098193 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:27.098189 2572 scope.go:117] "RemoveContainer" containerID="0f2e3bd54b9470205a6fa0ba5a585c5107e2a5b4b84e5267ecdf19412605fa66" May 21 21:32:27.107089 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:27.107073 2572 scope.go:117] "RemoveContainer" containerID="0f2e3bd54b9470205a6fa0ba5a585c5107e2a5b4b84e5267ecdf19412605fa66" May 21 21:32:27.107326 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:32:27.107309 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f2e3bd54b9470205a6fa0ba5a585c5107e2a5b4b84e5267ecdf19412605fa66\": container with ID starting with 0f2e3bd54b9470205a6fa0ba5a585c5107e2a5b4b84e5267ecdf19412605fa66 not found: ID does not exist" containerID="0f2e3bd54b9470205a6fa0ba5a585c5107e2a5b4b84e5267ecdf19412605fa66" May 21 21:32:27.107373 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:27.107336 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f2e3bd54b9470205a6fa0ba5a585c5107e2a5b4b84e5267ecdf19412605fa66"} err="failed to get container status \"0f2e3bd54b9470205a6fa0ba5a585c5107e2a5b4b84e5267ecdf19412605fa66\": rpc error: code = NotFound desc = could not find container \"0f2e3bd54b9470205a6fa0ba5a585c5107e2a5b4b84e5267ecdf19412605fa66\": container with ID starting with 0f2e3bd54b9470205a6fa0ba5a585c5107e2a5b4b84e5267ecdf19412605fa66 not found: ID does not exist" May 21 21:32:27.123738 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:27.123713 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66645f74b4-24c8q"] May 21 21:32:27.126430 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:27.126407 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-66645f74b4-24c8q"] May 21 21:32:28.743263 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:28.743228 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c24645e2-838e-4078-a01d-6ba8b08688f4" path="/var/lib/kubelet/pods/c24645e2-838e-4078-a01d-6ba8b08688f4/volumes" May 21 21:32:33.253224 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.253184 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7"] May 21 21:32:33.253583 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.253544 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c24645e2-838e-4078-a01d-6ba8b08688f4" containerName="authorino" May 21 21:32:33.253583 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.253556 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c24645e2-838e-4078-a01d-6ba8b08688f4" containerName="authorino" May 21 21:32:33.253649 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.253615 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="c24645e2-838e-4078-a01d-6ba8b08688f4" containerName="authorino" May 21 21:32:33.258074 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.258047 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" May 21 21:32:33.260642 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.260619 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 21 21:32:33.268853 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.268827 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7"] May 21 21:32:33.374262 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.374227 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/601b1f66-b340-4b20-9f41-33e4b900a786-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-j5dn7\" (UID: \"601b1f66-b340-4b20-9f41-33e4b900a786\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" May 21 21:32:33.374428 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.374271 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/601b1f66-b340-4b20-9f41-33e4b900a786-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-j5dn7\" (UID: \"601b1f66-b340-4b20-9f41-33e4b900a786\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" May 21 21:32:33.374428 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.374303 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/601b1f66-b340-4b20-9f41-33e4b900a786-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-j5dn7\" (UID: \"601b1f66-b340-4b20-9f41-33e4b900a786\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" May 21 21:32:33.374428 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.374371 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/601b1f66-b340-4b20-9f41-33e4b900a786-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-j5dn7\" (UID: \"601b1f66-b340-4b20-9f41-33e4b900a786\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" May 21 21:32:33.374428 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.374405 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6959\" (UniqueName: \"kubernetes.io/projected/601b1f66-b340-4b20-9f41-33e4b900a786-kube-api-access-z6959\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-j5dn7\" (UID: \"601b1f66-b340-4b20-9f41-33e4b900a786\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" May 21 21:32:33.374428 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.374426 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/601b1f66-b340-4b20-9f41-33e4b900a786-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-j5dn7\" (UID: \"601b1f66-b340-4b20-9f41-33e4b900a786\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" May 21 21:32:33.475519 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.475470 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/601b1f66-b340-4b20-9f41-33e4b900a786-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-j5dn7\" (UID: \"601b1f66-b340-4b20-9f41-33e4b900a786\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" May 21 21:32:33.475519 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.475529 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/601b1f66-b340-4b20-9f41-33e4b900a786-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-j5dn7\" (UID: \"601b1f66-b340-4b20-9f41-33e4b900a786\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" May 21 21:32:33.475770 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.475556 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/601b1f66-b340-4b20-9f41-33e4b900a786-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-j5dn7\" (UID: \"601b1f66-b340-4b20-9f41-33e4b900a786\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" May 21 21:32:33.475770 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.475589 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/601b1f66-b340-4b20-9f41-33e4b900a786-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-j5dn7\" (UID: \"601b1f66-b340-4b20-9f41-33e4b900a786\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" May 21 21:32:33.475770 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.475609 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6959\" (UniqueName: \"kubernetes.io/projected/601b1f66-b340-4b20-9f41-33e4b900a786-kube-api-access-z6959\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-j5dn7\" (UID: \"601b1f66-b340-4b20-9f41-33e4b900a786\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" May 21 21:32:33.475770 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.475628 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/601b1f66-b340-4b20-9f41-33e4b900a786-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-j5dn7\" (UID: \"601b1f66-b340-4b20-9f41-33e4b900a786\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" May 21 21:32:33.475988 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.475965 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/601b1f66-b340-4b20-9f41-33e4b900a786-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-j5dn7\" (UID: \"601b1f66-b340-4b20-9f41-33e4b900a786\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" May 21 21:32:33.476045 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.476003 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/601b1f66-b340-4b20-9f41-33e4b900a786-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-j5dn7\" (UID: \"601b1f66-b340-4b20-9f41-33e4b900a786\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" May 21 21:32:33.476045 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.476014 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/601b1f66-b340-4b20-9f41-33e4b900a786-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-j5dn7\" (UID: \"601b1f66-b340-4b20-9f41-33e4b900a786\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" May 21 21:32:33.477980 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.477950 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/601b1f66-b340-4b20-9f41-33e4b900a786-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-j5dn7\" (UID: \"601b1f66-b340-4b20-9f41-33e4b900a786\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" May 21 21:32:33.478125 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.478108 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/601b1f66-b340-4b20-9f41-33e4b900a786-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-j5dn7\" (UID: \"601b1f66-b340-4b20-9f41-33e4b900a786\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" May 21 21:32:33.486932 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.486909 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6959\" (UniqueName: \"kubernetes.io/projected/601b1f66-b340-4b20-9f41-33e4b900a786-kube-api-access-z6959\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-j5dn7\" (UID: \"601b1f66-b340-4b20-9f41-33e4b900a786\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" May 21 21:32:33.569192 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.569108 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" May 21 21:32:33.698919 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:33.698893 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7"] May 21 21:32:33.701543 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:32:33.701507 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod601b1f66_b340_4b20_9f41_33e4b900a786.slice/crio-cc83d02b9cf807a8f7798a49ee7532f51ecd29acf21604bdc44329607877458f WatchSource:0}: Error finding container cc83d02b9cf807a8f7798a49ee7532f51ecd29acf21604bdc44329607877458f: Status 404 returned error can't find the container with id cc83d02b9cf807a8f7798a49ee7532f51ecd29acf21604bdc44329607877458f May 21 21:32:34.122778 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:34.122738 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" event={"ID":"601b1f66-b340-4b20-9f41-33e4b900a786","Type":"ContainerStarted","Data":"05e2a8bc7a7bc047372bd8ef5507c2194ef656cabc4a13c05ec9478e0c9868a3"} May 21 21:32:34.122778 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:34.122778 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" event={"ID":"601b1f66-b340-4b20-9f41-33e4b900a786","Type":"ContainerStarted","Data":"cc83d02b9cf807a8f7798a49ee7532f51ecd29acf21604bdc44329607877458f"} May 21 21:32:40.145099 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:40.145064 2572 generic.go:358] "Generic (PLEG): container finished" podID="601b1f66-b340-4b20-9f41-33e4b900a786" containerID="05e2a8bc7a7bc047372bd8ef5507c2194ef656cabc4a13c05ec9478e0c9868a3" exitCode=0 May 21 21:32:40.145469 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:40.145141 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" event={"ID":"601b1f66-b340-4b20-9f41-33e4b900a786","Type":"ContainerDied","Data":"05e2a8bc7a7bc047372bd8ef5507c2194ef656cabc4a13c05ec9478e0c9868a3"} May 21 21:32:41.150219 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:41.150182 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" event={"ID":"601b1f66-b340-4b20-9f41-33e4b900a786","Type":"ContainerStarted","Data":"7ac9c50090b192d25f04c7f812c543e4f05bda06d5d9c181e92d471f78901047"} May 21 21:32:41.150677 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:41.150411 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" May 21 21:32:41.170055 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:41.170007 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" podStartSLOduration=7.956165955 podStartE2EDuration="8.169992989s" podCreationTimestamp="2026-05-21 21:32:33 +0000 UTC" firstStartedPulling="2026-05-21 21:32:40.145797967 +0000 UTC m=+695.967395366" lastFinishedPulling="2026-05-21 21:32:40.359624989 +0000 UTC m=+696.181222400" observedRunningTime="2026-05-21 21:32:41.169028458 +0000 UTC m=+696.990625877" watchObservedRunningTime="2026-05-21 21:32:41.169992989 +0000 UTC m=+696.991590387" May 21 21:32:52.166854 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:32:52.166775 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-j5dn7" May 21 21:36:04.655795 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:36:04.655719 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-s7b5h_5b3e1a90-2f91-4105-bcc6-64375d2527d2/console-operator/2.log" May 21 21:36:04.657229 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:36:04.657199 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-s7b5h_5b3e1a90-2f91-4105-bcc6-64375d2527d2/console-operator/2.log" May 21 21:36:04.661365 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:36:04.661346 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cs2zq_c8ddeadf-53c9-4198-8334-76cbdd1832c2/ovn-acl-logging/0.log" May 21 21:36:04.665079 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:36:04.665059 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cs2zq_c8ddeadf-53c9-4198-8334-76cbdd1832c2/ovn-acl-logging/0.log" May 21 21:41:04.681843 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:41:04.681811 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-s7b5h_5b3e1a90-2f91-4105-bcc6-64375d2527d2/console-operator/2.log" May 21 21:41:04.684240 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:41:04.684215 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-s7b5h_5b3e1a90-2f91-4105-bcc6-64375d2527d2/console-operator/2.log" May 21 21:41:04.687366 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:41:04.687347 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cs2zq_c8ddeadf-53c9-4198-8334-76cbdd1832c2/ovn-acl-logging/0.log" May 21 21:41:04.689594 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:41:04.689577 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cs2zq_c8ddeadf-53c9-4198-8334-76cbdd1832c2/ovn-acl-logging/0.log" May 21 21:45:00.144063 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:45:00.143986 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29656665-g7j9h"] May 21 21:45:00.149041 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:45:00.149021 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656665-g7j9h" May 21 21:45:00.152097 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:45:00.152071 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-dw59m\"" May 21 21:45:00.153334 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:45:00.153308 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656665-g7j9h"] May 21 21:45:00.269161 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:45:00.269130 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b85f\" (UniqueName: \"kubernetes.io/projected/e680b84f-9cbf-4139-b9ad-8dbc4e902046-kube-api-access-9b85f\") pod \"maas-api-key-cleanup-29656665-g7j9h\" (UID: \"e680b84f-9cbf-4139-b9ad-8dbc4e902046\") " pod="opendatahub/maas-api-key-cleanup-29656665-g7j9h" May 21 21:45:00.370499 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:45:00.370448 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9b85f\" (UniqueName: \"kubernetes.io/projected/e680b84f-9cbf-4139-b9ad-8dbc4e902046-kube-api-access-9b85f\") pod \"maas-api-key-cleanup-29656665-g7j9h\" (UID: \"e680b84f-9cbf-4139-b9ad-8dbc4e902046\") " pod="opendatahub/maas-api-key-cleanup-29656665-g7j9h" May 21 21:45:00.379746 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:45:00.379704 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b85f\" (UniqueName: \"kubernetes.io/projected/e680b84f-9cbf-4139-b9ad-8dbc4e902046-kube-api-access-9b85f\") pod \"maas-api-key-cleanup-29656665-g7j9h\" (UID: \"e680b84f-9cbf-4139-b9ad-8dbc4e902046\") " pod="opendatahub/maas-api-key-cleanup-29656665-g7j9h" May 21 21:45:00.459366 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:45:00.459333 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656665-g7j9h" May 21 21:45:00.584478 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:45:00.584453 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656665-g7j9h"] May 21 21:45:00.586473 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:45:00.586444 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode680b84f_9cbf_4139_b9ad_8dbc4e902046.slice/crio-6d4d6caf7d4bc1d2f8d5ff7ea5b77008c4783abbcebadb31439ca36b713a0231 WatchSource:0}: Error finding container 6d4d6caf7d4bc1d2f8d5ff7ea5b77008c4783abbcebadb31439ca36b713a0231: Status 404 returned error can't find the container with id 6d4d6caf7d4bc1d2f8d5ff7ea5b77008c4783abbcebadb31439ca36b713a0231 May 21 21:45:00.588158 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:45:00.588140 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 21:45:00.632514 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:45:00.632479 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656665-g7j9h" event={"ID":"e680b84f-9cbf-4139-b9ad-8dbc4e902046","Type":"ContainerStarted","Data":"6d4d6caf7d4bc1d2f8d5ff7ea5b77008c4783abbcebadb31439ca36b713a0231"} May 21 21:46:00.011183 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:46:00.011143 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656665-g7j9h"] May 21 21:46:04.706237 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:46:04.706204 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-s7b5h_5b3e1a90-2f91-4105-bcc6-64375d2527d2/console-operator/2.log" May 21 21:46:04.708559 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:46:04.708533 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-s7b5h_5b3e1a90-2f91-4105-bcc6-64375d2527d2/console-operator/2.log" May 21 21:46:04.711761 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:46:04.711741 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cs2zq_c8ddeadf-53c9-4198-8334-76cbdd1832c2/ovn-acl-logging/0.log" May 21 21:46:04.713718 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:46:04.713703 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cs2zq_c8ddeadf-53c9-4198-8334-76cbdd1832c2/ovn-acl-logging/0.log" May 21 21:47:04.063281 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:47:04.063237 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656665-g7j9h" event={"ID":"e680b84f-9cbf-4139-b9ad-8dbc4e902046","Type":"ContainerStarted","Data":"3fa4efd69beb1a295d7d2819e71cf02156b0fc078bc6cd00a5bcb4a64bc4cf7e"} May 21 21:47:04.063745 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:47:04.063298 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-key-cleanup-29656665-g7j9h" podUID="e680b84f-9cbf-4139-b9ad-8dbc4e902046" containerName="cleanup" containerID="cri-o://3fa4efd69beb1a295d7d2819e71cf02156b0fc078bc6cd00a5bcb4a64bc4cf7e" gracePeriod=30 May 21 21:47:04.091277 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:47:04.091218 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29656665-g7j9h" podStartSLOduration=1.001752267 podStartE2EDuration="2m4.091199992s" podCreationTimestamp="2026-05-21 21:45:00 +0000 UTC" firstStartedPulling="2026-05-21 21:45:00.588271676 +0000 UTC m=+1436.409869075" lastFinishedPulling="2026-05-21 21:47:03.677719391 +0000 UTC m=+1559.499316800" observedRunningTime="2026-05-21 21:47:04.090718674 +0000 UTC m=+1559.912316096" watchObservedRunningTime="2026-05-21 21:47:04.091199992 +0000 UTC m=+1559.912797417" May 21 21:47:04.714607 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:47:04.714583 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656665-g7j9h" May 21 21:47:04.798509 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:47:04.798481 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9b85f\" (UniqueName: \"kubernetes.io/projected/e680b84f-9cbf-4139-b9ad-8dbc4e902046-kube-api-access-9b85f\") pod \"e680b84f-9cbf-4139-b9ad-8dbc4e902046\" (UID: \"e680b84f-9cbf-4139-b9ad-8dbc4e902046\") " May 21 21:47:04.800595 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:47:04.800535 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e680b84f-9cbf-4139-b9ad-8dbc4e902046-kube-api-access-9b85f" (OuterVolumeSpecName: "kube-api-access-9b85f") pod "e680b84f-9cbf-4139-b9ad-8dbc4e902046" (UID: "e680b84f-9cbf-4139-b9ad-8dbc4e902046"). InnerVolumeSpecName "kube-api-access-9b85f". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 21:47:04.899646 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:47:04.899615 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9b85f\" (UniqueName: \"kubernetes.io/projected/e680b84f-9cbf-4139-b9ad-8dbc4e902046-kube-api-access-9b85f\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 21 21:47:05.072965 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:47:05.072881 2572 generic.go:358] "Generic (PLEG): container finished" podID="e680b84f-9cbf-4139-b9ad-8dbc4e902046" containerID="3fa4efd69beb1a295d7d2819e71cf02156b0fc078bc6cd00a5bcb4a64bc4cf7e" exitCode=0 May 21 21:47:05.072965 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:47:05.072956 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656665-g7j9h" event={"ID":"e680b84f-9cbf-4139-b9ad-8dbc4e902046","Type":"ContainerDied","Data":"3fa4efd69beb1a295d7d2819e71cf02156b0fc078bc6cd00a5bcb4a64bc4cf7e"} May 21 21:47:05.073479 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:47:05.072966 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656665-g7j9h" May 21 21:47:05.073479 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:47:05.072988 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656665-g7j9h" event={"ID":"e680b84f-9cbf-4139-b9ad-8dbc4e902046","Type":"ContainerDied","Data":"6d4d6caf7d4bc1d2f8d5ff7ea5b77008c4783abbcebadb31439ca36b713a0231"} May 21 21:47:05.073479 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:47:05.073007 2572 scope.go:117] "RemoveContainer" containerID="3fa4efd69beb1a295d7d2819e71cf02156b0fc078bc6cd00a5bcb4a64bc4cf7e" May 21 21:47:05.080987 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:47:05.080905 2572 scope.go:117] "RemoveContainer" containerID="3fa4efd69beb1a295d7d2819e71cf02156b0fc078bc6cd00a5bcb4a64bc4cf7e" May 21 21:47:05.081232 ip-10-0-133-99 kubenswrapper[2572]: E0521 21:47:05.081207 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fa4efd69beb1a295d7d2819e71cf02156b0fc078bc6cd00a5bcb4a64bc4cf7e\": container with ID starting with 3fa4efd69beb1a295d7d2819e71cf02156b0fc078bc6cd00a5bcb4a64bc4cf7e not found: ID does not exist" containerID="3fa4efd69beb1a295d7d2819e71cf02156b0fc078bc6cd00a5bcb4a64bc4cf7e" May 21 21:47:05.081298 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:47:05.081243 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fa4efd69beb1a295d7d2819e71cf02156b0fc078bc6cd00a5bcb4a64bc4cf7e"} err="failed to get container status \"3fa4efd69beb1a295d7d2819e71cf02156b0fc078bc6cd00a5bcb4a64bc4cf7e\": rpc error: code = NotFound desc = could not find container \"3fa4efd69beb1a295d7d2819e71cf02156b0fc078bc6cd00a5bcb4a64bc4cf7e\": container with ID starting with 3fa4efd69beb1a295d7d2819e71cf02156b0fc078bc6cd00a5bcb4a64bc4cf7e not found: ID does not exist" May 21 21:47:05.093723 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:47:05.093681 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656665-g7j9h"] May 21 21:47:05.097579 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:47:05.097558 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656665-g7j9h"] May 21 21:47:06.744001 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:47:06.743968 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e680b84f-9cbf-4139-b9ad-8dbc4e902046" path="/var/lib/kubelet/pods/e680b84f-9cbf-4139-b9ad-8dbc4e902046/volumes" May 21 21:51:04.729936 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:51:04.729908 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-s7b5h_5b3e1a90-2f91-4105-bcc6-64375d2527d2/console-operator/2.log" May 21 21:51:04.732910 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:51:04.732885 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-s7b5h_5b3e1a90-2f91-4105-bcc6-64375d2527d2/console-operator/2.log" May 21 21:51:04.735451 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:51:04.735438 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cs2zq_c8ddeadf-53c9-4198-8334-76cbdd1832c2/ovn-acl-logging/0.log" May 21 21:51:04.738316 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:51:04.738300 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cs2zq_c8ddeadf-53c9-4198-8334-76cbdd1832c2/ovn-acl-logging/0.log" May 21 21:55:02.364555 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:02.364526 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79646d69f8-7x8ks_69195729-25bf-4c33-8618-2a796a6e3976/manager/0.log" May 21 21:55:02.695022 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:02.694994 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-xjsx9_73d4b74c-0e43-4db4-a045-3570a341dcb1/postgres/0.log" May 21 21:55:05.283039 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:05.283009 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8bb597df6-8jbv6_c476a754-eeba-4d49-acbb-fbf9950428c0/kube-auth-proxy/0.log" May 21 21:55:05.715365 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:05.715330 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-94b86d8cb-4w4s6_435d78d6-e6b0-4569-8585-aa2990bdee1f/router/0.log" May 21 21:55:06.049468 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:06.049384 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z_074ad470-8757-473f-906f-b6eb65813cc4/storage-initializer/0.log" May 21 21:55:06.057398 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:06.057376 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-xqw2z_074ad470-8757-473f-906f-b6eb65813cc4/main/0.log" May 21 21:55:06.279706 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:06.279663 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-j5dn7_601b1f66-b340-4b20-9f41-33e4b900a786/storage-initializer/0.log" May 21 21:55:06.287380 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:06.287358 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-j5dn7_601b1f66-b340-4b20-9f41-33e4b900a786/main/0.log" May 21 21:55:06.512454 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:06.512421 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc_cdaa15b1-1cba-43c2-8806-13d5f5a5275a/storage-initializer/0.log" May 21 21:55:06.520305 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:06.520278 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-vlnvc_cdaa15b1-1cba-43c2-8806-13d5f5a5275a/main/0.log" May 21 21:55:12.833002 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:12.832969 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hgf7j_c737fef0-1e59-4bb3-bf82-b34b18cb7337/global-pull-secret-syncer/0.log" May 21 21:55:13.090047 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:13.089948 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lrz84_2739574e-acb3-4fca-8dfd-03ec5801a1e1/konnectivity-agent/0.log" May 21 21:55:13.168230 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:13.168204 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-99.ec2.internal_f60ea2db76896f8a68dfa4cecb6168b4/haproxy/0.log" May 21 21:55:19.136059 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:19.135981 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-657bfbcd57-xc7zf_2bbc955c-9aa1-4d28-ad27-fad35594d8e7/metrics-server/0.log" May 21 21:55:19.162299 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:19.162265 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-dspmd_0cbfcde1-e5f8-47e1-b228-90b0a60afc92/monitoring-plugin/0.log" May 21 21:55:19.197873 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:19.197841 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5j6h6_bc5561be-0755-4d68-a1b7-5086ba5e366b/node-exporter/0.log" May 21 21:55:19.222338 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:19.222317 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5j6h6_bc5561be-0755-4d68-a1b7-5086ba5e366b/kube-rbac-proxy/0.log" May 21 21:55:19.249921 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:19.249892 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5j6h6_bc5561be-0755-4d68-a1b7-5086ba5e366b/init-textfile/0.log" May 21 21:55:19.426170 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:19.426135 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-jrhv7_098692c5-9775-4c5a-9da0-5ecddb242ab6/kube-rbac-proxy-main/0.log" May 21 21:55:19.449762 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:19.449737 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-jrhv7_098692c5-9775-4c5a-9da0-5ecddb242ab6/kube-rbac-proxy-self/0.log" May 21 21:55:19.470963 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:19.470936 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-jrhv7_098692c5-9775-4c5a-9da0-5ecddb242ab6/openshift-state-metrics/0.log" May 21 21:55:19.516829 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:19.516798 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c8a70c40-8708-43b9-83c1-59fdae6543da/prometheus/0.log" May 21 21:55:19.541231 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:19.541206 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c8a70c40-8708-43b9-83c1-59fdae6543da/config-reloader/0.log" May 21 21:55:19.569051 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:19.569027 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c8a70c40-8708-43b9-83c1-59fdae6543da/thanos-sidecar/0.log" May 21 21:55:19.591234 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:19.591209 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c8a70c40-8708-43b9-83c1-59fdae6543da/kube-rbac-proxy-web/0.log" May 21 21:55:19.614498 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:19.614471 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c8a70c40-8708-43b9-83c1-59fdae6543da/kube-rbac-proxy/0.log" May 21 21:55:19.635495 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:19.635473 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c8a70c40-8708-43b9-83c1-59fdae6543da/kube-rbac-proxy-thanos/0.log" May 21 21:55:19.654633 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:19.654605 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c8a70c40-8708-43b9-83c1-59fdae6543da/init-config-reloader/0.log" May 21 21:55:19.685757 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:19.684926 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-gzb4k_4aee03ea-f387-4671-a8a4-32f76b915ef1/prometheus-operator/0.log" May 21 21:55:19.699460 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:19.699435 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-gzb4k_4aee03ea-f387-4671-a8a4-32f76b915ef1/kube-rbac-proxy/0.log" May 21 21:55:19.721227 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:19.721200 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-2jcpf_e590a475-e249-478e-b4a3-66bbaa4416cc/prometheus-operator-admission-webhook/0.log" May 21 21:55:19.748467 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:19.748443 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-676bb5d57c-xdjzd_a6ad1813-debe-456f-8ee6-69135253e24f/telemeter-client/0.log" May 21 21:55:19.770589 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:19.770569 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-676bb5d57c-xdjzd_a6ad1813-debe-456f-8ee6-69135253e24f/reload/0.log" May 21 21:55:19.791793 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:19.791766 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-676bb5d57c-xdjzd_a6ad1813-debe-456f-8ee6-69135253e24f/kube-rbac-proxy/0.log" May 21 21:55:21.568708 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.568650 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zzm8x/perf-node-gather-daemonset-lg6hf"] May 21 21:55:21.569097 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.569022 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e680b84f-9cbf-4139-b9ad-8dbc4e902046" containerName="cleanup" May 21 21:55:21.569097 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.569034 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e680b84f-9cbf-4139-b9ad-8dbc4e902046" containerName="cleanup" May 21 21:55:21.569177 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.569101 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="e680b84f-9cbf-4139-b9ad-8dbc4e902046" containerName="cleanup" May 21 21:55:21.572074 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.572047 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-lg6hf" May 21 21:55:21.574666 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.574644 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zzm8x\"/\"kube-root-ca.crt\"" May 21 21:55:21.574808 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.574644 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zzm8x\"/\"openshift-service-ca.crt\"" May 21 21:55:21.575613 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.575592 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zzm8x\"/\"default-dockercfg-jrd2s\"" May 21 21:55:21.583318 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.583298 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zzm8x/perf-node-gather-daemonset-lg6hf"] May 21 21:55:21.627417 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.627392 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqfwt\" (UniqueName: \"kubernetes.io/projected/99895a9c-fb99-4199-8339-b7b04dbddddf-kube-api-access-kqfwt\") pod \"perf-node-gather-daemonset-lg6hf\" (UID: \"99895a9c-fb99-4199-8339-b7b04dbddddf\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-lg6hf" May 21 21:55:21.627531 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.627444 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/99895a9c-fb99-4199-8339-b7b04dbddddf-proc\") pod \"perf-node-gather-daemonset-lg6hf\" (UID: \"99895a9c-fb99-4199-8339-b7b04dbddddf\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-lg6hf" May 21 21:55:21.627531 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.627506 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/99895a9c-fb99-4199-8339-b7b04dbddddf-podres\") pod \"perf-node-gather-daemonset-lg6hf\" (UID: \"99895a9c-fb99-4199-8339-b7b04dbddddf\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-lg6hf" May 21 21:55:21.627605 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.627542 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99895a9c-fb99-4199-8339-b7b04dbddddf-sys\") pod \"perf-node-gather-daemonset-lg6hf\" (UID: \"99895a9c-fb99-4199-8339-b7b04dbddddf\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-lg6hf" May 21 21:55:21.627605 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.627586 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99895a9c-fb99-4199-8339-b7b04dbddddf-lib-modules\") pod \"perf-node-gather-daemonset-lg6hf\" (UID: \"99895a9c-fb99-4199-8339-b7b04dbddddf\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-lg6hf" May 21 21:55:21.658087 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.658066 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-s7b5h_5b3e1a90-2f91-4105-bcc6-64375d2527d2/console-operator/2.log" May 21 21:55:21.665432 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.665412 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-s7b5h_5b3e1a90-2f91-4105-bcc6-64375d2527d2/console-operator/3.log" May 21 21:55:21.728101 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.728072 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kqfwt\" (UniqueName: \"kubernetes.io/projected/99895a9c-fb99-4199-8339-b7b04dbddddf-kube-api-access-kqfwt\") pod \"perf-node-gather-daemonset-lg6hf\" (UID: \"99895a9c-fb99-4199-8339-b7b04dbddddf\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-lg6hf" May 21 21:55:21.728243 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.728220 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/99895a9c-fb99-4199-8339-b7b04dbddddf-proc\") pod \"perf-node-gather-daemonset-lg6hf\" (UID: \"99895a9c-fb99-4199-8339-b7b04dbddddf\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-lg6hf" May 21 21:55:21.728309 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.728242 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/99895a9c-fb99-4199-8339-b7b04dbddddf-podres\") pod \"perf-node-gather-daemonset-lg6hf\" (UID: \"99895a9c-fb99-4199-8339-b7b04dbddddf\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-lg6hf" May 21 21:55:21.728309 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.728264 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99895a9c-fb99-4199-8339-b7b04dbddddf-sys\") pod \"perf-node-gather-daemonset-lg6hf\" (UID: \"99895a9c-fb99-4199-8339-b7b04dbddddf\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-lg6hf" May 21 21:55:21.728309 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.728295 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99895a9c-fb99-4199-8339-b7b04dbddddf-lib-modules\") pod \"perf-node-gather-daemonset-lg6hf\" (UID: \"99895a9c-fb99-4199-8339-b7b04dbddddf\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-lg6hf" May 21 21:55:21.728309 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.728295 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/99895a9c-fb99-4199-8339-b7b04dbddddf-proc\") pod \"perf-node-gather-daemonset-lg6hf\" (UID: \"99895a9c-fb99-4199-8339-b7b04dbddddf\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-lg6hf" May 21 21:55:21.728481 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.728371 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99895a9c-fb99-4199-8339-b7b04dbddddf-sys\") pod \"perf-node-gather-daemonset-lg6hf\" (UID: \"99895a9c-fb99-4199-8339-b7b04dbddddf\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-lg6hf" May 21 21:55:21.728481 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.728406 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/99895a9c-fb99-4199-8339-b7b04dbddddf-podres\") pod \"perf-node-gather-daemonset-lg6hf\" (UID: \"99895a9c-fb99-4199-8339-b7b04dbddddf\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-lg6hf" May 21 21:55:21.728481 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.728420 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99895a9c-fb99-4199-8339-b7b04dbddddf-lib-modules\") pod \"perf-node-gather-daemonset-lg6hf\" (UID: \"99895a9c-fb99-4199-8339-b7b04dbddddf\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-lg6hf" May 21 21:55:21.736529 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.736497 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqfwt\" (UniqueName: \"kubernetes.io/projected/99895a9c-fb99-4199-8339-b7b04dbddddf-kube-api-access-kqfwt\") pod \"perf-node-gather-daemonset-lg6hf\" (UID: \"99895a9c-fb99-4199-8339-b7b04dbddddf\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-lg6hf" May 21 21:55:21.882407 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:21.882312 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-lg6hf" May 21 21:55:22.011146 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:22.010973 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zzm8x/perf-node-gather-daemonset-lg6hf"] May 21 21:55:22.013704 ip-10-0-133-99 kubenswrapper[2572]: W0521 21:55:22.013663 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod99895a9c_fb99_4199_8339_b7b04dbddddf.slice/crio-2841232e300c1147e1a937f76f8cfbc6a8efa82023deda76dd32568c275203d2 WatchSource:0}: Error finding container 2841232e300c1147e1a937f76f8cfbc6a8efa82023deda76dd32568c275203d2: Status 404 returned error can't find the container with id 2841232e300c1147e1a937f76f8cfbc6a8efa82023deda76dd32568c275203d2 May 21 21:55:22.015632 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:22.015617 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 21:55:22.669176 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:22.669146 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-cjmvr_9a8b5d2d-43b7-4cf3-be4f-62b247e443e9/volume-data-source-validator/0.log" May 21 21:55:22.789888 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:22.789854 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-lg6hf" event={"ID":"99895a9c-fb99-4199-8339-b7b04dbddddf","Type":"ContainerStarted","Data":"ecc6c609b7d0b313d5d1888e08a283ac322a63588a494fb78e80358cd13eebaa"} May 21 21:55:22.789888 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:22.789894 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-lg6hf" event={"ID":"99895a9c-fb99-4199-8339-b7b04dbddddf","Type":"ContainerStarted","Data":"2841232e300c1147e1a937f76f8cfbc6a8efa82023deda76dd32568c275203d2"} May 21 21:55:22.790127 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:22.789914 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-lg6hf" May 21 21:55:22.809365 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:22.809318 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-lg6hf" podStartSLOduration=1.809300074 podStartE2EDuration="1.809300074s" podCreationTimestamp="2026-05-21 21:55:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:55:22.807490139 +0000 UTC m=+2058.629087559" watchObservedRunningTime="2026-05-21 21:55:22.809300074 +0000 UTC m=+2058.630897496" May 21 21:55:23.535181 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:23.535145 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2w7p5_01b78fa7-270f-479b-b579-915de407c411/dns/0.log" May 21 21:55:23.557121 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:23.557094 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2w7p5_01b78fa7-270f-479b-b579-915de407c411/kube-rbac-proxy/0.log" May 21 21:55:23.710635 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:23.710607 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rzckq_3d5474a2-32a3-4370-8e73-79b7ecbf4fd6/dns-node-resolver/0.log" May 21 21:55:24.233317 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:24.233287 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r8qsv_9262dc43-0cc0-4446-a8d4-570955a0442e/node-ca/0.log" May 21 21:55:25.204311 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:25.204279 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8bb597df6-8jbv6_c476a754-eeba-4d49-acbb-fbf9950428c0/kube-auth-proxy/0.log" May 21 21:55:25.365483 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:25.365449 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-94b86d8cb-4w4s6_435d78d6-e6b0-4569-8585-aa2990bdee1f/router/0.log" May 21 21:55:25.887339 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:25.887308 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8ltkf_56a356d3-0c79-4cff-8256-bc5aee2db13c/serve-healthcheck-canary/0.log" May 21 21:55:26.386347 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:26.386306 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-tns2g_330c5249-5f06-42ef-a15b-2a83a215bb8b/insights-operator/0.log" May 21 21:55:26.388507 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:26.388484 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-tns2g_330c5249-5f06-42ef-a15b-2a83a215bb8b/insights-operator/1.log" May 21 21:55:26.410739 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:26.410715 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9xfxl_90304d18-b4d5-4b43-9184-eef4a8a712f2/kube-rbac-proxy/0.log" May 21 21:55:26.430334 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:26.430303 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9xfxl_90304d18-b4d5-4b43-9184-eef4a8a712f2/exporter/0.log" May 21 21:55:26.451323 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:26.451290 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9xfxl_90304d18-b4d5-4b43-9184-eef4a8a712f2/extractor/0.log" May 21 21:55:28.585178 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:28.585146 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79646d69f8-7x8ks_69195729-25bf-4c33-8618-2a796a6e3976/manager/0.log" May 21 21:55:28.675868 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:28.675838 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-xjsx9_73d4b74c-0e43-4db4-a045-3570a341dcb1/postgres/0.log" May 21 21:55:28.804245 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:28.804212 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-lg6hf" May 21 21:55:29.960870 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:29.960840 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5c58594cc-ktjq4_b2755a1b-bd83-4aca-8f8a-50c5a3d02191/manager/0.log" May 21 21:55:30.016710 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:30.016646 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-ctv4m_dc7b5dd8-7853-4222-a02d-d441ba9cbbbf/openshift-lws-operator/0.log" May 21 21:55:35.762774 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:35.762744 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c2csm_6e5c7f2a-57a0-4291-974b-4414efc916e1/kube-multus-additional-cni-plugins/0.log" May 21 21:55:35.794197 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:35.794160 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c2csm_6e5c7f2a-57a0-4291-974b-4414efc916e1/egress-router-binary-copy/0.log" May 21 21:55:35.816184 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:35.816144 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c2csm_6e5c7f2a-57a0-4291-974b-4414efc916e1/cni-plugins/0.log" May 21 21:55:35.836041 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:35.836017 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c2csm_6e5c7f2a-57a0-4291-974b-4414efc916e1/bond-cni-plugin/0.log" May 21 21:55:35.856460 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:35.856437 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c2csm_6e5c7f2a-57a0-4291-974b-4414efc916e1/routeoverride-cni/0.log" May 21 21:55:35.874647 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:35.874629 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c2csm_6e5c7f2a-57a0-4291-974b-4414efc916e1/whereabouts-cni-bincopy/0.log" May 21 21:55:35.898576 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:35.898551 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c2csm_6e5c7f2a-57a0-4291-974b-4414efc916e1/whereabouts-cni/0.log" May 21 21:55:36.307869 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:36.307836 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dxvcp_8d31096e-e77f-4f67-a945-72f8f000b896/kube-multus/0.log" May 21 21:55:36.354759 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:36.354726 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f84fj_36b197d1-1cdf-47d2-9c86-c8b3e1dbe565/network-metrics-daemon/0.log" May 21 21:55:36.375191 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:36.375163 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f84fj_36b197d1-1cdf-47d2-9c86-c8b3e1dbe565/kube-rbac-proxy/0.log" May 21 21:55:37.286036 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:37.285927 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cs2zq_c8ddeadf-53c9-4198-8334-76cbdd1832c2/ovn-controller/0.log" May 21 21:55:37.300603 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:37.300574 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cs2zq_c8ddeadf-53c9-4198-8334-76cbdd1832c2/ovn-acl-logging/0.log" May 21 21:55:37.319149 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:37.319127 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cs2zq_c8ddeadf-53c9-4198-8334-76cbdd1832c2/ovn-acl-logging/1.log" May 21 21:55:37.343419 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:37.343380 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cs2zq_c8ddeadf-53c9-4198-8334-76cbdd1832c2/kube-rbac-proxy-node/0.log" May 21 21:55:37.362941 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:37.362916 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cs2zq_c8ddeadf-53c9-4198-8334-76cbdd1832c2/kube-rbac-proxy-ovn-metrics/0.log" May 21 21:55:37.378874 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:37.378856 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cs2zq_c8ddeadf-53c9-4198-8334-76cbdd1832c2/northd/0.log" May 21 21:55:37.397503 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:37.397480 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cs2zq_c8ddeadf-53c9-4198-8334-76cbdd1832c2/nbdb/0.log" May 21 21:55:37.415619 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:37.415595 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cs2zq_c8ddeadf-53c9-4198-8334-76cbdd1832c2/sbdb/0.log" May 21 21:55:37.569046 ip-10-0-133-99 kubenswrapper[2572]: I0521 21:55:37.568963 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cs2zq_c8ddeadf-53c9-4198-8334-76cbdd1832c2/ovnkube-controller/0.log"