May 21 16:11:34.569110 ip-10-0-139-146 systemd[1]: Starting Kubernetes Kubelet... May 21 16:11:35.056663 ip-10-0-139-146 kubenswrapper[2547]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 16:11:35.056663 ip-10-0-139-146 kubenswrapper[2547]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 16:11:35.056663 ip-10-0-139-146 kubenswrapper[2547]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 16:11:35.056663 ip-10-0-139-146 kubenswrapper[2547]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 16:11:35.056663 ip-10-0-139-146 kubenswrapper[2547]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 16:11:35.058428 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.058333 2547 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 16:11:35.064382 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064354 2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 16:11:35.064382 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064375 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 16:11:35.064382 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064379 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 16:11:35.064382 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064382 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 16:11:35.064382 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064385 2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 16:11:35.064382 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064390 2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 16:11:35.064382 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064393 2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 16:11:35.064636 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064395 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 16:11:35.064636 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064399 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 16:11:35.064636 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064402 2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 16:11:35.064636 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064404 2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 16:11:35.064636 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064407 2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 16:11:35.064636 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064410 2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 16:11:35.064636 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064413 2547 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 16:11:35.064636 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064416 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 16:11:35.064636 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064419 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 16:11:35.064636 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064422 2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 16:11:35.064636 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064425 2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 16:11:35.064636 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064433 2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 16:11:35.064636 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064437 2547 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 16:11:35.064636 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064439 2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 16:11:35.064636 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064442 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 16:11:35.064636 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064445 2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 16:11:35.064636 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064447 2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 16:11:35.064636 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064450 2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 16:11:35.064636 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064452 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 16:11:35.064636 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064455 2547 feature_gate.go:328] unrecognized feature gate: Example May 21 16:11:35.065125 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064458 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 16:11:35.065125 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064460 2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 16:11:35.065125 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064464 2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 16:11:35.065125 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064468 2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 16:11:35.065125 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064471 2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 16:11:35.065125 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064475 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 16:11:35.065125 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064477 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 16:11:35.065125 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064480 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 16:11:35.065125 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064483 2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 16:11:35.065125 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064486 2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 16:11:35.065125 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064489 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 16:11:35.065125 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064492 2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 16:11:35.065125 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064495 2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 16:11:35.065125 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064499 2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 16:11:35.065125 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064502 2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 16:11:35.065125 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064505 2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 16:11:35.065125 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064508 2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 16:11:35.065125 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064511 2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 16:11:35.065125 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064516 2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 16:11:35.065624 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064518 2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 16:11:35.065624 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064522 2547 feature_gate.go:328] unrecognized feature gate: Example2 May 21 16:11:35.065624 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064524 2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 16:11:35.065624 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064527 2547 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 16:11:35.065624 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064530 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 16:11:35.065624 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064534 2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 16:11:35.065624 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064538 2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 16:11:35.065624 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064541 2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 16:11:35.065624 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064544 2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 16:11:35.065624 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064546 2547 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 16:11:35.065624 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064549 2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 16:11:35.065624 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064552 2547 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 16:11:35.065624 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064555 2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 16:11:35.065624 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064558 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 16:11:35.065624 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064561 2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 16:11:35.065624 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064563 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 16:11:35.065624 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064566 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 16:11:35.065624 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064568 2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 16:11:35.065624 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064571 2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 16:11:35.066105 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064574 2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 16:11:35.066105 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064576 2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 16:11:35.066105 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064579 2547 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 16:11:35.066105 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064581 2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 16:11:35.066105 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064584 2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 16:11:35.066105 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064586 2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 16:11:35.066105 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064589 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 16:11:35.066105 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064600 2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 16:11:35.066105 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064603 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 16:11:35.066105 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064606 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 16:11:35.066105 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064609 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 16:11:35.066105 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064611 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 16:11:35.066105 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064615 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 16:11:35.066105 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064618 2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 16:11:35.066105 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064621 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 16:11:35.066105 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064624 2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 16:11:35.066105 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064626 2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 16:11:35.066105 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064629 2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 16:11:35.066105 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064631 2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 16:11:35.066105 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064634 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 16:11:35.066580 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.064637 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 16:11:35.066580 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065077 2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 16:11:35.066580 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065083 2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 16:11:35.066580 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065086 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 16:11:35.066580 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065089 2547 feature_gate.go:328] unrecognized feature gate: Example2 May 21 16:11:35.066580 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065091 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 16:11:35.066580 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065094 2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 16:11:35.066580 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065097 2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 16:11:35.066580 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065100 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 16:11:35.066580 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065102 2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 16:11:35.066580 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065105 2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 16:11:35.066580 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065107 2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 16:11:35.066580 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065110 2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 16:11:35.066580 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065113 2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 16:11:35.066580 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065115 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 16:11:35.066580 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065118 2547 feature_gate.go:328] unrecognized feature gate: Example May 21 16:11:35.066580 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065120 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 16:11:35.066580 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065123 2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 16:11:35.066580 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065126 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 16:11:35.066580 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065130 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 16:11:35.067075 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065133 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 16:11:35.067075 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065136 2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 16:11:35.067075 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065139 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 16:11:35.067075 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065141 2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 16:11:35.067075 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065144 2547 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 16:11:35.067075 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065146 2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 16:11:35.067075 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065149 2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 16:11:35.067075 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065151 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 16:11:35.067075 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065154 2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 16:11:35.067075 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065156 2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 16:11:35.067075 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065159 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 16:11:35.067075 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065162 2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 16:11:35.067075 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065164 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 16:11:35.067075 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065167 2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 16:11:35.067075 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065169 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 16:11:35.067075 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065172 2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 16:11:35.067075 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065174 2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 16:11:35.067075 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065176 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 16:11:35.067075 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065179 2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 16:11:35.067075 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065181 2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 16:11:35.067570 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065184 2547 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 16:11:35.067570 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065186 2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 16:11:35.067570 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065189 2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 16:11:35.067570 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065191 2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 16:11:35.067570 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065194 2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 16:11:35.067570 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065196 2547 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 16:11:35.067570 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065199 2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 16:11:35.067570 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065201 2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 16:11:35.067570 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065204 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 16:11:35.067570 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065206 2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 16:11:35.067570 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065209 2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 16:11:35.067570 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065213 2547 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 16:11:35.067570 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065216 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 16:11:35.067570 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065219 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 16:11:35.067570 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065221 2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 16:11:35.067570 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065224 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 16:11:35.067570 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065226 2547 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 16:11:35.067570 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065229 2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 16:11:35.067570 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065232 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 16:11:35.067570 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065235 2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 16:11:35.068111 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065239 2547 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 16:11:35.068111 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065242 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 16:11:35.068111 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065245 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 16:11:35.068111 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065247 2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 16:11:35.068111 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065251 2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 16:11:35.068111 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065253 2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 16:11:35.068111 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065256 2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 16:11:35.068111 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065258 2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 16:11:35.068111 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065261 2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 16:11:35.068111 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065263 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 16:11:35.068111 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065266 2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 16:11:35.068111 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065268 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 16:11:35.068111 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065271 2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 16:11:35.068111 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065274 2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 16:11:35.068111 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065276 2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 16:11:35.068111 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065279 2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 16:11:35.068111 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065281 2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 16:11:35.068111 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065284 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 16:11:35.068111 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065286 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 16:11:35.068111 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065289 2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 16:11:35.068612 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065292 2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 16:11:35.068612 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065297 2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 16:11:35.068612 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065300 2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 16:11:35.068612 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065305 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 16:11:35.068612 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065308 2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 16:11:35.068612 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065312 2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 16:11:35.068612 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.065314 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 16:11:35.068612 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066445 2547 flags.go:64] FLAG: --address="0.0.0.0" May 21 16:11:35.068612 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066460 2547 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 16:11:35.068612 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066467 2547 flags.go:64] FLAG: --anonymous-auth="true" May 21 16:11:35.068612 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066471 2547 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 16:11:35.068612 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066477 2547 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 16:11:35.068612 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066480 2547 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 16:11:35.068612 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066485 2547 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 16:11:35.068612 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066489 2547 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 16:11:35.068612 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066493 2547 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 16:11:35.068612 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066497 2547 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 16:11:35.068612 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066500 2547 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 16:11:35.068612 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066504 2547 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 16:11:35.068612 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066507 2547 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 16:11:35.068612 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066510 2547 flags.go:64] FLAG: --cgroup-root="" May 21 16:11:35.069147 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066513 2547 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 16:11:35.069147 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066516 2547 flags.go:64] FLAG: --client-ca-file="" May 21 16:11:35.069147 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066519 2547 flags.go:64] FLAG: --cloud-config="" May 21 16:11:35.069147 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066523 2547 flags.go:64] FLAG: --cloud-provider="external" May 21 16:11:35.069147 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066525 2547 flags.go:64] FLAG: --cluster-dns="[]" May 21 16:11:35.069147 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066531 2547 flags.go:64] FLAG: --cluster-domain="" May 21 16:11:35.069147 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066534 2547 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 16:11:35.069147 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066538 2547 flags.go:64] FLAG: --config-dir="" May 21 16:11:35.069147 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066541 2547 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 16:11:35.069147 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066544 2547 flags.go:64] FLAG: --container-log-max-files="5" May 21 16:11:35.069147 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066548 2547 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 16:11:35.069147 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066552 2547 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 16:11:35.069147 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066555 2547 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 16:11:35.069147 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066558 2547 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 16:11:35.069147 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066562 2547 flags.go:64] FLAG: --contention-profiling="false" May 21 16:11:35.069147 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066565 2547 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 16:11:35.069147 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066568 2547 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 16:11:35.069147 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066572 2547 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 16:11:35.069147 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066576 2547 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 16:11:35.069147 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066581 2547 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 16:11:35.069147 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066584 2547 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 16:11:35.069147 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066587 2547 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 16:11:35.069147 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066590 2547 flags.go:64] FLAG: --enable-load-reader="false" May 21 16:11:35.069147 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066594 2547 flags.go:64] FLAG: --enable-server="true" May 21 16:11:35.069147 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066597 2547 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 16:11:35.069732 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066602 2547 flags.go:64] FLAG: --event-burst="100" May 21 16:11:35.069732 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066605 2547 flags.go:64] FLAG: --event-qps="50" May 21 16:11:35.069732 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066608 2547 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 16:11:35.069732 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066611 2547 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 16:11:35.069732 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066615 2547 flags.go:64] FLAG: --eviction-hard="" May 21 16:11:35.069732 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066619 2547 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 16:11:35.069732 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066622 2547 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 16:11:35.069732 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066625 2547 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 16:11:35.069732 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066628 2547 flags.go:64] FLAG: --eviction-soft="" May 21 16:11:35.069732 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066631 2547 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 16:11:35.069732 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066634 2547 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 16:11:35.069732 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066637 2547 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 16:11:35.069732 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066641 2547 flags.go:64] FLAG: --experimental-mounter-path="" May 21 16:11:35.069732 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066644 2547 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 16:11:35.069732 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066647 2547 flags.go:64] FLAG: --fail-swap-on="true" May 21 16:11:35.069732 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066650 2547 flags.go:64] FLAG: --feature-gates="" May 21 16:11:35.069732 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066654 2547 flags.go:64] FLAG: --file-check-frequency="20s" May 21 16:11:35.069732 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066657 2547 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 16:11:35.069732 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066660 2547 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 16:11:35.069732 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066663 2547 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 16:11:35.069732 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066667 2547 flags.go:64] FLAG: --healthz-port="10248" May 21 16:11:35.069732 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066671 2547 flags.go:64] FLAG: --help="false" May 21 16:11:35.069732 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066674 2547 flags.go:64] FLAG: --hostname-override="ip-10-0-139-146.ec2.internal" May 21 16:11:35.069732 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066678 2547 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 16:11:35.069732 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066681 2547 flags.go:64] FLAG: --http-check-frequency="20s" May 21 16:11:35.070347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066685 2547 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 16:11:35.070347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066688 2547 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 16:11:35.070347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066692 2547 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 16:11:35.070347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066695 2547 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 16:11:35.070347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066698 2547 flags.go:64] FLAG: --image-service-endpoint="" May 21 16:11:35.070347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066701 2547 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 16:11:35.070347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066704 2547 flags.go:64] FLAG: --kube-api-burst="100" May 21 16:11:35.070347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066707 2547 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 16:11:35.070347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066711 2547 flags.go:64] FLAG: --kube-api-qps="50" May 21 16:11:35.070347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066713 2547 flags.go:64] FLAG: --kube-reserved="" May 21 16:11:35.070347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066717 2547 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 16:11:35.070347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066720 2547 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 16:11:35.070347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066723 2547 flags.go:64] FLAG: --kubelet-cgroups="" May 21 16:11:35.070347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066726 2547 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 16:11:35.070347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066729 2547 flags.go:64] FLAG: --lock-file="" May 21 16:11:35.070347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066732 2547 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 16:11:35.070347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066735 2547 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 16:11:35.070347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066738 2547 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 16:11:35.070347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066744 2547 flags.go:64] FLAG: --log-json-split-stream="false" May 21 16:11:35.070347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066747 2547 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 16:11:35.070347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066750 2547 flags.go:64] FLAG: --log-text-split-stream="false" May 21 16:11:35.070347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066753 2547 flags.go:64] FLAG: --logging-format="text" May 21 16:11:35.070347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066755 2547 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 16:11:35.070927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066759 2547 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 16:11:35.070927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066762 2547 flags.go:64] FLAG: --manifest-url="" May 21 16:11:35.070927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066765 2547 flags.go:64] FLAG: --manifest-url-header="" May 21 16:11:35.070927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066769 2547 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 16:11:35.070927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066772 2547 flags.go:64] FLAG: --max-open-files="1000000" May 21 16:11:35.070927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066777 2547 flags.go:64] FLAG: --max-pods="110" May 21 16:11:35.070927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066781 2547 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 16:11:35.070927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066784 2547 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 16:11:35.070927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066787 2547 flags.go:64] FLAG: --memory-manager-policy="None" May 21 16:11:35.070927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066790 2547 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 16:11:35.070927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066796 2547 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 16:11:35.070927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066800 2547 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 16:11:35.070927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066804 2547 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 16:11:35.070927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066812 2547 flags.go:64] FLAG: --node-status-max-images="50" May 21 16:11:35.070927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066828 2547 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 16:11:35.070927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066831 2547 flags.go:64] FLAG: --oom-score-adj="-999" May 21 16:11:35.070927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066835 2547 flags.go:64] FLAG: --pod-cidr="" May 21 16:11:35.070927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066838 2547 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 16:11:35.070927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066845 2547 flags.go:64] FLAG: --pod-manifest-path="" May 21 16:11:35.070927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066847 2547 flags.go:64] FLAG: --pod-max-pids="-1" May 21 16:11:35.070927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066851 2547 flags.go:64] FLAG: --pods-per-core="0" May 21 16:11:35.070927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066854 2547 flags.go:64] FLAG: --port="10250" May 21 16:11:35.070927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066857 2547 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 16:11:35.070927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066860 2547 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-004a9c63ca89b4b9a" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066863 2547 flags.go:64] FLAG: --qos-reserved="" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066867 2547 flags.go:64] FLAG: --read-only-port="10255" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066869 2547 flags.go:64] FLAG: --register-node="true" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066872 2547 flags.go:64] FLAG: --register-schedulable="true" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066875 2547 flags.go:64] FLAG: --register-with-taints="" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066879 2547 flags.go:64] FLAG: --registry-burst="10" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066882 2547 flags.go:64] FLAG: --registry-qps="5" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066885 2547 flags.go:64] FLAG: --reserved-cpus="" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066888 2547 flags.go:64] FLAG: --reserved-memory="" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066892 2547 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066895 2547 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066898 2547 flags.go:64] FLAG: --rotate-certificates="false" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066901 2547 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066904 2547 flags.go:64] FLAG: --runonce="false" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066907 2547 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066910 2547 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066913 2547 flags.go:64] FLAG: --seccomp-default="false" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066916 2547 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066919 2547 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066923 2547 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066926 2547 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066929 2547 flags.go:64] FLAG: --storage-driver-password="root" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066932 2547 flags.go:64] FLAG: --storage-driver-secure="false" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066935 2547 flags.go:64] FLAG: --storage-driver-table="stats" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066938 2547 flags.go:64] FLAG: --storage-driver-user="root" May 21 16:11:35.071502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066941 2547 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 16:11:35.072163 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066944 2547 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 16:11:35.072163 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066947 2547 flags.go:64] FLAG: --system-cgroups="" May 21 16:11:35.072163 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066950 2547 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 16:11:35.072163 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066956 2547 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 16:11:35.072163 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066958 2547 flags.go:64] FLAG: --tls-cert-file="" May 21 16:11:35.072163 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066961 2547 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 16:11:35.072163 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066966 2547 flags.go:64] FLAG: --tls-min-version="" May 21 16:11:35.072163 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066969 2547 flags.go:64] FLAG: --tls-private-key-file="" May 21 16:11:35.072163 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066972 2547 flags.go:64] FLAG: --topology-manager-policy="none" May 21 16:11:35.072163 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066975 2547 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 16:11:35.072163 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066977 2547 flags.go:64] FLAG: --topology-manager-scope="container" May 21 16:11:35.072163 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066981 2547 flags.go:64] FLAG: --v="2" May 21 16:11:35.072163 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066985 2547 flags.go:64] FLAG: --version="false" May 21 16:11:35.072163 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066990 2547 flags.go:64] FLAG: --vmodule="" May 21 16:11:35.072163 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.066997 2547 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 16:11:35.072163 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.067000 2547 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 16:11:35.072163 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067116 2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 16:11:35.072163 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067120 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 16:11:35.072163 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067123 2547 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 16:11:35.072163 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067126 2547 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 16:11:35.072163 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067129 2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 16:11:35.072163 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067132 2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 16:11:35.072163 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067134 2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 16:11:35.072163 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067137 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 16:11:35.072735 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067140 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 16:11:35.072735 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067142 2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 16:11:35.072735 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067146 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 16:11:35.072735 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067149 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 16:11:35.072735 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067151 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 16:11:35.072735 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067154 2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 16:11:35.072735 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067159 2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 16:11:35.072735 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067162 2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 16:11:35.072735 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067165 2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 16:11:35.072735 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067167 2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 16:11:35.072735 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067170 2547 feature_gate.go:328] unrecognized feature gate: Example2 May 21 16:11:35.072735 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067173 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 16:11:35.072735 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067175 2547 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 16:11:35.072735 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067178 2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 16:11:35.072735 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067181 2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 16:11:35.072735 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067183 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 16:11:35.072735 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067186 2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 16:11:35.072735 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067188 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 16:11:35.072735 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067191 2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 16:11:35.073309 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067193 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 16:11:35.073309 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067196 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 16:11:35.073309 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067198 2547 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 16:11:35.073309 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067201 2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 16:11:35.073309 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067203 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 16:11:35.073309 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067206 2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 16:11:35.073309 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067208 2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 16:11:35.073309 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067210 2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 16:11:35.073309 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067213 2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 16:11:35.073309 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067216 2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 16:11:35.073309 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067219 2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 16:11:35.073309 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067221 2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 16:11:35.073309 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067224 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 16:11:35.073309 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067227 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 16:11:35.073309 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067229 2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 16:11:35.073309 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067232 2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 16:11:35.073309 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067235 2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 16:11:35.073309 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067238 2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 16:11:35.073309 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067240 2547 feature_gate.go:328] unrecognized feature gate: Example May 21 16:11:35.073309 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067243 2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 16:11:35.074209 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067246 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 16:11:35.074209 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067248 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 16:11:35.074209 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067250 2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 16:11:35.074209 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067253 2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 16:11:35.074209 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067256 2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 16:11:35.074209 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067258 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 16:11:35.074209 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067262 2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 16:11:35.074209 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067265 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 16:11:35.074209 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067268 2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 16:11:35.074209 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067271 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 16:11:35.074209 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067274 2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 16:11:35.074209 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067278 2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 16:11:35.074209 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067281 2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 16:11:35.074209 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067283 2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 16:11:35.074209 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067286 2547 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 16:11:35.074209 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067289 2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 16:11:35.074209 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067291 2547 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 16:11:35.074209 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067294 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 16:11:35.074209 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067296 2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 16:11:35.075071 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067299 2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 16:11:35.075071 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067302 2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 16:11:35.075071 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067304 2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 16:11:35.075071 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067307 2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 16:11:35.075071 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067309 2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 16:11:35.075071 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067312 2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 16:11:35.075071 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067315 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 16:11:35.075071 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067317 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 16:11:35.075071 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067322 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 16:11:35.075071 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067325 2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 16:11:35.075071 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067328 2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 16:11:35.075071 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067331 2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 16:11:35.075071 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067334 2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 16:11:35.075071 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067337 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 16:11:35.075071 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067339 2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 16:11:35.075071 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067342 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 16:11:35.075071 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067344 2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 16:11:35.075071 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067347 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 16:11:35.075071 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067350 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 16:11:35.075071 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.067352 2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 16:11:35.075959 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.067995 2547 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 16:11:35.075959 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.075314 2547 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 16:11:35.075959 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.075338 2547 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 16:11:35.075959 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075411 2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 16:11:35.075959 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075419 2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 16:11:35.075959 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075425 2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 16:11:35.075959 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075430 2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 16:11:35.075959 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075435 2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 16:11:35.075959 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075441 2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 16:11:35.075959 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075445 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 16:11:35.075959 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075450 2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 16:11:35.075959 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075455 2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 16:11:35.075959 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075459 2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 16:11:35.075959 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075464 2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 16:11:35.075959 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075468 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 16:11:35.076621 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075472 2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 16:11:35.076621 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075477 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 16:11:35.076621 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075482 2547 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 16:11:35.076621 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075487 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 16:11:35.076621 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075492 2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 16:11:35.076621 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075496 2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 16:11:35.076621 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075501 2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 16:11:35.076621 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075506 2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 16:11:35.076621 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075511 2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 16:11:35.076621 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075515 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 16:11:35.076621 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075520 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 16:11:35.076621 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075524 2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 16:11:35.076621 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075529 2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 16:11:35.076621 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075533 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 16:11:35.076621 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075538 2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 16:11:35.076621 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075542 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 16:11:35.076621 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075546 2547 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 16:11:35.076621 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075551 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 16:11:35.076621 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075556 2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 16:11:35.076621 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075563 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 16:11:35.077207 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075568 2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 16:11:35.077207 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075572 2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 16:11:35.077207 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075577 2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 16:11:35.077207 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075582 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 16:11:35.077207 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075586 2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 16:11:35.077207 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075591 2547 feature_gate.go:328] unrecognized feature gate: Example May 21 16:11:35.077207 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075596 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 16:11:35.077207 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075600 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 16:11:35.077207 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075604 2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 16:11:35.077207 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075609 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 16:11:35.077207 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075614 2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 16:11:35.077207 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075620 2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 16:11:35.077207 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075628 2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 16:11:35.077207 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075633 2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 16:11:35.077207 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075637 2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 16:11:35.077207 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075642 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 16:11:35.077207 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075646 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 16:11:35.077207 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075651 2547 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 16:11:35.077207 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075656 2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 16:11:35.077207 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075660 2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 16:11:35.077786 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075665 2547 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 16:11:35.077786 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075669 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 16:11:35.077786 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075674 2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 16:11:35.077786 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075679 2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 16:11:35.077786 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075683 2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 16:11:35.077786 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075688 2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 16:11:35.077786 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075692 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 16:11:35.077786 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075697 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 16:11:35.077786 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075701 2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 16:11:35.077786 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075706 2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 16:11:35.077786 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075711 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 16:11:35.077786 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075716 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 16:11:35.077786 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075722 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 16:11:35.077786 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075727 2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 16:11:35.077786 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075731 2547 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 16:11:35.077786 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075736 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 16:11:35.077786 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075740 2547 feature_gate.go:328] unrecognized feature gate: Example2 May 21 16:11:35.077786 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075745 2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 16:11:35.077786 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075750 2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 16:11:35.077786 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075754 2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 16:11:35.078520 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075759 2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 16:11:35.078520 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075763 2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 16:11:35.078520 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075770 2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 16:11:35.078520 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075779 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 16:11:35.078520 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075784 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 16:11:35.078520 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075789 2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 16:11:35.078520 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075794 2547 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 16:11:35.078520 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075799 2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 16:11:35.078520 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075803 2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 16:11:35.078520 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075808 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 16:11:35.078520 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075833 2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 16:11:35.078520 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075839 2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 16:11:35.078520 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075843 2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 16:11:35.078520 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.075848 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 16:11:35.078520 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.075857 2547 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 16:11:35.079235 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076028 2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 16:11:35.079235 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076038 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 16:11:35.079235 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076043 2547 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 16:11:35.079235 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076048 2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 16:11:35.079235 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076054 2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 16:11:35.079235 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076059 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 16:11:35.079235 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076063 2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 16:11:35.079235 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076068 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 16:11:35.079235 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076072 2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 16:11:35.079235 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076077 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 16:11:35.079235 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076083 2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 16:11:35.079235 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076090 2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 16:11:35.079235 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076098 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 16:11:35.079235 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076103 2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 16:11:35.079235 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076108 2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 16:11:35.079235 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076112 2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 16:11:35.079235 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076117 2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 16:11:35.079235 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076121 2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 16:11:35.079235 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076126 2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 16:11:35.079875 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076130 2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 16:11:35.079875 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076135 2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 16:11:35.079875 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076140 2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 16:11:35.079875 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076145 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 16:11:35.079875 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076156 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 16:11:35.079875 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076161 2547 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 16:11:35.079875 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076166 2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 16:11:35.079875 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076171 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 16:11:35.079875 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076176 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 16:11:35.079875 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076180 2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 16:11:35.079875 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076185 2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 16:11:35.079875 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076190 2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 16:11:35.079875 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076195 2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 16:11:35.079875 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076199 2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 16:11:35.079875 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076204 2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 16:11:35.079875 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076208 2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 16:11:35.079875 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076213 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 16:11:35.079875 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076218 2547 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 16:11:35.079875 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076223 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 16:11:35.079875 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076228 2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 16:11:35.080488 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076232 2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 16:11:35.080488 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076237 2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 16:11:35.080488 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076241 2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 16:11:35.080488 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076246 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 16:11:35.080488 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076261 2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 16:11:35.080488 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076266 2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 16:11:35.080488 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076271 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 16:11:35.080488 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076276 2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 16:11:35.080488 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076281 2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 16:11:35.080488 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076285 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 16:11:35.080488 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076289 2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 16:11:35.080488 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076294 2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 16:11:35.080488 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076298 2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 16:11:35.080488 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076302 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 16:11:35.080488 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076307 2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 16:11:35.080488 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076312 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 16:11:35.080488 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076316 2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 16:11:35.080488 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076321 2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 16:11:35.080488 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076325 2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 16:11:35.081068 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076329 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 16:11:35.081068 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076334 2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 16:11:35.081068 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076338 2547 feature_gate.go:328] unrecognized feature gate: Example May 21 16:11:35.081068 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076343 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 16:11:35.081068 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076347 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 16:11:35.081068 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076352 2547 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 16:11:35.081068 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076356 2547 feature_gate.go:328] unrecognized feature gate: Example2 May 21 16:11:35.081068 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076361 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 16:11:35.081068 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076367 2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 16:11:35.081068 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076373 2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 16:11:35.081068 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076378 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 16:11:35.081068 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076382 2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 16:11:35.081068 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076387 2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 16:11:35.081068 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076392 2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 16:11:35.081068 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076396 2547 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 16:11:35.081068 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076403 2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 16:11:35.081068 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076408 2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 16:11:35.081068 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076412 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 16:11:35.081068 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076418 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 16:11:35.081587 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076423 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 16:11:35.081587 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076427 2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 16:11:35.081587 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076432 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 16:11:35.081587 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076436 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 16:11:35.081587 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076441 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 16:11:35.081587 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076445 2547 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 16:11:35.081587 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076450 2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 16:11:35.081587 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076454 2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 16:11:35.081587 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:35.076458 2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 16:11:35.081587 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.076466 2547 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 16:11:35.081587 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.077356 2547 server.go:962] "Client rotation is on, will bootstrap in background" May 21 16:11:35.081587 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.080283 2547 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 16:11:35.081587 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.081386 2547 server.go:1019] "Starting client certificate rotation" May 21 16:11:35.081587 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.081491 2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 16:11:35.082385 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.082373 2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 16:11:35.112295 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.112268 2547 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 16:11:35.114174 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.114155 2547 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 16:11:35.133582 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.133556 2547 log.go:25] "Validated CRI v1 runtime API" May 21 16:11:35.140640 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.140621 2547 log.go:25] "Validated CRI v1 image API" May 21 16:11:35.141941 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.141912 2547 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 16:11:35.144472 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.144449 2547 fs.go:135] Filesystem UUIDs: map[6a2f1f30-437e-421a-a01e-515d2d3bf3e5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 88cbc58c-34d0-423a-8079-f87af60e6226:/dev/nvme0n1p3] May 21 16:11:35.144543 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.144471 2547 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 16:11:35.147435 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.147410 2547 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 16:11:35.149439 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.149324 2547 manager.go:217] Machine: {Timestamp:2026-05-21 16:11:35.148804011 +0000 UTC m=+0.447524902 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098653 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2762a042c5cee6cf2d1321d6790a03 SystemUUID:ec2762a0-42c5-cee6-cf2d-1321d6790a03 BootID:4ebc02da-4b98-4ca7-a896-06ac85806513 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a3:0d:fa:eb:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a3:0d:fa:eb:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:30:4d:ee:5d:66 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 16:11:35.150127 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.150114 2547 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 16:11:35.150263 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.150249 2547 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 16:11:35.153788 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.153761 2547 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 16:11:35.153976 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.153792 2547 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-146.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 16:11:35.154030 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.153986 2547 topology_manager.go:138] "Creating topology manager with none policy" May 21 16:11:35.154030 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.153995 2547 container_manager_linux.go:306] "Creating device plugin manager" May 21 16:11:35.154030 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.154006 2547 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 16:11:35.155807 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.155797 2547 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 16:11:35.157007 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.156995 2547 state_mem.go:36] "Initialized new in-memory state store" May 21 16:11:35.157296 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.157286 2547 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 16:11:35.159900 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.159889 2547 kubelet.go:491] "Attempting to sync node with API server" May 21 16:11:35.159939 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.159905 2547 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 16:11:35.159939 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.159919 2547 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 16:11:35.159939 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.159928 2547 kubelet.go:397] "Adding apiserver pod source" May 21 16:11:35.159939 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.159937 2547 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 16:11:35.161118 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.161103 2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 16:11:35.161196 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.161124 2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 16:11:35.164937 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.164922 2547 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 16:11:35.167235 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.167221 2547 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 16:11:35.168798 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.168781 2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 16:11:35.168798 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.168800 2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 16:11:35.168921 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.168806 2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 16:11:35.168921 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.168812 2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 16:11:35.168921 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.168837 2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 16:11:35.168921 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.168844 2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 16:11:35.168921 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.168850 2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 16:11:35.168921 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.168855 2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 16:11:35.168921 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.168862 2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 16:11:35.168921 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.168868 2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 16:11:35.168921 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.168876 2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 16:11:35.168921 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.168882 2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 16:11:35.169259 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.169125 2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9tz62" May 21 16:11:35.169783 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.169773 2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 16:11:35.169830 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.169796 2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 16:11:35.171904 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:35.171845 2547 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 16:11:35.172002 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:35.171955 2547 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 16:11:35.173262 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.173241 2547 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-146.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 16:11:35.174850 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.174813 2547 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 16:11:35.174908 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.174886 2547 server.go:1295] "Started kubelet" May 21 16:11:35.175247 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.174966 2547 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 16:11:35.175356 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.175214 2547 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 16:11:35.175356 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.175289 2547 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 16:11:35.175650 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.175530 2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9tz62" May 21 16:11:35.175706 ip-10-0-139-146 systemd[1]: Started Kubernetes Kubelet. May 21 16:11:35.177165 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.177150 2547 server.go:317] "Adding debug handlers to kubelet server" May 21 16:11:35.177303 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.177289 2547 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 16:11:35.184195 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.184165 2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 16:11:35.184857 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.184840 2547 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 16:11:35.184977 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.184956 2547 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 16:11:35.184977 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.184977 2547 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 16:11:35.185133 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.185084 2547 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 16:11:35.185133 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.185123 2547 reconstruct.go:97] "Volume reconstruction finished" May 21 16:11:35.185133 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.185131 2547 reconciler.go:26] "Reconciler: start to sync state" May 21 16:11:35.185279 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:35.185132 2547 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 16:11:35.185659 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.185639 2547 factory.go:55] Registering systemd factory May 21 16:11:35.185659 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.185657 2547 factory.go:223] Registration of the systemd container factory successfully May 21 16:11:35.185765 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:35.185719 2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-146.ec2.internal\" not found" May 21 16:11:35.185923 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.185904 2547 factory.go:153] Registering CRI-O factory May 21 16:11:35.185978 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.185926 2547 factory.go:223] Registration of the crio container factory successfully May 21 16:11:35.186050 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.186038 2547 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 16:11:35.186089 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.186061 2547 factory.go:103] Registering Raw factory May 21 16:11:35.186089 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.186078 2547 manager.go:1196] Started watching for new ooms in manager May 21 16:11:35.187072 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.187046 2547 manager.go:319] Starting recovery of all containers May 21 16:11:35.188293 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.188274 2547 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 16:11:35.190844 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:35.190805 2547 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-146.ec2.internal\" not found" node="ip-10-0-139-146.ec2.internal" May 21 16:11:35.197287 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.197269 2547 manager.go:324] Recovery completed May 21 16:11:35.203016 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.203001 2547 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 16:11:35.205329 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.205312 2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientMemory" May 21 16:11:35.205400 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.205340 2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasNoDiskPressure" May 21 16:11:35.205400 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.205350 2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientPID" May 21 16:11:35.205873 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.205853 2547 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 16:11:35.205873 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.205869 2547 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 16:11:35.205985 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.205890 2547 state_mem.go:36] "Initialized new in-memory state store" May 21 16:11:35.208982 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.208967 2547 policy_none.go:49] "None policy: Start" May 21 16:11:35.209054 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.208985 2547 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 16:11:35.209054 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.208996 2547 state_mem.go:35] "Initializing new in-memory state store" May 21 16:11:35.252575 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.250482 2547 manager.go:341] "Starting Device Plugin manager" May 21 16:11:35.252575 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:35.250569 2547 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 16:11:35.252575 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.250583 2547 server.go:85] "Starting device plugin registration server" May 21 16:11:35.252575 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.250876 2547 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 16:11:35.252575 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.250890 2547 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 16:11:35.252575 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.251006 2547 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 16:11:35.252575 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.251076 2547 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 16:11:35.252575 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.251084 2547 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 16:11:35.252575 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:35.251626 2547 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 16:11:35.252575 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:35.251658 2547 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-146.ec2.internal\" not found" May 21 16:11:35.325631 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.325548 2547 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 16:11:35.326799 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.326781 2547 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 16:11:35.326882 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.326809 2547 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 16:11:35.326882 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.326852 2547 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 16:11:35.326882 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.326863 2547 kubelet.go:2451] "Starting kubelet main sync loop" May 21 16:11:35.327006 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:35.326912 2547 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 16:11:35.330242 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.330221 2547 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 16:11:35.351135 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.351100 2547 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 16:11:35.352296 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.352280 2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientMemory" May 21 16:11:35.352379 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.352311 2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasNoDiskPressure" May 21 16:11:35.352379 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.352326 2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientPID" May 21 16:11:35.352379 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.352350 2547 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-146.ec2.internal" May 21 16:11:35.361499 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.361481 2547 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-146.ec2.internal" May 21 16:11:35.361566 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:35.361504 2547 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-146.ec2.internal\": node \"ip-10-0-139-146.ec2.internal\" not found" May 21 16:11:35.379474 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:35.379453 2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-146.ec2.internal\" not found" May 21 16:11:35.427724 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.427689 2547 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-146.ec2.internal"] May 21 16:11:35.427875 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.427791 2547 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 16:11:35.429535 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.429519 2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientMemory" May 21 16:11:35.429618 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.429548 2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasNoDiskPressure" May 21 16:11:35.429618 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.429559 2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientPID" May 21 16:11:35.430827 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.430805 2547 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 16:11:35.431023 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.431009 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" May 21 16:11:35.431078 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.431038 2547 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 16:11:35.431629 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.431613 2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientMemory" May 21 16:11:35.431706 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.431632 2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientMemory" May 21 16:11:35.431706 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.431643 2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasNoDiskPressure" May 21 16:11:35.431706 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.431653 2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasNoDiskPressure" May 21 16:11:35.431706 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.431657 2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientPID" May 21 16:11:35.431706 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.431668 2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientPID" May 21 16:11:35.433158 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.433140 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-146.ec2.internal" May 21 16:11:35.433246 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.433169 2547 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 16:11:35.433793 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.433773 2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientMemory" May 21 16:11:35.433902 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.433798 2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasNoDiskPressure" May 21 16:11:35.433902 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.433811 2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientPID" May 21 16:11:35.457520 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:35.457501 2547 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-146.ec2.internal\" not found" node="ip-10-0-139-146.ec2.internal" May 21 16:11:35.462153 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:35.462135 2547 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-146.ec2.internal\" not found" node="ip-10-0-139-146.ec2.internal" May 21 16:11:35.479896 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:35.479872 2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-146.ec2.internal\" not found" May 21 16:11:35.580409 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:35.580338 2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-146.ec2.internal\" not found" May 21 16:11:35.586662 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.586641 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b349e1c779f1a186fb69a81f163bcb5d-config\") pod \"kube-apiserver-proxy-ip-10-0-139-146.ec2.internal\" (UID: \"b349e1c779f1a186fb69a81f163bcb5d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-146.ec2.internal" May 21 16:11:35.586737 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.586669 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90cb0b447697e0200b30615533e10b53-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal\" (UID: \"90cb0b447697e0200b30615533e10b53\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" May 21 16:11:35.586737 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.586687 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90cb0b447697e0200b30615533e10b53-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal\" (UID: \"90cb0b447697e0200b30615533e10b53\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" May 21 16:11:35.681102 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:35.681061 2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-146.ec2.internal\" not found" May 21 16:11:35.687358 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.687328 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b349e1c779f1a186fb69a81f163bcb5d-config\") pod \"kube-apiserver-proxy-ip-10-0-139-146.ec2.internal\" (UID: \"b349e1c779f1a186fb69a81f163bcb5d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-146.ec2.internal" May 21 16:11:35.687358 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.687359 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90cb0b447697e0200b30615533e10b53-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal\" (UID: \"90cb0b447697e0200b30615533e10b53\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" May 21 16:11:35.687537 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.687380 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90cb0b447697e0200b30615533e10b53-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal\" (UID: \"90cb0b447697e0200b30615533e10b53\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" May 21 16:11:35.687537 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.687425 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90cb0b447697e0200b30615533e10b53-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal\" (UID: \"90cb0b447697e0200b30615533e10b53\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" May 21 16:11:35.687537 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.687441 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90cb0b447697e0200b30615533e10b53-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal\" (UID: \"90cb0b447697e0200b30615533e10b53\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" May 21 16:11:35.687537 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.687445 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b349e1c779f1a186fb69a81f163bcb5d-config\") pod \"kube-apiserver-proxy-ip-10-0-139-146.ec2.internal\" (UID: \"b349e1c779f1a186fb69a81f163bcb5d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-146.ec2.internal" May 21 16:11:35.760512 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.760474 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" May 21 16:11:35.765553 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:35.765529 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-146.ec2.internal" May 21 16:11:35.782360 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:35.782011 2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-146.ec2.internal\" not found" May 21 16:11:35.882596 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:35.882494 2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-146.ec2.internal\" not found" May 21 16:11:35.983023 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:35.982980 2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-146.ec2.internal\" not found" May 21 16:11:36.006456 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:36.006436 2547 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 16:11:36.080674 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:36.080623 2547 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 16:11:36.081331 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:36.080809 2547 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 16:11:36.081331 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:36.080850 2547 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 16:11:36.081331 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:36.080850 2547 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 16:11:36.083775 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:36.083754 2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-146.ec2.internal\" not found" May 21 16:11:36.179291 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:36.179195 2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 16:06:35 +0000 UTC" deadline="2028-02-20 02:14:47.549952572 +0000 UTC" May 21 16:11:36.179291 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:36.179227 2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15346h3m11.370728804s" May 21 16:11:36.184379 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:36.184360 2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 16:11:36.184460 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:36.184366 2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-146.ec2.internal\" not found" May 21 16:11:36.194372 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:36.194347 2547 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 16:11:36.214993 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:36.214962 2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6m259" May 21 16:11:36.223238 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:36.223219 2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6m259" May 21 16:11:36.284947 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:36.284913 2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-146.ec2.internal\" not found" May 21 16:11:36.334002 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:36.333926 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb349e1c779f1a186fb69a81f163bcb5d.slice/crio-f5df431dc97806275d42ab0b02b6f8067fbc588e0d54213dd3011ec87cbe92fa WatchSource:0}: Error finding container f5df431dc97806275d42ab0b02b6f8067fbc588e0d54213dd3011ec87cbe92fa: Status 404 returned error can't find the container with id f5df431dc97806275d42ab0b02b6f8067fbc588e0d54213dd3011ec87cbe92fa May 21 16:11:36.334263 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:36.334245 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90cb0b447697e0200b30615533e10b53.slice/crio-815e62c0e2dbab94268d0d707246ba4951d56b5d4aacad21a84eb3ca82f62e25 WatchSource:0}: Error finding container 815e62c0e2dbab94268d0d707246ba4951d56b5d4aacad21a84eb3ca82f62e25: Status 404 returned error can't find the container with id 815e62c0e2dbab94268d0d707246ba4951d56b5d4aacad21a84eb3ca82f62e25 May 21 16:11:36.338580 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:36.338559 2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 16:11:36.385594 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:36.385543 2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-146.ec2.internal\" not found" May 21 16:11:36.485950 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:36.485875 2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-146.ec2.internal\" not found" May 21 16:11:36.535810 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:36.535784 2547 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 16:11:36.586091 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:36.586054 2547 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" May 21 16:11:36.600703 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:36.600674 2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 16:11:36.601649 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:36.601633 2547 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-146.ec2.internal" May 21 16:11:36.609294 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:36.609277 2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 16:11:37.161344 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.161307 2547 apiserver.go:52] "Watching apiserver" May 21 16:11:37.172046 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.172014 2547 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 16:11:37.172430 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.172401 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal","openshift-multus/multus-8crv6","openshift-multus/multus-additional-cni-plugins-g8kpd","openshift-multus/network-metrics-daemon-49jxl","kube-system/konnectivity-agent-t7qlr","kube-system/kube-apiserver-proxy-ip-10-0-139-146.ec2.internal","openshift-network-diagnostics/network-check-target-lmq6k","openshift-network-operator/iptables-alerter-hwbq8","openshift-ovn-kubernetes/ovnkube-node-xsq2k","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg","openshift-cluster-node-tuning-operator/tuned-85k9r","openshift-dns/node-resolver-vbmn8","openshift-image-registry/node-ca-44tws"] May 21 16:11:37.174407 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.174192 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:11:37.174407 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:37.174277 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lmq6k" podUID="f4204967-d20e-4283-935c-a6e32ad1aba9" May 21 16:11:37.175546 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.175520 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8crv6" May 21 16:11:37.176921 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.176798 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.178091 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.178067 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:11:37.178196 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:37.178139 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49jxl" podUID="44a88f02-4431-4214-9629-d63db994abfe" May 21 16:11:37.179432 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.179409 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 16:11:37.179581 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.179558 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 16:11:37.180120 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.179960 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 16:11:37.180120 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.180073 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fl7nw\"" May 21 16:11:37.180288 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.180180 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 16:11:37.180343 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.180078 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rd4bq\"" May 21 16:11:37.180395 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.180368 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 16:11:37.180600 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.180583 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 16:11:37.181764 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.181306 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hwbq8" May 21 16:11:37.183465 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.183424 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t7qlr" May 21 16:11:37.183612 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.183592 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.184319 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.184128 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 16:11:37.184319 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.184185 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 16:11:37.184319 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.184282 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ml626\"" May 21 16:11:37.184516 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.184393 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 16:11:37.186551 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.186365 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 16:11:37.186551 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.186390 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 16:11:37.186551 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.186466 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 16:11:37.186722 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.186710 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-twtgb\"" May 21 16:11:37.187552 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.186799 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-s4zsq\"" May 21 16:11:37.187552 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.186884 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 16:11:37.187552 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.186927 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 16:11:37.187552 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.186889 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 16:11:37.187552 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.186982 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" May 21 16:11:37.187552 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.187065 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 16:11:37.187552 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.187446 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 16:11:37.188714 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.188694 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.188861 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.188846 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vbmn8" May 21 16:11:37.189556 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.189540 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 16:11:37.189700 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.189680 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-59jlr\"" May 21 16:11:37.189985 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.189964 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 16:11:37.190247 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.190167 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 16:11:37.190639 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.190621 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-44tws" May 21 16:11:37.191279 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.191156 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 16:11:37.191392 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.191355 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 16:11:37.191709 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.191686 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 16:11:37.191976 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.191952 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hl654\"" May 21 16:11:37.192075 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.192057 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 16:11:37.192317 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.192299 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q89ml\"" May 21 16:11:37.193166 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.193129 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 16:11:37.193524 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.193506 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 16:11:37.193605 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.193524 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 16:11:37.193718 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.193703 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-99ccr\"" May 21 16:11:37.196251 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.194992 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-host-var-lib-cni-multus\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.196251 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195022 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-run-ovn\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.196251 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195039 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57b0c522-cbfe-4c72-9396-646d4d893a0a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g8kpd\" (UID: \"57b0c522-cbfe-4c72-9396-646d4d893a0a\") " pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.196251 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195054 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4903b299-31c8-4a3d-a403-0fea568003b1-sys-fs\") pod \"aws-ebs-csi-driver-node-mqcfg\" (UID: \"4903b299-31c8-4a3d-a403-0fea568003b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" May 21 16:11:37.196251 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195082 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-var-lib-openvswitch\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.196251 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195103 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5780fafa-5b6a-4f8b-8259-5fa685f0277f-cni-binary-copy\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.196251 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195127 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-host-run-multus-certs\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.196251 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195142 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-etc-kubernetes\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.196251 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195178 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d0103be-1e45-4ea4-9c18-bbc13773e537-host-slash\") pod \"iptables-alerter-hwbq8\" (UID: \"5d0103be-1e45-4ea4-9c18-bbc13773e537\") " pod="openshift-network-operator/iptables-alerter-hwbq8" May 21 16:11:37.196251 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195222 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nl2b\" (UniqueName: \"kubernetes.io/projected/4903b299-31c8-4a3d-a403-0fea568003b1-kube-api-access-7nl2b\") pod \"aws-ebs-csi-driver-node-mqcfg\" (UID: \"4903b299-31c8-4a3d-a403-0fea568003b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" May 21 16:11:37.196251 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195251 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57b0c522-cbfe-4c72-9396-646d4d893a0a-system-cni-dir\") pod \"multus-additional-cni-plugins-g8kpd\" (UID: \"57b0c522-cbfe-4c72-9396-646d4d893a0a\") " pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.196251 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195279 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs\") pod \"network-metrics-daemon-49jxl\" (UID: \"44a88f02-4431-4214-9629-d63db994abfe\") " pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:11:37.196251 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195305 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-host-var-lib-cni-bin\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.196251 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195331 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5d0103be-1e45-4ea4-9c18-bbc13773e537-iptables-alerter-script\") pod \"iptables-alerter-hwbq8\" (UID: \"5d0103be-1e45-4ea4-9c18-bbc13773e537\") " pod="openshift-network-operator/iptables-alerter-hwbq8" May 21 16:11:37.196251 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195359 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.196251 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195387 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e219263f-6a61-44ab-ab60-b90f74c6de79-ovnkube-config\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.197057 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195411 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e219263f-6a61-44ab-ab60-b90f74c6de79-env-overrides\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.197057 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195435 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-cnibin\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.197057 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195461 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-host-run-netns\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.197057 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195486 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57b0c522-cbfe-4c72-9396-646d4d893a0a-os-release\") pod \"multus-additional-cni-plugins-g8kpd\" (UID: \"57b0c522-cbfe-4c72-9396-646d4d893a0a\") " pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.197057 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195518 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4903b299-31c8-4a3d-a403-0fea568003b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-mqcfg\" (UID: \"4903b299-31c8-4a3d-a403-0fea568003b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" May 21 16:11:37.197057 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195562 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6v8j\" (UniqueName: \"kubernetes.io/projected/57b0c522-cbfe-4c72-9396-646d4d893a0a-kube-api-access-w6v8j\") pod \"multus-additional-cni-plugins-g8kpd\" (UID: \"57b0c522-cbfe-4c72-9396-646d4d893a0a\") " pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.197057 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195590 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-host-var-lib-kubelet\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.197057 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195639 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnbsk\" (UniqueName: \"kubernetes.io/projected/5d0103be-1e45-4ea4-9c18-bbc13773e537-kube-api-access-qnbsk\") pod \"iptables-alerter-hwbq8\" (UID: \"5d0103be-1e45-4ea4-9c18-bbc13773e537\") " pod="openshift-network-operator/iptables-alerter-hwbq8" May 21 16:11:37.197057 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195684 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-node-log\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.197057 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195710 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-host-cni-netd\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.197057 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195735 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-hostroot\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.197057 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195761 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5780fafa-5b6a-4f8b-8259-5fa685f0277f-multus-daemon-config\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.197057 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195787 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-etc-openvswitch\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.197057 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195840 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-host-cni-bin\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.197057 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195924 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8rwd\" (UniqueName: \"kubernetes.io/projected/e219263f-6a61-44ab-ab60-b90f74c6de79-kube-api-access-d8rwd\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.197057 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195955 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-host-run-k8s-cni-cncf-io\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.197679 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.195995 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4903b299-31c8-4a3d-a403-0fea568003b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mqcfg\" (UID: \"4903b299-31c8-4a3d-a403-0fea568003b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" May 21 16:11:37.197679 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.196022 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-os-release\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.197679 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.196063 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-multus-conf-dir\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.197679 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.196101 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0e63341a-de28-4eac-a9bf-7cbc317aac29-agent-certs\") pod \"konnectivity-agent-t7qlr\" (UID: \"0e63341a-de28-4eac-a9bf-7cbc317aac29\") " pod="kube-system/konnectivity-agent-t7qlr" May 21 16:11:37.197679 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.196127 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-host-slash\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.197679 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.196163 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-run-systemd\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.197679 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.196190 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-run-openvswitch\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.197679 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.196219 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-multus-cni-dir\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.197679 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.196250 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-log-socket\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.197679 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.196276 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-host-run-ovn-kubernetes\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.197679 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.196301 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4903b299-31c8-4a3d-a403-0fea568003b1-socket-dir\") pod \"aws-ebs-csi-driver-node-mqcfg\" (UID: \"4903b299-31c8-4a3d-a403-0fea568003b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" May 21 16:11:37.197679 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.196327 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/57b0c522-cbfe-4c72-9396-646d4d893a0a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g8kpd\" (UID: \"57b0c522-cbfe-4c72-9396-646d4d893a0a\") " pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.197679 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.196362 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbwhd\" (UniqueName: \"kubernetes.io/projected/f4204967-d20e-4283-935c-a6e32ad1aba9-kube-api-access-xbwhd\") pod \"network-check-target-lmq6k\" (UID: \"f4204967-d20e-4283-935c-a6e32ad1aba9\") " pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:11:37.197679 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.196388 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-system-cni-dir\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.197679 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.196413 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-host-kubelet\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.197679 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.196442 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e219263f-6a61-44ab-ab60-b90f74c6de79-ovn-node-metrics-cert\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.198401 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.196478 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4903b299-31c8-4a3d-a403-0fea568003b1-registration-dir\") pod \"aws-ebs-csi-driver-node-mqcfg\" (UID: \"4903b299-31c8-4a3d-a403-0fea568003b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" May 21 16:11:37.198401 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.196504 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57b0c522-cbfe-4c72-9396-646d4d893a0a-cni-binary-copy\") pod \"multus-additional-cni-plugins-g8kpd\" (UID: \"57b0c522-cbfe-4c72-9396-646d4d893a0a\") " pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.198401 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.196529 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-multus-socket-dir-parent\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.198401 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.196552 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-host-run-netns\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.198401 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.196574 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57b0c522-cbfe-4c72-9396-646d4d893a0a-cnibin\") pod \"multus-additional-cni-plugins-g8kpd\" (UID: \"57b0c522-cbfe-4c72-9396-646d4d893a0a\") " pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.198401 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.196591 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/57b0c522-cbfe-4c72-9396-646d4d893a0a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g8kpd\" (UID: \"57b0c522-cbfe-4c72-9396-646d4d893a0a\") " pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.198401 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.196606 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-systemd-units\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.198401 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.196629 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e219263f-6a61-44ab-ab60-b90f74c6de79-ovnkube-script-lib\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.201672 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.196660 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwbbc\" (UniqueName: \"kubernetes.io/projected/44a88f02-4431-4214-9629-d63db994abfe-kube-api-access-vwbbc\") pod \"network-metrics-daemon-49jxl\" (UID: \"44a88f02-4431-4214-9629-d63db994abfe\") " pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:11:37.201768 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.201709 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqlwk\" (UniqueName: \"kubernetes.io/projected/5780fafa-5b6a-4f8b-8259-5fa685f0277f-kube-api-access-wqlwk\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.201768 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.201752 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0e63341a-de28-4eac-a9bf-7cbc317aac29-konnectivity-ca\") pod \"konnectivity-agent-t7qlr\" (UID: \"0e63341a-de28-4eac-a9bf-7cbc317aac29\") " pod="kube-system/konnectivity-agent-t7qlr" May 21 16:11:37.201895 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.201786 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4903b299-31c8-4a3d-a403-0fea568003b1-device-dir\") pod \"aws-ebs-csi-driver-node-mqcfg\" (UID: \"4903b299-31c8-4a3d-a403-0fea568003b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" May 21 16:11:37.224137 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.224101 2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 16:06:36 +0000 UTC" deadline="2027-10-30 06:23:59.676903228 +0000 UTC" May 21 16:11:37.224137 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.224131 2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12638h12m22.452774915s" May 21 16:11:37.286214 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.286175 2547 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 16:11:37.302651 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.302620 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4903b299-31c8-4a3d-a403-0fea568003b1-sys-fs\") pod \"aws-ebs-csi-driver-node-mqcfg\" (UID: \"4903b299-31c8-4a3d-a403-0fea568003b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" May 21 16:11:37.302651 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.302662 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-var-lib-openvswitch\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.302914 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.302692 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5780fafa-5b6a-4f8b-8259-5fa685f0277f-cni-binary-copy\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.302914 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.302730 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-host-run-multus-certs\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.302914 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.302756 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-etc-kubernetes\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.302914 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.302760 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-var-lib-openvswitch\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.302914 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.302780 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d0103be-1e45-4ea4-9c18-bbc13773e537-host-slash\") pod \"iptables-alerter-hwbq8\" (UID: \"5d0103be-1e45-4ea4-9c18-bbc13773e537\") " pod="openshift-network-operator/iptables-alerter-hwbq8" May 21 16:11:37.302914 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.302786 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4903b299-31c8-4a3d-a403-0fea568003b1-sys-fs\") pod \"aws-ebs-csi-driver-node-mqcfg\" (UID: \"4903b299-31c8-4a3d-a403-0fea568003b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" May 21 16:11:37.302914 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.302841 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-etc-kubernetes\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.302914 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.302859 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-host-run-multus-certs\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.302914 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.302865 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d0103be-1e45-4ea4-9c18-bbc13773e537-host-slash\") pod \"iptables-alerter-hwbq8\" (UID: \"5d0103be-1e45-4ea4-9c18-bbc13773e537\") " pod="openshift-network-operator/iptables-alerter-hwbq8" May 21 16:11:37.302914 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.302897 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-etc-sysconfig\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.303370 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.302925 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b644c108-a408-4c24-8f36-3254c5892ad7-tmp\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.303370 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.302954 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7nl2b\" (UniqueName: \"kubernetes.io/projected/4903b299-31c8-4a3d-a403-0fea568003b1-kube-api-access-7nl2b\") pod \"aws-ebs-csi-driver-node-mqcfg\" (UID: \"4903b299-31c8-4a3d-a403-0fea568003b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" May 21 16:11:37.303370 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.302981 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57b0c522-cbfe-4c72-9396-646d4d893a0a-system-cni-dir\") pod \"multus-additional-cni-plugins-g8kpd\" (UID: \"57b0c522-cbfe-4c72-9396-646d4d893a0a\") " pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.303370 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303018 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57b0c522-cbfe-4c72-9396-646d4d893a0a-system-cni-dir\") pod \"multus-additional-cni-plugins-g8kpd\" (UID: \"57b0c522-cbfe-4c72-9396-646d4d893a0a\") " pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.303370 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303082 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs\") pod \"network-metrics-daemon-49jxl\" (UID: \"44a88f02-4431-4214-9629-d63db994abfe\") " pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:11:37.303370 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303103 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-host-var-lib-cni-bin\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.303370 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303127 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5d0103be-1e45-4ea4-9c18-bbc13773e537-iptables-alerter-script\") pod \"iptables-alerter-hwbq8\" (UID: \"5d0103be-1e45-4ea4-9c18-bbc13773e537\") " pod="openshift-network-operator/iptables-alerter-hwbq8" May 21 16:11:37.303370 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303159 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.303370 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303176 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-host-var-lib-cni-bin\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.303370 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303186 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e219263f-6a61-44ab-ab60-b90f74c6de79-ovnkube-config\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.303370 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:37.303197 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:37.303370 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303225 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e219263f-6a61-44ab-ab60-b90f74c6de79-env-overrides\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.303370 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:37.303279 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs podName:44a88f02-4431-4214-9629-d63db994abfe nodeName:}" failed. No retries permitted until 2026-05-21 16:11:37.803237143 +0000 UTC m=+3.101958042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs") pod "network-metrics-daemon-49jxl" (UID: "44a88f02-4431-4214-9629-d63db994abfe") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:37.303370 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303276 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.303370 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303304 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-cnibin\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.303370 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303340 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-host-run-netns\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.303370 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303369 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-run\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.304098 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303392 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-lib-modules\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.304098 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303419 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57b0c522-cbfe-4c72-9396-646d4d893a0a-os-release\") pod \"multus-additional-cni-plugins-g8kpd\" (UID: \"57b0c522-cbfe-4c72-9396-646d4d893a0a\") " pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.304098 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303448 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4903b299-31c8-4a3d-a403-0fea568003b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-mqcfg\" (UID: \"4903b299-31c8-4a3d-a403-0fea568003b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" May 21 16:11:37.304098 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303475 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6v8j\" (UniqueName: \"kubernetes.io/projected/57b0c522-cbfe-4c72-9396-646d4d893a0a-kube-api-access-w6v8j\") pod \"multus-additional-cni-plugins-g8kpd\" (UID: \"57b0c522-cbfe-4c72-9396-646d4d893a0a\") " pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.304098 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303529 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-cnibin\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.304098 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303562 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-host-var-lib-kubelet\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.304098 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303579 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5780fafa-5b6a-4f8b-8259-5fa685f0277f-cni-binary-copy\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.304098 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303593 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qnbsk\" (UniqueName: \"kubernetes.io/projected/5d0103be-1e45-4ea4-9c18-bbc13773e537-kube-api-access-qnbsk\") pod \"iptables-alerter-hwbq8\" (UID: \"5d0103be-1e45-4ea4-9c18-bbc13773e537\") " pod="openshift-network-operator/iptables-alerter-hwbq8" May 21 16:11:37.304098 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303618 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-node-log\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.304098 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303647 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-host-cni-netd\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.304098 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303673 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-hostroot\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.304098 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303686 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-host-var-lib-kubelet\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.304098 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303699 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5780fafa-5b6a-4f8b-8259-5fa685f0277f-multus-daemon-config\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.304098 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303704 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e219263f-6a61-44ab-ab60-b90f74c6de79-env-overrides\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.304098 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303734 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-host-run-netns\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.304098 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303751 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-node-log\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.304098 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303758 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e219263f-6a61-44ab-ab60-b90f74c6de79-ovnkube-config\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.304098 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303791 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-hostroot\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.304859 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303796 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-etc-openvswitch\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.304859 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303795 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57b0c522-cbfe-4c72-9396-646d4d893a0a-os-release\") pod \"multus-additional-cni-plugins-g8kpd\" (UID: \"57b0c522-cbfe-4c72-9396-646d4d893a0a\") " pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.304859 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303799 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4903b299-31c8-4a3d-a403-0fea568003b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-mqcfg\" (UID: \"4903b299-31c8-4a3d-a403-0fea568003b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" May 21 16:11:37.304859 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303808 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5d0103be-1e45-4ea4-9c18-bbc13773e537-iptables-alerter-script\") pod \"iptables-alerter-hwbq8\" (UID: \"5d0103be-1e45-4ea4-9c18-bbc13773e537\") " pod="openshift-network-operator/iptables-alerter-hwbq8" May 21 16:11:37.304859 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303843 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-host-cni-netd\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.304859 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303853 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-etc-openvswitch\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.304859 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303884 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-host-cni-bin\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.304859 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303907 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d8rwd\" (UniqueName: \"kubernetes.io/projected/e219263f-6a61-44ab-ab60-b90f74c6de79-kube-api-access-d8rwd\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.304859 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303932 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b644c108-a408-4c24-8f36-3254c5892ad7-etc-tuned\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.304859 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303938 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-host-cni-bin\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.304859 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.303959 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4vmd\" (UniqueName: \"kubernetes.io/projected/b644c108-a408-4c24-8f36-3254c5892ad7-kube-api-access-l4vmd\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.304859 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304054 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93d8872f-0f1e-49b5-9204-eb976993ff33-host\") pod \"node-ca-44tws\" (UID: \"93d8872f-0f1e-49b5-9204-eb976993ff33\") " pod="openshift-image-registry/node-ca-44tws" May 21 16:11:37.304859 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304090 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-host-run-k8s-cni-cncf-io\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.304859 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304142 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-host-run-k8s-cni-cncf-io\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.304859 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304169 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5780fafa-5b6a-4f8b-8259-5fa685f0277f-multus-daemon-config\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.304859 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304168 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-etc-modprobe-d\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.304859 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304217 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-var-lib-kubelet\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.305614 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304246 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4903b299-31c8-4a3d-a403-0fea568003b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mqcfg\" (UID: \"4903b299-31c8-4a3d-a403-0fea568003b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" May 21 16:11:37.305614 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304271 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-os-release\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.305614 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304294 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-multus-conf-dir\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.305614 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304320 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0e63341a-de28-4eac-a9bf-7cbc317aac29-agent-certs\") pod \"konnectivity-agent-t7qlr\" (UID: \"0e63341a-de28-4eac-a9bf-7cbc317aac29\") " pod="kube-system/konnectivity-agent-t7qlr" May 21 16:11:37.305614 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304340 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-host-slash\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.305614 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304337 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4903b299-31c8-4a3d-a403-0fea568003b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mqcfg\" (UID: \"4903b299-31c8-4a3d-a403-0fea568003b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" May 21 16:11:37.305614 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304357 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-run-systemd\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.305614 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304362 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-os-release\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.305614 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304389 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-run-openvswitch\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.305614 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304406 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-etc-kubernetes\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.305614 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304416 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-multus-conf-dir\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.305614 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304422 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b9dc463-4392-4994-9467-5979208be3e2-tmp-dir\") pod \"node-resolver-vbmn8\" (UID: \"7b9dc463-4392-4994-9467-5979208be3e2\") " pod="openshift-dns/node-resolver-vbmn8" May 21 16:11:37.305614 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304459 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-host-slash\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.305614 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304476 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/93d8872f-0f1e-49b5-9204-eb976993ff33-serviceca\") pod \"node-ca-44tws\" (UID: \"93d8872f-0f1e-49b5-9204-eb976993ff33\") " pod="openshift-image-registry/node-ca-44tws" May 21 16:11:37.305614 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304495 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-run-systemd\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.305614 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304508 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-multus-cni-dir\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.305614 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304530 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-run-openvswitch\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.305614 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304536 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-log-socket\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.306331 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304563 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-host-run-ovn-kubernetes\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.306331 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304592 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-multus-cni-dir\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.306331 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304591 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4903b299-31c8-4a3d-a403-0fea568003b1-socket-dir\") pod \"aws-ebs-csi-driver-node-mqcfg\" (UID: \"4903b299-31c8-4a3d-a403-0fea568003b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" May 21 16:11:37.306331 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304617 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-log-socket\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.306331 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304642 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-host-run-ovn-kubernetes\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.306331 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304639 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/57b0c522-cbfe-4c72-9396-646d4d893a0a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g8kpd\" (UID: \"57b0c522-cbfe-4c72-9396-646d4d893a0a\") " pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.306331 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304668 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbwhd\" (UniqueName: \"kubernetes.io/projected/f4204967-d20e-4283-935c-a6e32ad1aba9-kube-api-access-xbwhd\") pod \"network-check-target-lmq6k\" (UID: \"f4204967-d20e-4283-935c-a6e32ad1aba9\") " pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:11:37.306331 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304657 2547 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 16:11:37.306331 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304686 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-system-cni-dir\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.306331 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304705 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-host-kubelet\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.306331 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304730 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e219263f-6a61-44ab-ab60-b90f74c6de79-ovn-node-metrics-cert\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.306331 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304743 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4903b299-31c8-4a3d-a403-0fea568003b1-socket-dir\") pod \"aws-ebs-csi-driver-node-mqcfg\" (UID: \"4903b299-31c8-4a3d-a403-0fea568003b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" May 21 16:11:37.306331 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304751 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-etc-systemd\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.306331 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304794 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-system-cni-dir\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.306331 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304852 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-host-kubelet\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.306331 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304839 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4903b299-31c8-4a3d-a403-0fea568003b1-registration-dir\") pod \"aws-ebs-csi-driver-node-mqcfg\" (UID: \"4903b299-31c8-4a3d-a403-0fea568003b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" May 21 16:11:37.306331 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304914 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57b0c522-cbfe-4c72-9396-646d4d893a0a-cni-binary-copy\") pod \"multus-additional-cni-plugins-g8kpd\" (UID: \"57b0c522-cbfe-4c72-9396-646d4d893a0a\") " pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.306879 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304940 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-multus-socket-dir-parent\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.306879 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304964 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-host-run-netns\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.306879 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.304999 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-host\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.306879 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305027 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57b0c522-cbfe-4c72-9396-646d4d893a0a-cnibin\") pod \"multus-additional-cni-plugins-g8kpd\" (UID: \"57b0c522-cbfe-4c72-9396-646d4d893a0a\") " pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.306879 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305052 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/57b0c522-cbfe-4c72-9396-646d4d893a0a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g8kpd\" (UID: \"57b0c522-cbfe-4c72-9396-646d4d893a0a\") " pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.306879 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305054 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-host-run-netns\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.306879 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305002 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4903b299-31c8-4a3d-a403-0fea568003b1-registration-dir\") pod \"aws-ebs-csi-driver-node-mqcfg\" (UID: \"4903b299-31c8-4a3d-a403-0fea568003b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" May 21 16:11:37.306879 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305098 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-multus-socket-dir-parent\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.306879 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305143 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57b0c522-cbfe-4c72-9396-646d4d893a0a-cnibin\") pod \"multus-additional-cni-plugins-g8kpd\" (UID: \"57b0c522-cbfe-4c72-9396-646d4d893a0a\") " pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.306879 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305164 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/57b0c522-cbfe-4c72-9396-646d4d893a0a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g8kpd\" (UID: \"57b0c522-cbfe-4c72-9396-646d4d893a0a\") " pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.306879 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305178 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-systemd-units\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.306879 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305218 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e219263f-6a61-44ab-ab60-b90f74c6de79-ovnkube-script-lib\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.306879 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305210 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-systemd-units\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.306879 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305254 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-etc-sysctl-d\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.306879 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305306 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vwbbc\" (UniqueName: \"kubernetes.io/projected/44a88f02-4431-4214-9629-d63db994abfe-kube-api-access-vwbbc\") pod \"network-metrics-daemon-49jxl\" (UID: \"44a88f02-4431-4214-9629-d63db994abfe\") " pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:11:37.306879 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305334 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wqlwk\" (UniqueName: \"kubernetes.io/projected/5780fafa-5b6a-4f8b-8259-5fa685f0277f-kube-api-access-wqlwk\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.306879 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305361 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0e63341a-de28-4eac-a9bf-7cbc317aac29-konnectivity-ca\") pod \"konnectivity-agent-t7qlr\" (UID: \"0e63341a-de28-4eac-a9bf-7cbc317aac29\") " pod="kube-system/konnectivity-agent-t7qlr" May 21 16:11:37.307389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305388 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-sys\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.307389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305400 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57b0c522-cbfe-4c72-9396-646d4d893a0a-cni-binary-copy\") pod \"multus-additional-cni-plugins-g8kpd\" (UID: \"57b0c522-cbfe-4c72-9396-646d4d893a0a\") " pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.307389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305418 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b9dc463-4392-4994-9467-5979208be3e2-hosts-file\") pod \"node-resolver-vbmn8\" (UID: \"7b9dc463-4392-4994-9467-5979208be3e2\") " pod="openshift-dns/node-resolver-vbmn8" May 21 16:11:37.307389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305447 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t9lr\" (UniqueName: \"kubernetes.io/projected/7b9dc463-4392-4994-9467-5979208be3e2-kube-api-access-6t9lr\") pod \"node-resolver-vbmn8\" (UID: \"7b9dc463-4392-4994-9467-5979208be3e2\") " pod="openshift-dns/node-resolver-vbmn8" May 21 16:11:37.307389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305476 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/57b0c522-cbfe-4c72-9396-646d4d893a0a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g8kpd\" (UID: \"57b0c522-cbfe-4c72-9396-646d4d893a0a\") " pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.307389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305489 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4903b299-31c8-4a3d-a403-0fea568003b1-device-dir\") pod \"aws-ebs-csi-driver-node-mqcfg\" (UID: \"4903b299-31c8-4a3d-a403-0fea568003b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" May 21 16:11:37.307389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305521 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-host-var-lib-cni-multus\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.307389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305578 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5780fafa-5b6a-4f8b-8259-5fa685f0277f-host-var-lib-cni-multus\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.307389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305629 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-run-ovn\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.307389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305664 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-etc-sysctl-conf\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.307389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305692 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57b0c522-cbfe-4c72-9396-646d4d893a0a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g8kpd\" (UID: \"57b0c522-cbfe-4c72-9396-646d4d893a0a\") " pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.307389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305697 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e219263f-6a61-44ab-ab60-b90f74c6de79-ovnkube-script-lib\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.307389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305724 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grnwj\" (UniqueName: \"kubernetes.io/projected/93d8872f-0f1e-49b5-9204-eb976993ff33-kube-api-access-grnwj\") pod \"node-ca-44tws\" (UID: \"93d8872f-0f1e-49b5-9204-eb976993ff33\") " pod="openshift-image-registry/node-ca-44tws" May 21 16:11:37.307389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305760 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e219263f-6a61-44ab-ab60-b90f74c6de79-run-ovn\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.307389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305809 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4903b299-31c8-4a3d-a403-0fea568003b1-device-dir\") pod \"aws-ebs-csi-driver-node-mqcfg\" (UID: \"4903b299-31c8-4a3d-a403-0fea568003b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" May 21 16:11:37.307389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.305860 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57b0c522-cbfe-4c72-9396-646d4d893a0a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g8kpd\" (UID: \"57b0c522-cbfe-4c72-9396-646d4d893a0a\") " pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.307389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.306038 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0e63341a-de28-4eac-a9bf-7cbc317aac29-konnectivity-ca\") pod \"konnectivity-agent-t7qlr\" (UID: \"0e63341a-de28-4eac-a9bf-7cbc317aac29\") " pod="kube-system/konnectivity-agent-t7qlr" May 21 16:11:37.308191 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.307982 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e219263f-6a61-44ab-ab60-b90f74c6de79-ovn-node-metrics-cert\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.308262 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.308095 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0e63341a-de28-4eac-a9bf-7cbc317aac29-agent-certs\") pod \"konnectivity-agent-t7qlr\" (UID: \"0e63341a-de28-4eac-a9bf-7cbc317aac29\") " pod="kube-system/konnectivity-agent-t7qlr" May 21 16:11:37.311286 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:37.310988 2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 16:11:37.311286 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:37.311011 2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 16:11:37.311286 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:37.311027 2547 projected.go:194] Error preparing data for projected volume kube-api-access-xbwhd for pod openshift-network-diagnostics/network-check-target-lmq6k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:37.311286 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:37.311091 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4204967-d20e-4283-935c-a6e32ad1aba9-kube-api-access-xbwhd podName:f4204967-d20e-4283-935c-a6e32ad1aba9 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:37.811073927 +0000 UTC m=+3.109794824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xbwhd" (UniqueName: "kubernetes.io/projected/f4204967-d20e-4283-935c-a6e32ad1aba9-kube-api-access-xbwhd") pod "network-check-target-lmq6k" (UID: "f4204967-d20e-4283-935c-a6e32ad1aba9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:37.312929 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.312871 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6v8j\" (UniqueName: \"kubernetes.io/projected/57b0c522-cbfe-4c72-9396-646d4d893a0a-kube-api-access-w6v8j\") pod \"multus-additional-cni-plugins-g8kpd\" (UID: \"57b0c522-cbfe-4c72-9396-646d4d893a0a\") " pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.312929 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.312897 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nl2b\" (UniqueName: \"kubernetes.io/projected/4903b299-31c8-4a3d-a403-0fea568003b1-kube-api-access-7nl2b\") pod \"aws-ebs-csi-driver-node-mqcfg\" (UID: \"4903b299-31c8-4a3d-a403-0fea568003b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" May 21 16:11:37.313389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.313361 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnbsk\" (UniqueName: \"kubernetes.io/projected/5d0103be-1e45-4ea4-9c18-bbc13773e537-kube-api-access-qnbsk\") pod \"iptables-alerter-hwbq8\" (UID: \"5d0103be-1e45-4ea4-9c18-bbc13773e537\") " pod="openshift-network-operator/iptables-alerter-hwbq8" May 21 16:11:37.313986 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.313966 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwbbc\" (UniqueName: \"kubernetes.io/projected/44a88f02-4431-4214-9629-d63db994abfe-kube-api-access-vwbbc\") pod \"network-metrics-daemon-49jxl\" (UID: \"44a88f02-4431-4214-9629-d63db994abfe\") " pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:11:37.314154 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.314132 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8rwd\" (UniqueName: \"kubernetes.io/projected/e219263f-6a61-44ab-ab60-b90f74c6de79-kube-api-access-d8rwd\") pod \"ovnkube-node-xsq2k\" (UID: \"e219263f-6a61-44ab-ab60-b90f74c6de79\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.314663 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.314644 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqlwk\" (UniqueName: \"kubernetes.io/projected/5780fafa-5b6a-4f8b-8259-5fa685f0277f-kube-api-access-wqlwk\") pod \"multus-8crv6\" (UID: \"5780fafa-5b6a-4f8b-8259-5fa685f0277f\") " pod="openshift-multus/multus-8crv6" May 21 16:11:37.331388 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.331333 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" event={"ID":"90cb0b447697e0200b30615533e10b53","Type":"ContainerStarted","Data":"815e62c0e2dbab94268d0d707246ba4951d56b5d4aacad21a84eb3ca82f62e25"} May 21 16:11:37.332284 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.332260 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-146.ec2.internal" event={"ID":"b349e1c779f1a186fb69a81f163bcb5d","Type":"ContainerStarted","Data":"f5df431dc97806275d42ab0b02b6f8067fbc588e0d54213dd3011ec87cbe92fa"} May 21 16:11:37.406175 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406135 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-etc-sysconfig\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.406175 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406181 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b644c108-a408-4c24-8f36-3254c5892ad7-tmp\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.406420 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406227 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-run\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.406420 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406255 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-lib-modules\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.406420 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406283 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b644c108-a408-4c24-8f36-3254c5892ad7-etc-tuned\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.406420 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406298 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-etc-sysconfig\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.406420 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406307 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l4vmd\" (UniqueName: \"kubernetes.io/projected/b644c108-a408-4c24-8f36-3254c5892ad7-kube-api-access-l4vmd\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.406420 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406329 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-run\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.406420 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406361 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93d8872f-0f1e-49b5-9204-eb976993ff33-host\") pod \"node-ca-44tws\" (UID: \"93d8872f-0f1e-49b5-9204-eb976993ff33\") " pod="openshift-image-registry/node-ca-44tws" May 21 16:11:37.406420 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406388 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-etc-modprobe-d\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.406420 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406415 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-var-lib-kubelet\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.406809 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406447 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-etc-kubernetes\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.406809 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406450 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93d8872f-0f1e-49b5-9204-eb976993ff33-host\") pod \"node-ca-44tws\" (UID: \"93d8872f-0f1e-49b5-9204-eb976993ff33\") " pod="openshift-image-registry/node-ca-44tws" May 21 16:11:37.406809 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406438 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-lib-modules\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.406809 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406475 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b9dc463-4392-4994-9467-5979208be3e2-tmp-dir\") pod \"node-resolver-vbmn8\" (UID: \"7b9dc463-4392-4994-9467-5979208be3e2\") " pod="openshift-dns/node-resolver-vbmn8" May 21 16:11:37.406809 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406499 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/93d8872f-0f1e-49b5-9204-eb976993ff33-serviceca\") pod \"node-ca-44tws\" (UID: \"93d8872f-0f1e-49b5-9204-eb976993ff33\") " pod="openshift-image-registry/node-ca-44tws" May 21 16:11:37.406809 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406513 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-etc-kubernetes\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.406809 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406545 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-etc-systemd\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.406809 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406572 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-host\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.406809 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406575 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-etc-modprobe-d\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.406809 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406500 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-var-lib-kubelet\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.406809 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406600 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-etc-sysctl-d\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.406809 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406670 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-etc-systemd\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.406809 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406710 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-etc-sysctl-d\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.406809 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406729 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-sys\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.406809 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406740 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-host\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.406809 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406762 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b9dc463-4392-4994-9467-5979208be3e2-hosts-file\") pod \"node-resolver-vbmn8\" (UID: \"7b9dc463-4392-4994-9467-5979208be3e2\") " pod="openshift-dns/node-resolver-vbmn8" May 21 16:11:37.406809 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406793 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6t9lr\" (UniqueName: \"kubernetes.io/projected/7b9dc463-4392-4994-9467-5979208be3e2-kube-api-access-6t9lr\") pod \"node-resolver-vbmn8\" (UID: \"7b9dc463-4392-4994-9467-5979208be3e2\") " pod="openshift-dns/node-resolver-vbmn8" May 21 16:11:37.406809 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406807 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-sys\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.407803 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406840 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-etc-sysctl-conf\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.407803 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406849 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b9dc463-4392-4994-9467-5979208be3e2-hosts-file\") pod \"node-resolver-vbmn8\" (UID: \"7b9dc463-4392-4994-9467-5979208be3e2\") " pod="openshift-dns/node-resolver-vbmn8" May 21 16:11:37.407803 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406866 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-grnwj\" (UniqueName: \"kubernetes.io/projected/93d8872f-0f1e-49b5-9204-eb976993ff33-kube-api-access-grnwj\") pod \"node-ca-44tws\" (UID: \"93d8872f-0f1e-49b5-9204-eb976993ff33\") " pod="openshift-image-registry/node-ca-44tws" May 21 16:11:37.407803 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406963 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b644c108-a408-4c24-8f36-3254c5892ad7-etc-sysctl-conf\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.407803 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.406979 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/93d8872f-0f1e-49b5-9204-eb976993ff33-serviceca\") pod \"node-ca-44tws\" (UID: \"93d8872f-0f1e-49b5-9204-eb976993ff33\") " pod="openshift-image-registry/node-ca-44tws" May 21 16:11:37.407803 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.407452 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b9dc463-4392-4994-9467-5979208be3e2-tmp-dir\") pod \"node-resolver-vbmn8\" (UID: \"7b9dc463-4392-4994-9467-5979208be3e2\") " pod="openshift-dns/node-resolver-vbmn8" May 21 16:11:37.409051 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.409027 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b644c108-a408-4c24-8f36-3254c5892ad7-etc-tuned\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.409312 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.409288 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b644c108-a408-4c24-8f36-3254c5892ad7-tmp\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.416596 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.416536 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4vmd\" (UniqueName: \"kubernetes.io/projected/b644c108-a408-4c24-8f36-3254c5892ad7-kube-api-access-l4vmd\") pod \"tuned-85k9r\" (UID: \"b644c108-a408-4c24-8f36-3254c5892ad7\") " pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.416877 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.416856 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t9lr\" (UniqueName: \"kubernetes.io/projected/7b9dc463-4392-4994-9467-5979208be3e2-kube-api-access-6t9lr\") pod \"node-resolver-vbmn8\" (UID: \"7b9dc463-4392-4994-9467-5979208be3e2\") " pod="openshift-dns/node-resolver-vbmn8" May 21 16:11:37.416947 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.416876 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grnwj\" (UniqueName: \"kubernetes.io/projected/93d8872f-0f1e-49b5-9204-eb976993ff33-kube-api-access-grnwj\") pod \"node-ca-44tws\" (UID: \"93d8872f-0f1e-49b5-9204-eb976993ff33\") " pod="openshift-image-registry/node-ca-44tws" May 21 16:11:37.485299 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.485256 2547 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 16:11:37.490451 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.490420 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8crv6" May 21 16:11:37.500262 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.500229 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g8kpd" May 21 16:11:37.516048 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.516020 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hwbq8" May 21 16:11:37.519750 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.519727 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t7qlr" May 21 16:11:37.526474 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.526452 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:11:37.532193 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.532169 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" May 21 16:11:37.538870 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.538849 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-85k9r" May 21 16:11:37.545438 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.545416 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vbmn8" May 21 16:11:37.551016 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.550992 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-44tws" May 21 16:11:37.650654 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.650612 2547 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 16:11:37.810712 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.810619 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs\") pod \"network-metrics-daemon-49jxl\" (UID: \"44a88f02-4431-4214-9629-d63db994abfe\") " pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:11:37.810953 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:37.810791 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:37.810953 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:37.810878 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs podName:44a88f02-4431-4214-9629-d63db994abfe nodeName:}" failed. No retries permitted until 2026-05-21 16:11:38.810857333 +0000 UTC m=+4.109578226 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs") pod "network-metrics-daemon-49jxl" (UID: "44a88f02-4431-4214-9629-d63db994abfe") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:37.910342 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:37.910311 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d0103be_1e45_4ea4_9c18_bbc13773e537.slice/crio-f774919df1c5f9e94baf4057ecf291d4b48f2fd96a4f1682b3390ee94e202293 WatchSource:0}: Error finding container f774919df1c5f9e94baf4057ecf291d4b48f2fd96a4f1682b3390ee94e202293: Status 404 returned error can't find the container with id f774919df1c5f9e94baf4057ecf291d4b48f2fd96a4f1682b3390ee94e202293 May 21 16:11:37.910976 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:37.910950 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbwhd\" (UniqueName: \"kubernetes.io/projected/f4204967-d20e-4283-935c-a6e32ad1aba9-kube-api-access-xbwhd\") pod \"network-check-target-lmq6k\" (UID: \"f4204967-d20e-4283-935c-a6e32ad1aba9\") " pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:11:37.911103 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:37.911085 2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 16:11:37.911176 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:37.911108 2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 16:11:37.911176 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:37.911120 2547 projected.go:194] Error preparing data for projected volume kube-api-access-xbwhd for pod openshift-network-diagnostics/network-check-target-lmq6k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:37.911176 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:37.911173 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4204967-d20e-4283-935c-a6e32ad1aba9-kube-api-access-xbwhd podName:f4204967-d20e-4283-935c-a6e32ad1aba9 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:38.911156514 +0000 UTC m=+4.209877408 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xbwhd" (UniqueName: "kubernetes.io/projected/f4204967-d20e-4283-935c-a6e32ad1aba9-kube-api-access-xbwhd") pod "network-check-target-lmq6k" (UID: "f4204967-d20e-4283-935c-a6e32ad1aba9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:37.916080 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:37.916057 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e63341a_de28_4eac_a9bf_7cbc317aac29.slice/crio-c5223ecf8dcf7d8ac09307db66bca41c42c32ba9bc486eb68d75abf0234f00c3 WatchSource:0}: Error finding container c5223ecf8dcf7d8ac09307db66bca41c42c32ba9bc486eb68d75abf0234f00c3: Status 404 returned error can't find the container with id c5223ecf8dcf7d8ac09307db66bca41c42c32ba9bc486eb68d75abf0234f00c3 May 21 16:11:37.916512 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:37.916493 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93d8872f_0f1e_49b5_9204_eb976993ff33.slice/crio-184a390dbb1f45833dbbfb1fb7713866e1565160fa2c7f0815fa89222d3c69bc WatchSource:0}: Error finding container 184a390dbb1f45833dbbfb1fb7713866e1565160fa2c7f0815fa89222d3c69bc: Status 404 returned error can't find the container with id 184a390dbb1f45833dbbfb1fb7713866e1565160fa2c7f0815fa89222d3c69bc May 21 16:11:37.917408 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:37.917382 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5780fafa_5b6a_4f8b_8259_5fa685f0277f.slice/crio-3a3456c9ac4d6baafad6006afd81428023f56529104919708acb3cda9ea456f0 WatchSource:0}: Error finding container 3a3456c9ac4d6baafad6006afd81428023f56529104919708acb3cda9ea456f0: Status 404 returned error can't find the container with id 3a3456c9ac4d6baafad6006afd81428023f56529104919708acb3cda9ea456f0 May 21 16:11:37.918274 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:37.918249 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4903b299_31c8_4a3d_a403_0fea568003b1.slice/crio-d9de74cf5d1b1b6b8da3fe1ae23a9b8ff9fe42c2fa2d1bf9e94eb9fed2a6e8bf WatchSource:0}: Error finding container d9de74cf5d1b1b6b8da3fe1ae23a9b8ff9fe42c2fa2d1bf9e94eb9fed2a6e8bf: Status 404 returned error can't find the container with id d9de74cf5d1b1b6b8da3fe1ae23a9b8ff9fe42c2fa2d1bf9e94eb9fed2a6e8bf May 21 16:11:37.919692 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:37.919659 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode219263f_6a61_44ab_ab60_b90f74c6de79.slice/crio-2aaecdbe954a5f3a1191fe7fb21513beb4c303b64a61624278a775f7b76bbba6 WatchSource:0}: Error finding container 2aaecdbe954a5f3a1191fe7fb21513beb4c303b64a61624278a775f7b76bbba6: Status 404 returned error can't find the container with id 2aaecdbe954a5f3a1191fe7fb21513beb4c303b64a61624278a775f7b76bbba6 May 21 16:11:37.921589 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:37.921568 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb644c108_a408_4c24_8f36_3254c5892ad7.slice/crio-ca444b464f09985a985322452916d920269b4425f7a3771db2c42f66a4e2deda WatchSource:0}: Error finding container ca444b464f09985a985322452916d920269b4425f7a3771db2c42f66a4e2deda: Status 404 returned error can't find the container with id ca444b464f09985a985322452916d920269b4425f7a3771db2c42f66a4e2deda May 21 16:11:37.922731 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:37.922707 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b9dc463_4392_4994_9467_5979208be3e2.slice/crio-10f2e0022a0fac2b56d2eaa13f8816184e0fe933243387a8201061d958465125 WatchSource:0}: Error finding container 10f2e0022a0fac2b56d2eaa13f8816184e0fe933243387a8201061d958465125: Status 404 returned error can't find the container with id 10f2e0022a0fac2b56d2eaa13f8816184e0fe933243387a8201061d958465125 May 21 16:11:37.924353 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:11:37.924331 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57b0c522_cbfe_4c72_9396_646d4d893a0a.slice/crio-6ee1ebc908e3b503d4064d5ced9f48224dca44e7fea736af149f0c22b7f1721b WatchSource:0}: Error finding container 6ee1ebc908e3b503d4064d5ced9f48224dca44e7fea736af149f0c22b7f1721b: Status 404 returned error can't find the container with id 6ee1ebc908e3b503d4064d5ced9f48224dca44e7fea736af149f0c22b7f1721b May 21 16:11:38.224468 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:38.224427 2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 16:06:36 +0000 UTC" deadline="2028-02-02 21:35:54.209927478 +0000 UTC" May 21 16:11:38.224468 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:38.224467 2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14933h24m15.985464609s" May 21 16:11:38.345211 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:38.345168 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t7qlr" event={"ID":"0e63341a-de28-4eac-a9bf-7cbc317aac29","Type":"ContainerStarted","Data":"c5223ecf8dcf7d8ac09307db66bca41c42c32ba9bc486eb68d75abf0234f00c3"} May 21 16:11:38.348614 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:38.348559 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hwbq8" event={"ID":"5d0103be-1e45-4ea4-9c18-bbc13773e537","Type":"ContainerStarted","Data":"f774919df1c5f9e94baf4057ecf291d4b48f2fd96a4f1682b3390ee94e202293"} May 21 16:11:38.355733 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:38.355018 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-146.ec2.internal" event={"ID":"b349e1c779f1a186fb69a81f163bcb5d","Type":"ContainerStarted","Data":"c4794400967fdb8393df9a0fb787a2c0e413ae00e461d6dc016182ffa146c0a0"} May 21 16:11:38.357760 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:38.357702 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8kpd" event={"ID":"57b0c522-cbfe-4c72-9396-646d4d893a0a","Type":"ContainerStarted","Data":"6ee1ebc908e3b503d4064d5ced9f48224dca44e7fea736af149f0c22b7f1721b"} May 21 16:11:38.360751 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:38.360700 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vbmn8" event={"ID":"7b9dc463-4392-4994-9467-5979208be3e2","Type":"ContainerStarted","Data":"10f2e0022a0fac2b56d2eaa13f8816184e0fe933243387a8201061d958465125"} May 21 16:11:38.371081 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:38.370759 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-146.ec2.internal" podStartSLOduration=2.370742964 podStartE2EDuration="2.370742964s" podCreationTimestamp="2026-05-21 16:11:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:11:38.369875383 +0000 UTC m=+3.668596284" watchObservedRunningTime="2026-05-21 16:11:38.370742964 +0000 UTC m=+3.669463867" May 21 16:11:38.371541 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:38.371475 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" event={"ID":"e219263f-6a61-44ab-ab60-b90f74c6de79","Type":"ContainerStarted","Data":"2aaecdbe954a5f3a1191fe7fb21513beb4c303b64a61624278a775f7b76bbba6"} May 21 16:11:38.383087 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:38.383054 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" event={"ID":"4903b299-31c8-4a3d-a403-0fea568003b1","Type":"ContainerStarted","Data":"d9de74cf5d1b1b6b8da3fe1ae23a9b8ff9fe42c2fa2d1bf9e94eb9fed2a6e8bf"} May 21 16:11:38.396693 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:38.396653 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8crv6" event={"ID":"5780fafa-5b6a-4f8b-8259-5fa685f0277f","Type":"ContainerStarted","Data":"3a3456c9ac4d6baafad6006afd81428023f56529104919708acb3cda9ea456f0"} May 21 16:11:38.414844 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:38.414498 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-44tws" event={"ID":"93d8872f-0f1e-49b5-9204-eb976993ff33","Type":"ContainerStarted","Data":"184a390dbb1f45833dbbfb1fb7713866e1565160fa2c7f0815fa89222d3c69bc"} May 21 16:11:38.429986 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:38.429692 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" event={"ID":"90cb0b447697e0200b30615533e10b53","Type":"ContainerDied","Data":"92d7c003206a15aab4b9896ce93f0992a901661151e3b82eb42ecc1488bba9a3"} May 21 16:11:38.429986 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:38.429660 2547 generic.go:358] "Generic (PLEG): container finished" podID="90cb0b447697e0200b30615533e10b53" containerID="92d7c003206a15aab4b9896ce93f0992a901661151e3b82eb42ecc1488bba9a3" exitCode=0 May 21 16:11:38.438641 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:38.438608 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-85k9r" event={"ID":"b644c108-a408-4c24-8f36-3254c5892ad7","Type":"ContainerStarted","Data":"ca444b464f09985a985322452916d920269b4425f7a3771db2c42f66a4e2deda"} May 21 16:11:38.782911 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:38.782872 2547 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 16:11:38.817577 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:38.817538 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs\") pod \"network-metrics-daemon-49jxl\" (UID: \"44a88f02-4431-4214-9629-d63db994abfe\") " pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:11:38.817736 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:38.817687 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:38.817809 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:38.817754 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs podName:44a88f02-4431-4214-9629-d63db994abfe nodeName:}" failed. No retries permitted until 2026-05-21 16:11:40.817733901 +0000 UTC m=+6.116454782 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs") pod "network-metrics-daemon-49jxl" (UID: "44a88f02-4431-4214-9629-d63db994abfe") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:38.918743 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:38.918705 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbwhd\" (UniqueName: \"kubernetes.io/projected/f4204967-d20e-4283-935c-a6e32ad1aba9-kube-api-access-xbwhd\") pod \"network-check-target-lmq6k\" (UID: \"f4204967-d20e-4283-935c-a6e32ad1aba9\") " pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:11:38.918936 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:38.918915 2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 16:11:38.918936 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:38.918937 2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 16:11:38.919059 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:38.918951 2547 projected.go:194] Error preparing data for projected volume kube-api-access-xbwhd for pod openshift-network-diagnostics/network-check-target-lmq6k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:38.919059 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:38.919011 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4204967-d20e-4283-935c-a6e32ad1aba9-kube-api-access-xbwhd podName:f4204967-d20e-4283-935c-a6e32ad1aba9 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:40.91899322 +0000 UTC m=+6.217714105 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xbwhd" (UniqueName: "kubernetes.io/projected/f4204967-d20e-4283-935c-a6e32ad1aba9-kube-api-access-xbwhd") pod "network-check-target-lmq6k" (UID: "f4204967-d20e-4283-935c-a6e32ad1aba9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:39.329916 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:39.329884 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:11:39.330429 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:39.330025 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49jxl" podUID="44a88f02-4431-4214-9629-d63db994abfe" May 21 16:11:39.330494 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:39.330432 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:11:39.330553 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:39.330519 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lmq6k" podUID="f4204967-d20e-4283-935c-a6e32ad1aba9" May 21 16:11:39.471313 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:39.471173 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" event={"ID":"90cb0b447697e0200b30615533e10b53","Type":"ContainerStarted","Data":"041a936c9edc61a8be0bc32b64a73bd844254ae799d5987ec86273926f3cc387"} May 21 16:11:39.488721 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:39.488665 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" podStartSLOduration=3.488648418 podStartE2EDuration="3.488648418s" podCreationTimestamp="2026-05-21 16:11:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:11:39.488372942 +0000 UTC m=+4.787093843" watchObservedRunningTime="2026-05-21 16:11:39.488648418 +0000 UTC m=+4.787369320" May 21 16:11:40.835587 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:40.835550 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs\") pod \"network-metrics-daemon-49jxl\" (UID: \"44a88f02-4431-4214-9629-d63db994abfe\") " pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:11:40.836076 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:40.835755 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:40.836076 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:40.835841 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs podName:44a88f02-4431-4214-9629-d63db994abfe nodeName:}" failed. No retries permitted until 2026-05-21 16:11:44.83580488 +0000 UTC m=+10.134525761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs") pod "network-metrics-daemon-49jxl" (UID: "44a88f02-4431-4214-9629-d63db994abfe") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:40.937114 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:40.936430 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbwhd\" (UniqueName: \"kubernetes.io/projected/f4204967-d20e-4283-935c-a6e32ad1aba9-kube-api-access-xbwhd\") pod \"network-check-target-lmq6k\" (UID: \"f4204967-d20e-4283-935c-a6e32ad1aba9\") " pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:11:40.937114 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:40.936637 2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 16:11:40.937114 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:40.936657 2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 16:11:40.937114 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:40.936671 2547 projected.go:194] Error preparing data for projected volume kube-api-access-xbwhd for pod openshift-network-diagnostics/network-check-target-lmq6k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:40.937114 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:40.936729 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4204967-d20e-4283-935c-a6e32ad1aba9-kube-api-access-xbwhd podName:f4204967-d20e-4283-935c-a6e32ad1aba9 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:44.936711204 +0000 UTC m=+10.235432101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xbwhd" (UniqueName: "kubernetes.io/projected/f4204967-d20e-4283-935c-a6e32ad1aba9-kube-api-access-xbwhd") pod "network-check-target-lmq6k" (UID: "f4204967-d20e-4283-935c-a6e32ad1aba9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:41.327723 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:41.327639 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:11:41.327723 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:41.327669 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:11:41.327952 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:41.327780 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49jxl" podUID="44a88f02-4431-4214-9629-d63db994abfe" May 21 16:11:41.328254 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:41.328226 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lmq6k" podUID="f4204967-d20e-4283-935c-a6e32ad1aba9" May 21 16:11:43.330311 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:43.329605 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:11:43.330311 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:43.329744 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49jxl" podUID="44a88f02-4431-4214-9629-d63db994abfe" May 21 16:11:43.330311 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:43.330090 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:11:43.330311 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:43.330179 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lmq6k" podUID="f4204967-d20e-4283-935c-a6e32ad1aba9" May 21 16:11:44.872580 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:44.872438 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs\") pod \"network-metrics-daemon-49jxl\" (UID: \"44a88f02-4431-4214-9629-d63db994abfe\") " pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:11:44.873065 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:44.872610 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:44.873065 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:44.872734 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs podName:44a88f02-4431-4214-9629-d63db994abfe nodeName:}" failed. No retries permitted until 2026-05-21 16:11:52.872712201 +0000 UTC m=+18.171433105 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs") pod "network-metrics-daemon-49jxl" (UID: "44a88f02-4431-4214-9629-d63db994abfe") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:44.973638 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:44.973523 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbwhd\" (UniqueName: \"kubernetes.io/projected/f4204967-d20e-4283-935c-a6e32ad1aba9-kube-api-access-xbwhd\") pod \"network-check-target-lmq6k\" (UID: \"f4204967-d20e-4283-935c-a6e32ad1aba9\") " pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:11:44.973854 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:44.973652 2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 16:11:44.973854 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:44.973672 2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 16:11:44.973854 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:44.973685 2547 projected.go:194] Error preparing data for projected volume kube-api-access-xbwhd for pod openshift-network-diagnostics/network-check-target-lmq6k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:44.973854 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:44.973741 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4204967-d20e-4283-935c-a6e32ad1aba9-kube-api-access-xbwhd podName:f4204967-d20e-4283-935c-a6e32ad1aba9 nodeName:}" failed. No retries permitted until 2026-05-21 16:11:52.973723504 +0000 UTC m=+18.272444384 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xbwhd" (UniqueName: "kubernetes.io/projected/f4204967-d20e-4283-935c-a6e32ad1aba9-kube-api-access-xbwhd") pod "network-check-target-lmq6k" (UID: "f4204967-d20e-4283-935c-a6e32ad1aba9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:45.329013 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:45.328926 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:11:45.329179 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:45.329040 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lmq6k" podUID="f4204967-d20e-4283-935c-a6e32ad1aba9" May 21 16:11:45.329450 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:45.329388 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:11:45.329553 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:45.329490 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49jxl" podUID="44a88f02-4431-4214-9629-d63db994abfe" May 21 16:11:47.327437 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:47.327405 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:11:47.327895 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:47.327447 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:11:47.327895 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:47.327543 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lmq6k" podUID="f4204967-d20e-4283-935c-a6e32ad1aba9" May 21 16:11:47.327895 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:47.327678 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49jxl" podUID="44a88f02-4431-4214-9629-d63db994abfe" May 21 16:11:49.328441 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:49.328405 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:11:49.328891 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:49.328403 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:11:49.328891 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:49.328543 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49jxl" podUID="44a88f02-4431-4214-9629-d63db994abfe" May 21 16:11:49.328891 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:49.328654 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lmq6k" podUID="f4204967-d20e-4283-935c-a6e32ad1aba9" May 21 16:11:51.328064 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:51.327983 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:11:51.328528 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:51.327983 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:11:51.328528 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:51.328174 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lmq6k" podUID="f4204967-d20e-4283-935c-a6e32ad1aba9" May 21 16:11:51.328528 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:51.328264 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49jxl" podUID="44a88f02-4431-4214-9629-d63db994abfe" May 21 16:11:52.928138 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:52.928090 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs\") pod \"network-metrics-daemon-49jxl\" (UID: \"44a88f02-4431-4214-9629-d63db994abfe\") " pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:11:52.928589 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:52.928289 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:52.928589 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:52.928373 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs podName:44a88f02-4431-4214-9629-d63db994abfe nodeName:}" failed. No retries permitted until 2026-05-21 16:12:08.928352835 +0000 UTC m=+34.227073723 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs") pod "network-metrics-daemon-49jxl" (UID: "44a88f02-4431-4214-9629-d63db994abfe") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:11:53.028838 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:53.028778 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbwhd\" (UniqueName: \"kubernetes.io/projected/f4204967-d20e-4283-935c-a6e32ad1aba9-kube-api-access-xbwhd\") pod \"network-check-target-lmq6k\" (UID: \"f4204967-d20e-4283-935c-a6e32ad1aba9\") " pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:11:53.029006 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:53.028970 2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 16:11:53.029006 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:53.028998 2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 16:11:53.029126 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:53.029012 2547 projected.go:194] Error preparing data for projected volume kube-api-access-xbwhd for pod openshift-network-diagnostics/network-check-target-lmq6k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:53.029126 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:53.029079 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4204967-d20e-4283-935c-a6e32ad1aba9-kube-api-access-xbwhd podName:f4204967-d20e-4283-935c-a6e32ad1aba9 nodeName:}" failed. No retries permitted until 2026-05-21 16:12:09.029059978 +0000 UTC m=+34.327780871 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xbwhd" (UniqueName: "kubernetes.io/projected/f4204967-d20e-4283-935c-a6e32ad1aba9-kube-api-access-xbwhd") pod "network-check-target-lmq6k" (UID: "f4204967-d20e-4283-935c-a6e32ad1aba9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:11:53.327399 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:53.327362 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:11:53.327581 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:53.327491 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lmq6k" podUID="f4204967-d20e-4283-935c-a6e32ad1aba9" May 21 16:11:53.327581 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:53.327534 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:11:53.327686 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:53.327623 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49jxl" podUID="44a88f02-4431-4214-9629-d63db994abfe" May 21 16:11:55.328291 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:55.328255 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:11:55.328842 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:55.328343 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lmq6k" podUID="f4204967-d20e-4283-935c-a6e32ad1aba9" May 21 16:11:55.328842 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:55.328420 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:11:55.328842 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:55.328522 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49jxl" podUID="44a88f02-4431-4214-9629-d63db994abfe" May 21 16:11:56.504567 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:56.504191 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vbmn8" event={"ID":"7b9dc463-4392-4994-9467-5979208be3e2","Type":"ContainerStarted","Data":"705f27ff3008cbc83ecf3b091b65b9a09d46066e13610635180f13daded179e4"} May 21 16:11:56.508146 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:56.508126 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/ovn-acl-logging/0.log" May 21 16:11:56.508554 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:56.508527 2547 generic.go:358] "Generic (PLEG): container finished" podID="e219263f-6a61-44ab-ab60-b90f74c6de79" containerID="78d433eef28837d7d58c1b1158faba31a7c0ddf8bfc2cc66fdc9ba7b6816edad" exitCode=1 May 21 16:11:56.508659 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:56.508590 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" event={"ID":"e219263f-6a61-44ab-ab60-b90f74c6de79","Type":"ContainerStarted","Data":"5da25190948cce4b2b91184406623d90192e893939ba34c0ecd21ae99f6912d8"} May 21 16:11:56.508659 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:56.508629 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" event={"ID":"e219263f-6a61-44ab-ab60-b90f74c6de79","Type":"ContainerStarted","Data":"4770b0fbf9848fc7102b49a7fde02fd6c46bd798e1ee5efa3f5a5857bd8bac01"} May 21 16:11:56.508659 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:56.508645 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" event={"ID":"e219263f-6a61-44ab-ab60-b90f74c6de79","Type":"ContainerStarted","Data":"c3ebd75cf52f25fd04738a111cc03c7a48e5dfc21dd2ec373f314a7b75874fc0"} May 21 16:11:56.508659 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:56.508658 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" event={"ID":"e219263f-6a61-44ab-ab60-b90f74c6de79","Type":"ContainerDied","Data":"78d433eef28837d7d58c1b1158faba31a7c0ddf8bfc2cc66fdc9ba7b6816edad"} May 21 16:11:56.508883 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:56.508673 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" event={"ID":"e219263f-6a61-44ab-ab60-b90f74c6de79","Type":"ContainerStarted","Data":"077460f15592b12c4a7ab12b71b152ef98e3a52f29dd7c2af62d0ab5029da6bb"} May 21 16:11:56.510132 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:56.510113 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" event={"ID":"4903b299-31c8-4a3d-a403-0fea568003b1","Type":"ContainerStarted","Data":"9b31bb09614c799abf9e2ed22f90fac5ed1937e9d0bb3fa9db2af8e899480abc"} May 21 16:11:56.511919 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:56.511894 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8crv6" event={"ID":"5780fafa-5b6a-4f8b-8259-5fa685f0277f","Type":"ContainerStarted","Data":"4b9db18b31f238c30861509f34abf3d7f6a08cf036b79a62561a768c2e8c1c30"} May 21 16:11:56.514064 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:56.514025 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-44tws" event={"ID":"93d8872f-0f1e-49b5-9204-eb976993ff33","Type":"ContainerStarted","Data":"388a23f708ccd9af715534abd5c1148c954023d4bbf0eefb76d50387a441e4e3"} May 21 16:11:56.515744 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:56.515709 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-85k9r" event={"ID":"b644c108-a408-4c24-8f36-3254c5892ad7","Type":"ContainerStarted","Data":"1b8cf0a8da0ee3de35ec09c3e46f66ed13b234d88bac0dcbc72a7d323e28e151"} May 21 16:11:56.517228 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:56.517201 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t7qlr" event={"ID":"0e63341a-de28-4eac-a9bf-7cbc317aac29","Type":"ContainerStarted","Data":"8416d6f17bf8d010b0fc15494546dc3c07d5843db209965245070f1177463a0a"} May 21 16:11:56.518931 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:56.518908 2547 generic.go:358] "Generic (PLEG): container finished" podID="57b0c522-cbfe-4c72-9396-646d4d893a0a" containerID="a5ccded2241ddea7656e1d1023bdc08540a51fbe9b1a7f8de948c8148b114bac" exitCode=0 May 21 16:11:56.519026 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:56.518941 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8kpd" event={"ID":"57b0c522-cbfe-4c72-9396-646d4d893a0a","Type":"ContainerDied","Data":"a5ccded2241ddea7656e1d1023bdc08540a51fbe9b1a7f8de948c8148b114bac"} May 21 16:11:56.519092 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:56.519016 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-vbmn8" podStartSLOduration=3.668596406 podStartE2EDuration="21.519003091s" podCreationTimestamp="2026-05-21 16:11:35 +0000 UTC" firstStartedPulling="2026-05-21 16:11:37.925136319 +0000 UTC m=+3.223857198" lastFinishedPulling="2026-05-21 16:11:55.77554299 +0000 UTC m=+21.074263883" observedRunningTime="2026-05-21 16:11:56.518783449 +0000 UTC m=+21.817504353" watchObservedRunningTime="2026-05-21 16:11:56.519003091 +0000 UTC m=+21.817723990" May 21 16:11:56.532339 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:56.532188 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t7qlr" podStartSLOduration=3.674150633 podStartE2EDuration="21.532174751s" podCreationTimestamp="2026-05-21 16:11:35 +0000 UTC" firstStartedPulling="2026-05-21 16:11:37.918245745 +0000 UTC m=+3.216966637" lastFinishedPulling="2026-05-21 16:11:55.776269872 +0000 UTC m=+21.074990755" observedRunningTime="2026-05-21 16:11:56.531889739 +0000 UTC m=+21.830610639" watchObservedRunningTime="2026-05-21 16:11:56.532174751 +0000 UTC m=+21.830895651" May 21 16:11:56.547403 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:56.547358 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-85k9r" podStartSLOduration=3.693534056 podStartE2EDuration="21.547343905s" podCreationTimestamp="2026-05-21 16:11:35 +0000 UTC" firstStartedPulling="2026-05-21 16:11:37.923459455 +0000 UTC m=+3.222180332" lastFinishedPulling="2026-05-21 16:11:55.777269297 +0000 UTC m=+21.075990181" observedRunningTime="2026-05-21 16:11:56.546661121 +0000 UTC m=+21.845382032" watchObservedRunningTime="2026-05-21 16:11:56.547343905 +0000 UTC m=+21.846064806" May 21 16:11:56.561315 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:56.561266 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-44tws" podStartSLOduration=8.408542228 podStartE2EDuration="21.561250972s" podCreationTimestamp="2026-05-21 16:11:35 +0000 UTC" firstStartedPulling="2026-05-21 16:11:37.918607912 +0000 UTC m=+3.217328790" lastFinishedPulling="2026-05-21 16:11:51.071316654 +0000 UTC m=+16.370037534" observedRunningTime="2026-05-21 16:11:56.560228863 +0000 UTC m=+21.858949763" watchObservedRunningTime="2026-05-21 16:11:56.561250972 +0000 UTC m=+21.859971874" May 21 16:11:56.576849 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:56.576784 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-8crv6" podStartSLOduration=3.708286193 podStartE2EDuration="21.576766315s" podCreationTimestamp="2026-05-21 16:11:35 +0000 UTC" firstStartedPulling="2026-05-21 16:11:37.919304146 +0000 UTC m=+3.218025041" lastFinishedPulling="2026-05-21 16:11:55.787784281 +0000 UTC m=+21.086505163" observedRunningTime="2026-05-21 16:11:56.576283433 +0000 UTC m=+21.875004333" watchObservedRunningTime="2026-05-21 16:11:56.576766315 +0000 UTC m=+21.875487196" May 21 16:11:57.295224 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:57.295062 2547 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 16:11:57.327516 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:57.327481 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:11:57.327660 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:57.327481 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:11:57.327660 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:57.327610 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49jxl" podUID="44a88f02-4431-4214-9629-d63db994abfe" May 21 16:11:57.327660 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:57.327640 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lmq6k" podUID="f4204967-d20e-4283-935c-a6e32ad1aba9" May 21 16:11:57.464722 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:57.464647 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t7qlr" May 21 16:11:57.523540 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:57.523513 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/ovn-acl-logging/0.log" May 21 16:11:57.524029 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:57.523829 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" event={"ID":"e219263f-6a61-44ab-ab60-b90f74c6de79","Type":"ContainerStarted","Data":"ed0670c0bff451246d66f4c8b669278c0c1d0d964bee1375a392620bd03715dd"} May 21 16:11:57.526229 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:57.526197 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" event={"ID":"4903b299-31c8-4a3d-a403-0fea568003b1","Type":"ContainerStarted","Data":"7dae1a749e34587a21984f7b7b991e651adf59a63d511a8494b41b4326757be0"} May 21 16:11:57.528061 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:57.528023 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hwbq8" event={"ID":"5d0103be-1e45-4ea4-9c18-bbc13773e537","Type":"ContainerStarted","Data":"b3bc8064cea69a38ca951600e4d267d275aef67653cf531fb019be8f3019c7b8"} May 21 16:11:57.543892 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:57.543845 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hwbq8" podStartSLOduration=4.680829428 podStartE2EDuration="22.543812381s" podCreationTimestamp="2026-05-21 16:11:35 +0000 UTC" firstStartedPulling="2026-05-21 16:11:37.912636322 +0000 UTC m=+3.211357213" lastFinishedPulling="2026-05-21 16:11:55.775619273 +0000 UTC m=+21.074340166" observedRunningTime="2026-05-21 16:11:57.543635158 +0000 UTC m=+22.842356057" watchObservedRunningTime="2026-05-21 16:11:57.543812381 +0000 UTC m=+22.842533281" May 21 16:11:58.265386 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:58.265291 2547 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T16:11:57.295218806Z","UUID":"c87c5ad1-74cc-4e32-9b3e-567286f641af","Handler":null,"Name":"","Endpoint":""} May 21 16:11:58.268435 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:58.268413 2547 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 16:11:58.268520 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:58.268443 2547 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 16:11:58.531496 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:58.531415 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" event={"ID":"4903b299-31c8-4a3d-a403-0fea568003b1","Type":"ContainerStarted","Data":"693fbed4f81bc381cfef9e550eba62d3abe2d2e84058809271decf2d2a04940b"} May 21 16:11:59.327737 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:59.327696 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:11:59.327936 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:59.327696 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:11:59.327936 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:59.327852 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49jxl" podUID="44a88f02-4431-4214-9629-d63db994abfe" May 21 16:11:59.327936 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:11:59.327886 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lmq6k" podUID="f4204967-d20e-4283-935c-a6e32ad1aba9" May 21 16:11:59.538399 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:59.538370 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/ovn-acl-logging/0.log" May 21 16:11:59.538956 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:11:59.538702 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" event={"ID":"e219263f-6a61-44ab-ab60-b90f74c6de79","Type":"ContainerStarted","Data":"5e35c2b7c79907997406e6682c577e051e7d96a4f60ccfcac8bb7452892c9843"} May 21 16:12:01.328123 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:01.327883 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:12:01.328650 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:01.327883 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:12:01.328650 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:01.328246 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lmq6k" podUID="f4204967-d20e-4283-935c-a6e32ad1aba9" May 21 16:12:01.328650 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:01.328332 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49jxl" podUID="44a88f02-4431-4214-9629-d63db994abfe" May 21 16:12:01.438862 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:01.438803 2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t7qlr" May 21 16:12:01.439451 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:01.439421 2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t7qlr" May 21 16:12:01.456090 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:01.456034 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mqcfg" podStartSLOduration=6.106976525 podStartE2EDuration="26.456018438s" podCreationTimestamp="2026-05-21 16:11:35 +0000 UTC" firstStartedPulling="2026-05-21 16:11:37.919959901 +0000 UTC m=+3.218680782" lastFinishedPulling="2026-05-21 16:11:58.269001813 +0000 UTC m=+23.567722695" observedRunningTime="2026-05-21 16:11:58.549590057 +0000 UTC m=+23.848310957" watchObservedRunningTime="2026-05-21 16:12:01.456018438 +0000 UTC m=+26.754739338" May 21 16:12:01.545591 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:01.545567 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/ovn-acl-logging/0.log" May 21 16:12:01.545945 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:01.545918 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" event={"ID":"e219263f-6a61-44ab-ab60-b90f74c6de79","Type":"ContainerStarted","Data":"6e38224ac062a1a0d28228181e2f3d5aff7a3a71b3631ebd37c2eb97a4b2f0e4"} May 21 16:12:01.546383 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:01.546363 2547 scope.go:117] "RemoveContainer" containerID="78d433eef28837d7d58c1b1158faba31a7c0ddf8bfc2cc66fdc9ba7b6816edad" May 21 16:12:01.547015 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:01.547000 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t7qlr" May 21 16:12:02.551703 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:02.551677 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/ovn-acl-logging/0.log" May 21 16:12:02.552196 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:02.552110 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" event={"ID":"e219263f-6a61-44ab-ab60-b90f74c6de79","Type":"ContainerStarted","Data":"e5acbac88e047be776409d59a91a09f15d48f028bde8da2b381f3f87e25f1ae0"} May 21 16:12:02.552697 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:02.552662 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:12:02.552868 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:02.552847 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:12:02.552956 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:02.552879 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:12:02.570373 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:02.570346 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:12:02.574321 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:02.574300 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:12:02.584829 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:02.584778 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" podStartSLOduration=9.682143056 podStartE2EDuration="27.584766235s" podCreationTimestamp="2026-05-21 16:11:35 +0000 UTC" firstStartedPulling="2026-05-21 16:11:37.921656335 +0000 UTC m=+3.220377220" lastFinishedPulling="2026-05-21 16:11:55.824279508 +0000 UTC m=+21.123000399" observedRunningTime="2026-05-21 16:12:02.583275006 +0000 UTC m=+27.881995906" watchObservedRunningTime="2026-05-21 16:12:02.584766235 +0000 UTC m=+27.883487169" May 21 16:12:02.705875 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:02.705840 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lmq6k"] May 21 16:12:02.706056 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:02.705978 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:12:02.706110 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:02.706073 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lmq6k" podUID="f4204967-d20e-4283-935c-a6e32ad1aba9" May 21 16:12:02.706633 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:02.706614 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-49jxl"] May 21 16:12:02.706734 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:02.706721 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:12:02.706884 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:02.706810 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49jxl" podUID="44a88f02-4431-4214-9629-d63db994abfe" May 21 16:12:04.327696 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:04.327536 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:12:04.328154 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:04.327536 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:12:04.328154 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:04.327777 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lmq6k" podUID="f4204967-d20e-4283-935c-a6e32ad1aba9" May 21 16:12:04.328154 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:04.327866 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49jxl" podUID="44a88f02-4431-4214-9629-d63db994abfe" May 21 16:12:04.557231 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:04.557194 2547 generic.go:358] "Generic (PLEG): container finished" podID="57b0c522-cbfe-4c72-9396-646d4d893a0a" containerID="8b175f8cd5c391c3ce9d69b5f6d24c3dc2125eb64415d6eca9869fc31e912817" exitCode=0 May 21 16:12:04.557391 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:04.557278 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8kpd" event={"ID":"57b0c522-cbfe-4c72-9396-646d4d893a0a","Type":"ContainerDied","Data":"8b175f8cd5c391c3ce9d69b5f6d24c3dc2125eb64415d6eca9869fc31e912817"} May 21 16:12:05.560275 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:05.560184 2547 generic.go:358] "Generic (PLEG): container finished" podID="57b0c522-cbfe-4c72-9396-646d4d893a0a" containerID="aae9de8102f3b1ef44a9376684eeac1ce98ee0fea64e518fe2f56687d9aae1b9" exitCode=0 May 21 16:12:05.560275 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:05.560232 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8kpd" event={"ID":"57b0c522-cbfe-4c72-9396-646d4d893a0a","Type":"ContainerDied","Data":"aae9de8102f3b1ef44a9376684eeac1ce98ee0fea64e518fe2f56687d9aae1b9"} May 21 16:12:06.327536 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:06.327494 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:12:06.327536 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:06.327520 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:12:06.327776 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:06.327621 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lmq6k" podUID="f4204967-d20e-4283-935c-a6e32ad1aba9" May 21 16:12:06.327776 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:06.327738 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49jxl" podUID="44a88f02-4431-4214-9629-d63db994abfe" May 21 16:12:06.564852 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:06.564725 2547 generic.go:358] "Generic (PLEG): container finished" podID="57b0c522-cbfe-4c72-9396-646d4d893a0a" containerID="a47b6ddeefacf250ffac491ca0de47efd1693a9e9a90be11e9995587224a38b4" exitCode=0 May 21 16:12:06.564852 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:06.564780 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8kpd" event={"ID":"57b0c522-cbfe-4c72-9396-646d4d893a0a","Type":"ContainerDied","Data":"a47b6ddeefacf250ffac491ca0de47efd1693a9e9a90be11e9995587224a38b4"} May 21 16:12:08.327462 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.327427 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:12:08.328246 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.327439 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:12:08.328246 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:08.327569 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lmq6k" podUID="f4204967-d20e-4283-935c-a6e32ad1aba9" May 21 16:12:08.328246 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:08.327645 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49jxl" podUID="44a88f02-4431-4214-9629-d63db994abfe" May 21 16:12:08.501718 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.501687 2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeReady" May 21 16:12:08.501895 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.501854 2547 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 16:12:08.556723 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.556690 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-984s7"] May 21 16:12:08.559440 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.559414 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-984s7" May 21 16:12:08.559723 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.559697 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-82shb"] May 21 16:12:08.562843 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.562808 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 16:12:08.562934 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.562874 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-82shb" May 21 16:12:08.562934 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.562898 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xl8jw\"" May 21 16:12:08.563144 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.563122 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 16:12:08.566024 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.566001 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 16:12:08.566024 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.566021 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 16:12:08.566172 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.566040 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-94pnq\"" May 21 16:12:08.566595 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.566385 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 16:12:08.573352 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.573327 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-984s7"] May 21 16:12:08.586679 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.586617 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-82shb"] May 21 16:12:08.634590 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.634561 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44ebd433-29f6-4471-8518-b23a3b13be79-tmp-dir\") pod \"dns-default-984s7\" (UID: \"44ebd433-29f6-4471-8518-b23a3b13be79\") " pod="openshift-dns/dns-default-984s7" May 21 16:12:08.634590 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.634604 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert\") pod \"ingress-canary-82shb\" (UID: \"0593535c-9146-4f09-8845-dc1bd5e79c6b\") " pod="openshift-ingress-canary/ingress-canary-82shb" May 21 16:12:08.634837 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.634632 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhzqs\" (UniqueName: \"kubernetes.io/projected/0593535c-9146-4f09-8845-dc1bd5e79c6b-kube-api-access-nhzqs\") pod \"ingress-canary-82shb\" (UID: \"0593535c-9146-4f09-8845-dc1bd5e79c6b\") " pod="openshift-ingress-canary/ingress-canary-82shb" May 21 16:12:08.634837 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.634711 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79w5x\" (UniqueName: \"kubernetes.io/projected/44ebd433-29f6-4471-8518-b23a3b13be79-kube-api-access-79w5x\") pod \"dns-default-984s7\" (UID: \"44ebd433-29f6-4471-8518-b23a3b13be79\") " pod="openshift-dns/dns-default-984s7" May 21 16:12:08.634837 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.634762 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls\") pod \"dns-default-984s7\" (UID: \"44ebd433-29f6-4471-8518-b23a3b13be79\") " pod="openshift-dns/dns-default-984s7" May 21 16:12:08.634958 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.634881 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/44ebd433-29f6-4471-8518-b23a3b13be79-config-volume\") pod \"dns-default-984s7\" (UID: \"44ebd433-29f6-4471-8518-b23a3b13be79\") " pod="openshift-dns/dns-default-984s7" May 21 16:12:08.735662 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.735627 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/44ebd433-29f6-4471-8518-b23a3b13be79-config-volume\") pod \"dns-default-984s7\" (UID: \"44ebd433-29f6-4471-8518-b23a3b13be79\") " pod="openshift-dns/dns-default-984s7" May 21 16:12:08.735866 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.735693 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44ebd433-29f6-4471-8518-b23a3b13be79-tmp-dir\") pod \"dns-default-984s7\" (UID: \"44ebd433-29f6-4471-8518-b23a3b13be79\") " pod="openshift-dns/dns-default-984s7" May 21 16:12:08.735866 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.735720 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert\") pod \"ingress-canary-82shb\" (UID: \"0593535c-9146-4f09-8845-dc1bd5e79c6b\") " pod="openshift-ingress-canary/ingress-canary-82shb" May 21 16:12:08.735866 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.735745 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhzqs\" (UniqueName: \"kubernetes.io/projected/0593535c-9146-4f09-8845-dc1bd5e79c6b-kube-api-access-nhzqs\") pod \"ingress-canary-82shb\" (UID: \"0593535c-9146-4f09-8845-dc1bd5e79c6b\") " pod="openshift-ingress-canary/ingress-canary-82shb" May 21 16:12:08.735866 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.735771 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79w5x\" (UniqueName: \"kubernetes.io/projected/44ebd433-29f6-4471-8518-b23a3b13be79-kube-api-access-79w5x\") pod \"dns-default-984s7\" (UID: \"44ebd433-29f6-4471-8518-b23a3b13be79\") " pod="openshift-dns/dns-default-984s7" May 21 16:12:08.735866 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.735794 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls\") pod \"dns-default-984s7\" (UID: \"44ebd433-29f6-4471-8518-b23a3b13be79\") " pod="openshift-dns/dns-default-984s7" May 21 16:12:08.736127 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:08.735882 2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 16:12:08.736127 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:08.735954 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert podName:0593535c-9146-4f09-8845-dc1bd5e79c6b nodeName:}" failed. No retries permitted until 2026-05-21 16:12:09.23593417 +0000 UTC m=+34.534655051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert") pod "ingress-canary-82shb" (UID: "0593535c-9146-4f09-8845-dc1bd5e79c6b") : secret "canary-serving-cert" not found May 21 16:12:08.736127 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:08.735974 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 16:12:08.736127 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:08.736038 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls podName:44ebd433-29f6-4471-8518-b23a3b13be79 nodeName:}" failed. No retries permitted until 2026-05-21 16:12:09.236020423 +0000 UTC m=+34.534741316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls") pod "dns-default-984s7" (UID: "44ebd433-29f6-4471-8518-b23a3b13be79") : secret "dns-default-metrics-tls" not found May 21 16:12:08.736321 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.736158 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44ebd433-29f6-4471-8518-b23a3b13be79-tmp-dir\") pod \"dns-default-984s7\" (UID: \"44ebd433-29f6-4471-8518-b23a3b13be79\") " pod="openshift-dns/dns-default-984s7" May 21 16:12:08.736383 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.736363 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/44ebd433-29f6-4471-8518-b23a3b13be79-config-volume\") pod \"dns-default-984s7\" (UID: \"44ebd433-29f6-4471-8518-b23a3b13be79\") " pod="openshift-dns/dns-default-984s7" May 21 16:12:08.747638 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.747490 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79w5x\" (UniqueName: \"kubernetes.io/projected/44ebd433-29f6-4471-8518-b23a3b13be79-kube-api-access-79w5x\") pod \"dns-default-984s7\" (UID: \"44ebd433-29f6-4471-8518-b23a3b13be79\") " pod="openshift-dns/dns-default-984s7" May 21 16:12:08.747797 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.747744 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhzqs\" (UniqueName: \"kubernetes.io/projected/0593535c-9146-4f09-8845-dc1bd5e79c6b-kube-api-access-nhzqs\") pod \"ingress-canary-82shb\" (UID: \"0593535c-9146-4f09-8845-dc1bd5e79c6b\") " pod="openshift-ingress-canary/ingress-canary-82shb" May 21 16:12:08.937255 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:08.937144 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs\") pod \"network-metrics-daemon-49jxl\" (UID: \"44a88f02-4431-4214-9629-d63db994abfe\") " pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:12:08.937396 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:08.937296 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:12:08.937396 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:08.937372 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs podName:44a88f02-4431-4214-9629-d63db994abfe nodeName:}" failed. No retries permitted until 2026-05-21 16:12:40.937351093 +0000 UTC m=+66.236071972 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs") pod "network-metrics-daemon-49jxl" (UID: "44a88f02-4431-4214-9629-d63db994abfe") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 16:12:09.038539 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:09.038507 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbwhd\" (UniqueName: \"kubernetes.io/projected/f4204967-d20e-4283-935c-a6e32ad1aba9-kube-api-access-xbwhd\") pod \"network-check-target-lmq6k\" (UID: \"f4204967-d20e-4283-935c-a6e32ad1aba9\") " pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:12:09.038743 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:09.038719 2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 16:12:09.038841 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:09.038747 2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 16:12:09.038841 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:09.038757 2547 projected.go:194] Error preparing data for projected volume kube-api-access-xbwhd for pod openshift-network-diagnostics/network-check-target-lmq6k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:12:09.038841 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:09.038808 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4204967-d20e-4283-935c-a6e32ad1aba9-kube-api-access-xbwhd podName:f4204967-d20e-4283-935c-a6e32ad1aba9 nodeName:}" failed. No retries permitted until 2026-05-21 16:12:41.038794358 +0000 UTC m=+66.337515236 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xbwhd" (UniqueName: "kubernetes.io/projected/f4204967-d20e-4283-935c-a6e32ad1aba9-kube-api-access-xbwhd") pod "network-check-target-lmq6k" (UID: "f4204967-d20e-4283-935c-a6e32ad1aba9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 16:12:09.240195 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:09.240098 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls\") pod \"dns-default-984s7\" (UID: \"44ebd433-29f6-4471-8518-b23a3b13be79\") " pod="openshift-dns/dns-default-984s7" May 21 16:12:09.240363 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:09.240216 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert\") pod \"ingress-canary-82shb\" (UID: \"0593535c-9146-4f09-8845-dc1bd5e79c6b\") " pod="openshift-ingress-canary/ingress-canary-82shb" May 21 16:12:09.240363 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:09.240274 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 16:12:09.240363 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:09.240312 2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 16:12:09.240363 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:09.240348 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls podName:44ebd433-29f6-4471-8518-b23a3b13be79 nodeName:}" failed. No retries permitted until 2026-05-21 16:12:10.240329195 +0000 UTC m=+35.539050076 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls") pod "dns-default-984s7" (UID: "44ebd433-29f6-4471-8518-b23a3b13be79") : secret "dns-default-metrics-tls" not found May 21 16:12:09.240602 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:09.240367 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert podName:0593535c-9146-4f09-8845-dc1bd5e79c6b nodeName:}" failed. No retries permitted until 2026-05-21 16:12:10.240357422 +0000 UTC m=+35.539078305 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert") pod "ingress-canary-82shb" (UID: "0593535c-9146-4f09-8845-dc1bd5e79c6b") : secret "canary-serving-cert" not found May 21 16:12:10.250056 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:10.250022 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert\") pod \"ingress-canary-82shb\" (UID: \"0593535c-9146-4f09-8845-dc1bd5e79c6b\") " pod="openshift-ingress-canary/ingress-canary-82shb" May 21 16:12:10.250056 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:10.250061 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls\") pod \"dns-default-984s7\" (UID: \"44ebd433-29f6-4471-8518-b23a3b13be79\") " pod="openshift-dns/dns-default-984s7" May 21 16:12:10.250466 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:10.250180 2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 16:12:10.250466 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:10.250202 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 16:12:10.250466 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:10.250248 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert podName:0593535c-9146-4f09-8845-dc1bd5e79c6b nodeName:}" failed. No retries permitted until 2026-05-21 16:12:12.250232328 +0000 UTC m=+37.548953205 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert") pod "ingress-canary-82shb" (UID: "0593535c-9146-4f09-8845-dc1bd5e79c6b") : secret "canary-serving-cert" not found May 21 16:12:10.250466 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:10.250262 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls podName:44ebd433-29f6-4471-8518-b23a3b13be79 nodeName:}" failed. No retries permitted until 2026-05-21 16:12:12.250256094 +0000 UTC m=+37.548976973 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls") pod "dns-default-984s7" (UID: "44ebd433-29f6-4471-8518-b23a3b13be79") : secret "dns-default-metrics-tls" not found May 21 16:12:10.327243 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:10.327212 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:12:10.327438 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:10.327212 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:12:10.330280 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:10.330257 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4jlj8\"" May 21 16:12:10.331361 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:10.331341 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 16:12:10.331490 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:10.331375 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 16:12:10.331714 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:10.331694 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8zt6m\"" May 21 16:12:10.332086 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:10.332066 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 16:12:12.266321 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:12.266274 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert\") pod \"ingress-canary-82shb\" (UID: \"0593535c-9146-4f09-8845-dc1bd5e79c6b\") " pod="openshift-ingress-canary/ingress-canary-82shb" May 21 16:12:12.266761 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:12.266325 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls\") pod \"dns-default-984s7\" (UID: \"44ebd433-29f6-4471-8518-b23a3b13be79\") " pod="openshift-dns/dns-default-984s7" May 21 16:12:12.266761 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:12.266450 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 16:12:12.266761 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:12.266529 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls podName:44ebd433-29f6-4471-8518-b23a3b13be79 nodeName:}" failed. No retries permitted until 2026-05-21 16:12:16.26650731 +0000 UTC m=+41.565228189 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls") pod "dns-default-984s7" (UID: "44ebd433-29f6-4471-8518-b23a3b13be79") : secret "dns-default-metrics-tls" not found May 21 16:12:12.266761 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:12.266452 2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 16:12:12.266761 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:12.266623 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert podName:0593535c-9146-4f09-8845-dc1bd5e79c6b nodeName:}" failed. No retries permitted until 2026-05-21 16:12:16.266604471 +0000 UTC m=+41.565325348 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert") pod "ingress-canary-82shb" (UID: "0593535c-9146-4f09-8845-dc1bd5e79c6b") : secret "canary-serving-cert" not found May 21 16:12:14.582356 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:14.582310 2547 generic.go:358] "Generic (PLEG): container finished" podID="57b0c522-cbfe-4c72-9396-646d4d893a0a" containerID="8d8248485fe3fd3459fb322ae9a93872377b180a739de05e25e5241fce0f7a31" exitCode=0 May 21 16:12:14.582728 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:14.582373 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8kpd" event={"ID":"57b0c522-cbfe-4c72-9396-646d4d893a0a","Type":"ContainerDied","Data":"8d8248485fe3fd3459fb322ae9a93872377b180a739de05e25e5241fce0f7a31"} May 21 16:12:15.586299 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:15.586263 2547 generic.go:358] "Generic (PLEG): container finished" podID="57b0c522-cbfe-4c72-9396-646d4d893a0a" containerID="1a03958de3d15212354819c84d722e0409626e24055c8fa09e850ad82ee5cb77" exitCode=0 May 21 16:12:15.586299 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:15.586302 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8kpd" event={"ID":"57b0c522-cbfe-4c72-9396-646d4d893a0a","Type":"ContainerDied","Data":"1a03958de3d15212354819c84d722e0409626e24055c8fa09e850ad82ee5cb77"} May 21 16:12:16.297756 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:16.297714 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert\") pod \"ingress-canary-82shb\" (UID: \"0593535c-9146-4f09-8845-dc1bd5e79c6b\") " pod="openshift-ingress-canary/ingress-canary-82shb" May 21 16:12:16.297756 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:16.297765 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls\") pod \"dns-default-984s7\" (UID: \"44ebd433-29f6-4471-8518-b23a3b13be79\") " pod="openshift-dns/dns-default-984s7" May 21 16:12:16.297992 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:16.297880 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 16:12:16.297992 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:16.297890 2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 16:12:16.297992 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:16.297932 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls podName:44ebd433-29f6-4471-8518-b23a3b13be79 nodeName:}" failed. No retries permitted until 2026-05-21 16:12:24.297918967 +0000 UTC m=+49.596639851 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls") pod "dns-default-984s7" (UID: "44ebd433-29f6-4471-8518-b23a3b13be79") : secret "dns-default-metrics-tls" not found May 21 16:12:16.297992 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:16.297952 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert podName:0593535c-9146-4f09-8845-dc1bd5e79c6b nodeName:}" failed. No retries permitted until 2026-05-21 16:12:24.29793884 +0000 UTC m=+49.596659719 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert") pod "ingress-canary-82shb" (UID: "0593535c-9146-4f09-8845-dc1bd5e79c6b") : secret "canary-serving-cert" not found May 21 16:12:16.591347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:16.591318 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g8kpd" event={"ID":"57b0c522-cbfe-4c72-9396-646d4d893a0a","Type":"ContainerStarted","Data":"5347c3fe5d584dabb278c4158509d10f5a1c286aa0134e68f144c15350774ee3"} May 21 16:12:16.614854 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:16.614784 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g8kpd" podStartSLOduration=5.990259758 podStartE2EDuration="41.6147655s" podCreationTimestamp="2026-05-21 16:11:35 +0000 UTC" firstStartedPulling="2026-05-21 16:11:37.925923579 +0000 UTC m=+3.224644462" lastFinishedPulling="2026-05-21 16:12:13.550429323 +0000 UTC m=+38.849150204" observedRunningTime="2026-05-21 16:12:16.613051543 +0000 UTC m=+41.911772457" watchObservedRunningTime="2026-05-21 16:12:16.6147655 +0000 UTC m=+41.913486403" May 21 16:12:24.354811 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:24.354769 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls\") pod \"dns-default-984s7\" (UID: \"44ebd433-29f6-4471-8518-b23a3b13be79\") " pod="openshift-dns/dns-default-984s7" May 21 16:12:24.355356 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:24.354868 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert\") pod \"ingress-canary-82shb\" (UID: \"0593535c-9146-4f09-8845-dc1bd5e79c6b\") " pod="openshift-ingress-canary/ingress-canary-82shb" May 21 16:12:24.355356 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:24.354954 2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 16:12:24.355356 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:24.354962 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 16:12:24.355356 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:24.355005 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert podName:0593535c-9146-4f09-8845-dc1bd5e79c6b nodeName:}" failed. No retries permitted until 2026-05-21 16:12:40.354991599 +0000 UTC m=+65.653712476 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert") pod "ingress-canary-82shb" (UID: "0593535c-9146-4f09-8845-dc1bd5e79c6b") : secret "canary-serving-cert" not found May 21 16:12:24.355356 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:24.355038 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls podName:44ebd433-29f6-4471-8518-b23a3b13be79 nodeName:}" failed. No retries permitted until 2026-05-21 16:12:40.355018659 +0000 UTC m=+65.653739539 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls") pod "dns-default-984s7" (UID: "44ebd433-29f6-4471-8518-b23a3b13be79") : secret "dns-default-metrics-tls" not found May 21 16:12:34.568227 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:34.568196 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xsq2k" May 21 16:12:40.366372 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:40.366331 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert\") pod \"ingress-canary-82shb\" (UID: \"0593535c-9146-4f09-8845-dc1bd5e79c6b\") " pod="openshift-ingress-canary/ingress-canary-82shb" May 21 16:12:40.366372 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:40.366374 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls\") pod \"dns-default-984s7\" (UID: \"44ebd433-29f6-4471-8518-b23a3b13be79\") " pod="openshift-dns/dns-default-984s7" May 21 16:12:40.366897 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:40.366479 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 16:12:40.366897 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:40.366480 2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 16:12:40.366897 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:40.366546 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls podName:44ebd433-29f6-4471-8518-b23a3b13be79 nodeName:}" failed. No retries permitted until 2026-05-21 16:13:12.366528588 +0000 UTC m=+97.665249470 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls") pod "dns-default-984s7" (UID: "44ebd433-29f6-4471-8518-b23a3b13be79") : secret "dns-default-metrics-tls" not found May 21 16:12:40.366897 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:40.366561 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert podName:0593535c-9146-4f09-8845-dc1bd5e79c6b nodeName:}" failed. No retries permitted until 2026-05-21 16:13:12.366553661 +0000 UTC m=+97.665274539 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert") pod "ingress-canary-82shb" (UID: "0593535c-9146-4f09-8845-dc1bd5e79c6b") : secret "canary-serving-cert" not found May 21 16:12:40.971534 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:40.971497 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs\") pod \"network-metrics-daemon-49jxl\" (UID: \"44a88f02-4431-4214-9629-d63db994abfe\") " pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:12:40.974253 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:40.974232 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 16:12:40.982487 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:40.982466 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 16:12:40.982574 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:12:40.982563 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs podName:44a88f02-4431-4214-9629-d63db994abfe nodeName:}" failed. No retries permitted until 2026-05-21 16:13:44.982518046 +0000 UTC m=+130.281238929 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs") pod "network-metrics-daemon-49jxl" (UID: "44a88f02-4431-4214-9629-d63db994abfe") : secret "metrics-daemon-secret" not found May 21 16:12:41.072140 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:41.072105 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbwhd\" (UniqueName: \"kubernetes.io/projected/f4204967-d20e-4283-935c-a6e32ad1aba9-kube-api-access-xbwhd\") pod \"network-check-target-lmq6k\" (UID: \"f4204967-d20e-4283-935c-a6e32ad1aba9\") " pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:12:41.074962 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:41.074942 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 16:12:41.084678 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:41.084660 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 16:12:41.095564 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:41.095539 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbwhd\" (UniqueName: \"kubernetes.io/projected/f4204967-d20e-4283-935c-a6e32ad1aba9-kube-api-access-xbwhd\") pod \"network-check-target-lmq6k\" (UID: \"f4204967-d20e-4283-935c-a6e32ad1aba9\") " pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:12:41.243720 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:41.243641 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8zt6m\"" May 21 16:12:41.251902 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:41.251874 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:12:41.381659 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:41.381626 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lmq6k"] May 21 16:12:41.384987 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:12:41.384954 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4204967_d20e_4283_935c_a6e32ad1aba9.slice/crio-3da532da032013a63cfaf69b2eb0fcb04c312386a15ec5912cd92d944a8d16dc WatchSource:0}: Error finding container 3da532da032013a63cfaf69b2eb0fcb04c312386a15ec5912cd92d944a8d16dc: Status 404 returned error can't find the container with id 3da532da032013a63cfaf69b2eb0fcb04c312386a15ec5912cd92d944a8d16dc May 21 16:12:41.639550 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:41.639505 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lmq6k" event={"ID":"f4204967-d20e-4283-935c-a6e32ad1aba9","Type":"ContainerStarted","Data":"3da532da032013a63cfaf69b2eb0fcb04c312386a15ec5912cd92d944a8d16dc"} May 21 16:12:44.645909 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:44.645868 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lmq6k" event={"ID":"f4204967-d20e-4283-935c-a6e32ad1aba9","Type":"ContainerStarted","Data":"2bd9c808220ef092debb295a2c62fdca424e4c5050ffddc56edeec9d618b4f75"} May 21 16:12:44.646265 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:44.645986 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:12:44.661357 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:12:44.661310 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lmq6k" podStartSLOduration=66.938406717 podStartE2EDuration="1m9.661298784s" podCreationTimestamp="2026-05-21 16:11:35 +0000 UTC" firstStartedPulling="2026-05-21 16:12:41.386682606 +0000 UTC m=+66.685403484" lastFinishedPulling="2026-05-21 16:12:44.109574654 +0000 UTC m=+69.408295551" observedRunningTime="2026-05-21 16:12:44.660940912 +0000 UTC m=+69.959661812" watchObservedRunningTime="2026-05-21 16:12:44.661298784 +0000 UTC m=+69.960019684" May 21 16:13:12.388534 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:12.388484 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert\") pod \"ingress-canary-82shb\" (UID: \"0593535c-9146-4f09-8845-dc1bd5e79c6b\") " pod="openshift-ingress-canary/ingress-canary-82shb" May 21 16:13:12.388534 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:12.388542 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls\") pod \"dns-default-984s7\" (UID: \"44ebd433-29f6-4471-8518-b23a3b13be79\") " pod="openshift-dns/dns-default-984s7" May 21 16:13:12.389007 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:12.388632 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 16:13:12.389007 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:12.388636 2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 16:13:12.389007 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:12.388686 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls podName:44ebd433-29f6-4471-8518-b23a3b13be79 nodeName:}" failed. No retries permitted until 2026-05-21 16:14:16.388671747 +0000 UTC m=+161.687392624 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls") pod "dns-default-984s7" (UID: "44ebd433-29f6-4471-8518-b23a3b13be79") : secret "dns-default-metrics-tls" not found May 21 16:13:12.389007 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:12.388727 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert podName:0593535c-9146-4f09-8845-dc1bd5e79c6b nodeName:}" failed. No retries permitted until 2026-05-21 16:14:16.388711001 +0000 UTC m=+161.687431895 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert") pod "ingress-canary-82shb" (UID: "0593535c-9146-4f09-8845-dc1bd5e79c6b") : secret "canary-serving-cert" not found May 21 16:13:15.650652 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:15.650618 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lmq6k" May 21 16:13:40.575336 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.575300 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-cmnmf"] May 21 16:13:40.579803 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.579773 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6f5959664-vpn5f"] May 21 16:13:40.579988 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.579947 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-cmnmf" May 21 16:13:40.581926 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.581904 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:13:40.582634 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.582610 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 16:13:40.583983 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.583962 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 21 16:13:40.584102 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.583964 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-c9ptl\"" May 21 16:13:40.584219 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.584192 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 21 16:13:40.584287 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.584227 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 16:13:40.584287 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.584252 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 21 16:13:40.585273 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.585255 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 16:13:40.585371 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.585355 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 21 16:13:40.585452 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.585437 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-bvgrw\"" May 21 16:13:40.585550 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.585512 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 21 16:13:40.585942 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.585895 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 16:13:40.586043 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.585895 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 21 16:13:40.586649 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.586630 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-cmnmf"] May 21 16:13:40.592416 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.592395 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f5959664-vpn5f"] May 21 16:13:40.673838 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.673792 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8jpcn"] May 21 16:13:40.675613 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.675598 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8jpcn" May 21 16:13:40.678333 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.678310 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 21 16:13:40.678468 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.678367 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 21 16:13:40.678468 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.678372 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-rcrhx\"" May 21 16:13:40.686358 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.686337 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8jpcn"] May 21 16:13:40.691224 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.691197 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7438a0cb-f85b-4259-8030-9c9840e39fb9-service-ca-bundle\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:13:40.691315 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.691240 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpzp5\" (UniqueName: \"kubernetes.io/projected/7438a0cb-f85b-4259-8030-9c9840e39fb9-kube-api-access-cpzp5\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:13:40.691315 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.691309 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-cmnmf\" (UID: \"a3e6e1c3-5727-4f92-aea9-075fa5ca85bb\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-cmnmf" May 21 16:13:40.691384 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.691353 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7438a0cb-f85b-4259-8030-9c9840e39fb9-metrics-certs\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:13:40.691416 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.691402 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-cmnmf\" (UID: \"a3e6e1c3-5727-4f92-aea9-075fa5ca85bb\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-cmnmf" May 21 16:13:40.691449 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.691433 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mvsx\" (UniqueName: \"kubernetes.io/projected/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-kube-api-access-7mvsx\") pod \"cluster-monitoring-operator-6c75959455-cmnmf\" (UID: \"a3e6e1c3-5727-4f92-aea9-075fa5ca85bb\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-cmnmf" May 21 16:13:40.691522 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.691458 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7438a0cb-f85b-4259-8030-9c9840e39fb9-default-certificate\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:13:40.691522 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.691483 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7438a0cb-f85b-4259-8030-9c9840e39fb9-stats-auth\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:13:40.778483 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.778445 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-lvpcz"] May 21 16:13:40.780405 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.780382 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lvpcz" May 21 16:13:40.782483 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.782463 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-z6wwz"] May 21 16:13:40.784424 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.784405 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-n5c9z"] May 21 16:13:40.784579 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.784563 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-z6wwz" May 21 16:13:40.784795 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.784771 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 21 16:13:40.785213 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.785193 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 21 16:13:40.785213 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.785206 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xx2th\"" May 21 16:13:40.785343 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.785254 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 21 16:13:40.785343 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.785295 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 21 16:13:40.786133 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.786118 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7cb47f7d76-kl985"] May 21 16:13:40.786305 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.786285 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-n5c9z" May 21 16:13:40.787326 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.787308 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 21 16:13:40.787803 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.787784 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 21 16:13:40.788035 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.787943 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:40.788140 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.787946 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 21 16:13:40.788511 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.788491 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-j4fbg\"" May 21 16:13:40.788662 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.788645 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 21 16:13:40.788739 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.788673 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 16:13:40.789062 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.789048 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 21 16:13:40.789157 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.789119 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 21 16:13:40.789291 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.789269 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 16:13:40.789349 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.789269 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-97zbg\"" May 21 16:13:40.791927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.791911 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7438a0cb-f85b-4259-8030-9c9840e39fb9-stats-auth\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:13:40.791995 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.791940 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7438a0cb-f85b-4259-8030-9c9840e39fb9-service-ca-bundle\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:13:40.791995 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.791963 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cpzp5\" (UniqueName: \"kubernetes.io/projected/7438a0cb-f85b-4259-8030-9c9840e39fb9-kube-api-access-cpzp5\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:13:40.792113 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.792014 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msc5q\" (UniqueName: \"kubernetes.io/projected/037c5e61-8bb7-474e-b47b-8e98725d9e6f-kube-api-access-msc5q\") pod \"volume-data-source-validator-5cf8c89d64-8jpcn\" (UID: \"037c5e61-8bb7-474e-b47b-8e98725d9e6f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8jpcn" May 21 16:13:40.792113 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:40.792059 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7438a0cb-f85b-4259-8030-9c9840e39fb9-service-ca-bundle podName:7438a0cb-f85b-4259-8030-9c9840e39fb9 nodeName:}" failed. No retries permitted until 2026-05-21 16:13:41.292042644 +0000 UTC m=+126.590763543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7438a0cb-f85b-4259-8030-9c9840e39fb9-service-ca-bundle") pod "router-default-6f5959664-vpn5f" (UID: "7438a0cb-f85b-4259-8030-9c9840e39fb9") : configmap references non-existent config key: service-ca.crt May 21 16:13:40.792237 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.792178 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-cmnmf\" (UID: \"a3e6e1c3-5727-4f92-aea9-075fa5ca85bb\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-cmnmf" May 21 16:13:40.792322 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.792241 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7438a0cb-f85b-4259-8030-9c9840e39fb9-metrics-certs\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:13:40.792322 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.792301 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-cmnmf\" (UID: \"a3e6e1c3-5727-4f92-aea9-075fa5ca85bb\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-cmnmf" May 21 16:13:40.792447 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.792332 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7mvsx\" (UniqueName: \"kubernetes.io/projected/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-kube-api-access-7mvsx\") pod \"cluster-monitoring-operator-6c75959455-cmnmf\" (UID: \"a3e6e1c3-5727-4f92-aea9-075fa5ca85bb\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-cmnmf" May 21 16:13:40.792447 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:40.792355 2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 16:13:40.792447 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.792359 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7438a0cb-f85b-4259-8030-9c9840e39fb9-default-certificate\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:13:40.792447 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:40.792414 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7438a0cb-f85b-4259-8030-9c9840e39fb9-metrics-certs podName:7438a0cb-f85b-4259-8030-9c9840e39fb9 nodeName:}" failed. No retries permitted until 2026-05-21 16:13:41.292397674 +0000 UTC m=+126.591118563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7438a0cb-f85b-4259-8030-9c9840e39fb9-metrics-certs") pod "router-default-6f5959664-vpn5f" (UID: "7438a0cb-f85b-4259-8030-9c9840e39fb9") : secret "router-metrics-certs-default" not found May 21 16:13:40.792447 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:40.792420 2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 16:13:40.792729 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:40.792466 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-cluster-monitoring-operator-tls podName:a3e6e1c3-5727-4f92-aea9-075fa5ca85bb nodeName:}" failed. No retries permitted until 2026-05-21 16:13:41.292452305 +0000 UTC m=+126.591173183 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-cmnmf" (UID: "a3e6e1c3-5727-4f92-aea9-075fa5ca85bb") : secret "cluster-monitoring-operator-tls" not found May 21 16:13:40.792807 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.792796 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 16:13:40.792807 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.792806 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 16:13:40.792993 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.792973 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 16:13:40.793056 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.792989 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-cmnmf\" (UID: \"a3e6e1c3-5727-4f92-aea9-075fa5ca85bb\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-cmnmf" May 21 16:13:40.793142 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.793125 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jpwrx\"" May 21 16:13:40.794796 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.794777 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7438a0cb-f85b-4259-8030-9c9840e39fb9-stats-auth\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:13:40.795105 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.795087 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7438a0cb-f85b-4259-8030-9c9840e39fb9-default-certificate\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:13:40.799444 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.797790 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 21 16:13:40.802624 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.800732 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-lvpcz"] May 21 16:13:40.802624 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.801999 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 16:13:40.804439 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.804417 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-z6wwz"] May 21 16:13:40.805532 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.805512 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-n5c9z"] May 21 16:13:40.808269 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.808238 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cb47f7d76-kl985"] May 21 16:13:40.816555 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.816530 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mvsx\" (UniqueName: \"kubernetes.io/projected/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-kube-api-access-7mvsx\") pod \"cluster-monitoring-operator-6c75959455-cmnmf\" (UID: \"a3e6e1c3-5727-4f92-aea9-075fa5ca85bb\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-cmnmf" May 21 16:13:40.816987 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.816963 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpzp5\" (UniqueName: \"kubernetes.io/projected/7438a0cb-f85b-4259-8030-9c9840e39fb9-kube-api-access-cpzp5\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:13:40.893274 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.893245 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/192b3e8b-5e9a-4390-bbe2-a481491eca79-serving-cert\") pod \"insights-operator-78bdfb888c-n5c9z\" (UID: \"192b3e8b-5e9a-4390-bbe2-a481491eca79\") " pod="openshift-insights/insights-operator-78bdfb888c-n5c9z" May 21 16:13:40.893441 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.893290 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhhlj\" (UniqueName: \"kubernetes.io/projected/192b3e8b-5e9a-4390-bbe2-a481491eca79-kube-api-access-fhhlj\") pod \"insights-operator-78bdfb888c-n5c9z\" (UID: \"192b3e8b-5e9a-4390-bbe2-a481491eca79\") " pod="openshift-insights/insights-operator-78bdfb888c-n5c9z" May 21 16:13:40.893441 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.893324 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/33505023-9fe3-4cad-a874-0b521d2f254e-image-registry-private-configuration\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:40.893441 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.893376 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/720b745b-9405-4dfd-b3cd-28f7a1841b92-config\") pod \"service-ca-operator-57b5b68b8-lvpcz\" (UID: \"720b745b-9405-4dfd-b3cd-28f7a1841b92\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lvpcz" May 21 16:13:40.893441 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.893407 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-registry-tls\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:40.893441 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.893436 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfw78\" (UniqueName: \"kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-kube-api-access-rfw78\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:40.893597 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.893459 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/066361a8-80f2-4d49-9f40-23277e538536-config\") pod \"kube-storage-version-migrator-operator-565644f49-z6wwz\" (UID: \"066361a8-80f2-4d49-9f40-23277e538536\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-z6wwz" May 21 16:13:40.893597 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.893501 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-msc5q\" (UniqueName: \"kubernetes.io/projected/037c5e61-8bb7-474e-b47b-8e98725d9e6f-kube-api-access-msc5q\") pod \"volume-data-source-validator-5cf8c89d64-8jpcn\" (UID: \"037c5e61-8bb7-474e-b47b-8e98725d9e6f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8jpcn" May 21 16:13:40.893597 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.893530 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/720b745b-9405-4dfd-b3cd-28f7a1841b92-serving-cert\") pod \"service-ca-operator-57b5b68b8-lvpcz\" (UID: \"720b745b-9405-4dfd-b3cd-28f7a1841b92\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lvpcz" May 21 16:13:40.893703 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.893615 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/33505023-9fe3-4cad-a874-0b521d2f254e-ca-trust-extracted\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:40.893756 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.893736 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-bound-sa-token\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:40.893844 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.893809 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99kb5\" (UniqueName: \"kubernetes.io/projected/720b745b-9405-4dfd-b3cd-28f7a1841b92-kube-api-access-99kb5\") pod \"service-ca-operator-57b5b68b8-lvpcz\" (UID: \"720b745b-9405-4dfd-b3cd-28f7a1841b92\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lvpcz" May 21 16:13:40.893907 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.893858 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/33505023-9fe3-4cad-a874-0b521d2f254e-installation-pull-secrets\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:40.893907 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.893885 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/066361a8-80f2-4d49-9f40-23277e538536-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-z6wwz\" (UID: \"066361a8-80f2-4d49-9f40-23277e538536\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-z6wwz" May 21 16:13:40.894008 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.893929 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33505023-9fe3-4cad-a874-0b521d2f254e-trusted-ca\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:40.894008 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.893996 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/192b3e8b-5e9a-4390-bbe2-a481491eca79-snapshots\") pod \"insights-operator-78bdfb888c-n5c9z\" (UID: \"192b3e8b-5e9a-4390-bbe2-a481491eca79\") " pod="openshift-insights/insights-operator-78bdfb888c-n5c9z" May 21 16:13:40.894100 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.894026 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/192b3e8b-5e9a-4390-bbe2-a481491eca79-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-n5c9z\" (UID: \"192b3e8b-5e9a-4390-bbe2-a481491eca79\") " pod="openshift-insights/insights-operator-78bdfb888c-n5c9z" May 21 16:13:40.894100 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.894053 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/192b3e8b-5e9a-4390-bbe2-a481491eca79-service-ca-bundle\") pod \"insights-operator-78bdfb888c-n5c9z\" (UID: \"192b3e8b-5e9a-4390-bbe2-a481491eca79\") " pod="openshift-insights/insights-operator-78bdfb888c-n5c9z" May 21 16:13:40.894100 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.894076 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/192b3e8b-5e9a-4390-bbe2-a481491eca79-tmp\") pod \"insights-operator-78bdfb888c-n5c9z\" (UID: \"192b3e8b-5e9a-4390-bbe2-a481491eca79\") " pod="openshift-insights/insights-operator-78bdfb888c-n5c9z" May 21 16:13:40.894211 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.894102 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/33505023-9fe3-4cad-a874-0b521d2f254e-registry-certificates\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:40.894211 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.894145 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qvhc\" (UniqueName: \"kubernetes.io/projected/066361a8-80f2-4d49-9f40-23277e538536-kube-api-access-2qvhc\") pod \"kube-storage-version-migrator-operator-565644f49-z6wwz\" (UID: \"066361a8-80f2-4d49-9f40-23277e538536\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-z6wwz" May 21 16:13:40.909304 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.909277 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msc5q\" (UniqueName: \"kubernetes.io/projected/037c5e61-8bb7-474e-b47b-8e98725d9e6f-kube-api-access-msc5q\") pod \"volume-data-source-validator-5cf8c89d64-8jpcn\" (UID: \"037c5e61-8bb7-474e-b47b-8e98725d9e6f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8jpcn" May 21 16:13:40.983692 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.983639 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8jpcn" May 21 16:13:40.994752 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.994723 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/720b745b-9405-4dfd-b3cd-28f7a1841b92-config\") pod \"service-ca-operator-57b5b68b8-lvpcz\" (UID: \"720b745b-9405-4dfd-b3cd-28f7a1841b92\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lvpcz" May 21 16:13:40.994871 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.994768 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-registry-tls\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:40.994871 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.994804 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rfw78\" (UniqueName: \"kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-kube-api-access-rfw78\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:40.994871 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.994851 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/066361a8-80f2-4d49-9f40-23277e538536-config\") pod \"kube-storage-version-migrator-operator-565644f49-z6wwz\" (UID: \"066361a8-80f2-4d49-9f40-23277e538536\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-z6wwz" May 21 16:13:40.995007 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:40.994892 2547 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 16:13:40.995007 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.994909 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/720b745b-9405-4dfd-b3cd-28f7a1841b92-serving-cert\") pod \"service-ca-operator-57b5b68b8-lvpcz\" (UID: \"720b745b-9405-4dfd-b3cd-28f7a1841b92\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lvpcz" May 21 16:13:40.995007 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:40.994917 2547 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cb47f7d76-kl985: secret "image-registry-tls" not found May 21 16:13:40.995007 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.994938 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/33505023-9fe3-4cad-a874-0b521d2f254e-ca-trust-extracted\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:40.995007 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:40.994986 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-registry-tls podName:33505023-9fe3-4cad-a874-0b521d2f254e nodeName:}" failed. No retries permitted until 2026-05-21 16:13:41.494963276 +0000 UTC m=+126.793684159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-registry-tls") pod "image-registry-7cb47f7d76-kl985" (UID: "33505023-9fe3-4cad-a874-0b521d2f254e") : secret "image-registry-tls" not found May 21 16:13:40.995245 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.995029 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-bound-sa-token\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:40.995245 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.995089 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-99kb5\" (UniqueName: \"kubernetes.io/projected/720b745b-9405-4dfd-b3cd-28f7a1841b92-kube-api-access-99kb5\") pod \"service-ca-operator-57b5b68b8-lvpcz\" (UID: \"720b745b-9405-4dfd-b3cd-28f7a1841b92\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lvpcz" May 21 16:13:40.995245 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.995118 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/33505023-9fe3-4cad-a874-0b521d2f254e-installation-pull-secrets\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:40.995245 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.995144 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/066361a8-80f2-4d49-9f40-23277e538536-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-z6wwz\" (UID: \"066361a8-80f2-4d49-9f40-23277e538536\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-z6wwz" May 21 16:13:40.995245 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.995189 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33505023-9fe3-4cad-a874-0b521d2f254e-trusted-ca\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:40.995501 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.995248 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/192b3e8b-5e9a-4390-bbe2-a481491eca79-snapshots\") pod \"insights-operator-78bdfb888c-n5c9z\" (UID: \"192b3e8b-5e9a-4390-bbe2-a481491eca79\") " pod="openshift-insights/insights-operator-78bdfb888c-n5c9z" May 21 16:13:40.995501 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.995278 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/192b3e8b-5e9a-4390-bbe2-a481491eca79-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-n5c9z\" (UID: \"192b3e8b-5e9a-4390-bbe2-a481491eca79\") " pod="openshift-insights/insights-operator-78bdfb888c-n5c9z" May 21 16:13:40.995501 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.995304 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/192b3e8b-5e9a-4390-bbe2-a481491eca79-service-ca-bundle\") pod \"insights-operator-78bdfb888c-n5c9z\" (UID: \"192b3e8b-5e9a-4390-bbe2-a481491eca79\") " pod="openshift-insights/insights-operator-78bdfb888c-n5c9z" May 21 16:13:40.995501 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.995330 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/192b3e8b-5e9a-4390-bbe2-a481491eca79-tmp\") pod \"insights-operator-78bdfb888c-n5c9z\" (UID: \"192b3e8b-5e9a-4390-bbe2-a481491eca79\") " pod="openshift-insights/insights-operator-78bdfb888c-n5c9z" May 21 16:13:40.995501 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.995351 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/33505023-9fe3-4cad-a874-0b521d2f254e-ca-trust-extracted\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:40.995501 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.995362 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/720b745b-9405-4dfd-b3cd-28f7a1841b92-config\") pod \"service-ca-operator-57b5b68b8-lvpcz\" (UID: \"720b745b-9405-4dfd-b3cd-28f7a1841b92\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lvpcz" May 21 16:13:40.995501 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.995355 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/33505023-9fe3-4cad-a874-0b521d2f254e-registry-certificates\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:40.995501 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.995481 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/066361a8-80f2-4d49-9f40-23277e538536-config\") pod \"kube-storage-version-migrator-operator-565644f49-z6wwz\" (UID: \"066361a8-80f2-4d49-9f40-23277e538536\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-z6wwz" May 21 16:13:40.995896 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.995572 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2qvhc\" (UniqueName: \"kubernetes.io/projected/066361a8-80f2-4d49-9f40-23277e538536-kube-api-access-2qvhc\") pod \"kube-storage-version-migrator-operator-565644f49-z6wwz\" (UID: \"066361a8-80f2-4d49-9f40-23277e538536\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-z6wwz" May 21 16:13:40.995896 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.995616 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/192b3e8b-5e9a-4390-bbe2-a481491eca79-serving-cert\") pod \"insights-operator-78bdfb888c-n5c9z\" (UID: \"192b3e8b-5e9a-4390-bbe2-a481491eca79\") " pod="openshift-insights/insights-operator-78bdfb888c-n5c9z" May 21 16:13:40.995896 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.995648 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fhhlj\" (UniqueName: \"kubernetes.io/projected/192b3e8b-5e9a-4390-bbe2-a481491eca79-kube-api-access-fhhlj\") pod \"insights-operator-78bdfb888c-n5c9z\" (UID: \"192b3e8b-5e9a-4390-bbe2-a481491eca79\") " pod="openshift-insights/insights-operator-78bdfb888c-n5c9z" May 21 16:13:40.995896 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.995673 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/33505023-9fe3-4cad-a874-0b521d2f254e-image-registry-private-configuration\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:40.996099 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.996044 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/33505023-9fe3-4cad-a874-0b521d2f254e-registry-certificates\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:40.996160 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.996128 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/192b3e8b-5e9a-4390-bbe2-a481491eca79-snapshots\") pod \"insights-operator-78bdfb888c-n5c9z\" (UID: \"192b3e8b-5e9a-4390-bbe2-a481491eca79\") " pod="openshift-insights/insights-operator-78bdfb888c-n5c9z" May 21 16:13:40.996661 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.996637 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/192b3e8b-5e9a-4390-bbe2-a481491eca79-service-ca-bundle\") pod \"insights-operator-78bdfb888c-n5c9z\" (UID: \"192b3e8b-5e9a-4390-bbe2-a481491eca79\") " pod="openshift-insights/insights-operator-78bdfb888c-n5c9z" May 21 16:13:40.997117 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.997096 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/192b3e8b-5e9a-4390-bbe2-a481491eca79-tmp\") pod \"insights-operator-78bdfb888c-n5c9z\" (UID: \"192b3e8b-5e9a-4390-bbe2-a481491eca79\") " pod="openshift-insights/insights-operator-78bdfb888c-n5c9z" May 21 16:13:40.997494 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.997462 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33505023-9fe3-4cad-a874-0b521d2f254e-trusted-ca\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:40.998138 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.998105 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/720b745b-9405-4dfd-b3cd-28f7a1841b92-serving-cert\") pod \"service-ca-operator-57b5b68b8-lvpcz\" (UID: \"720b745b-9405-4dfd-b3cd-28f7a1841b92\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lvpcz" May 21 16:13:40.998229 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.998181 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/066361a8-80f2-4d49-9f40-23277e538536-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-z6wwz\" (UID: \"066361a8-80f2-4d49-9f40-23277e538536\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-z6wwz" May 21 16:13:40.998286 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.998258 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/33505023-9fe3-4cad-a874-0b521d2f254e-image-registry-private-configuration\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:40.998286 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.998277 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/192b3e8b-5e9a-4390-bbe2-a481491eca79-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-n5c9z\" (UID: \"192b3e8b-5e9a-4390-bbe2-a481491eca79\") " pod="openshift-insights/insights-operator-78bdfb888c-n5c9z" May 21 16:13:40.998523 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.998504 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/192b3e8b-5e9a-4390-bbe2-a481491eca79-serving-cert\") pod \"insights-operator-78bdfb888c-n5c9z\" (UID: \"192b3e8b-5e9a-4390-bbe2-a481491eca79\") " pod="openshift-insights/insights-operator-78bdfb888c-n5c9z" May 21 16:13:40.998558 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:40.998530 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/33505023-9fe3-4cad-a874-0b521d2f254e-installation-pull-secrets\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:41.006505 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:41.006477 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfw78\" (UniqueName: \"kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-kube-api-access-rfw78\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:41.006794 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:41.006776 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99kb5\" (UniqueName: \"kubernetes.io/projected/720b745b-9405-4dfd-b3cd-28f7a1841b92-kube-api-access-99kb5\") pod \"service-ca-operator-57b5b68b8-lvpcz\" (UID: \"720b745b-9405-4dfd-b3cd-28f7a1841b92\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lvpcz" May 21 16:13:41.006901 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:41.006812 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qvhc\" (UniqueName: \"kubernetes.io/projected/066361a8-80f2-4d49-9f40-23277e538536-kube-api-access-2qvhc\") pod \"kube-storage-version-migrator-operator-565644f49-z6wwz\" (UID: \"066361a8-80f2-4d49-9f40-23277e538536\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-z6wwz" May 21 16:13:41.006901 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:41.006836 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-bound-sa-token\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:41.007362 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:41.007346 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhhlj\" (UniqueName: \"kubernetes.io/projected/192b3e8b-5e9a-4390-bbe2-a481491eca79-kube-api-access-fhhlj\") pod \"insights-operator-78bdfb888c-n5c9z\" (UID: \"192b3e8b-5e9a-4390-bbe2-a481491eca79\") " pod="openshift-insights/insights-operator-78bdfb888c-n5c9z" May 21 16:13:41.092269 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:41.092179 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lvpcz" May 21 16:13:41.102510 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:41.102477 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8jpcn"] May 21 16:13:41.105382 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:13:41.105351 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod037c5e61_8bb7_474e_b47b_8e98725d9e6f.slice/crio-011bba856bf6b0165eddbef6bf57f24b011d36cac9d44af0bab19dce87c2827e WatchSource:0}: Error finding container 011bba856bf6b0165eddbef6bf57f24b011d36cac9d44af0bab19dce87c2827e: Status 404 returned error can't find the container with id 011bba856bf6b0165eddbef6bf57f24b011d36cac9d44af0bab19dce87c2827e May 21 16:13:41.109575 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:41.109532 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-z6wwz" May 21 16:13:41.116358 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:41.116340 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-n5c9z" May 21 16:13:41.232034 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:41.231997 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-lvpcz"] May 21 16:13:41.235557 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:13:41.235523 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod720b745b_9405_4dfd_b3cd_28f7a1841b92.slice/crio-650fdbdc4a0e5157633403499e57c0e0bb16ede1674131325ee32c4e79961b6a WatchSource:0}: Error finding container 650fdbdc4a0e5157633403499e57c0e0bb16ede1674131325ee32c4e79961b6a: Status 404 returned error can't find the container with id 650fdbdc4a0e5157633403499e57c0e0bb16ede1674131325ee32c4e79961b6a May 21 16:13:41.247635 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:41.247608 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-z6wwz"] May 21 16:13:41.250904 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:13:41.250879 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod066361a8_80f2_4d49_9f40_23277e538536.slice/crio-f5c02d864d9e1e4204b4e0b78e3b42d9cc04af23fe6d43cbbfe397d8a43c64ac WatchSource:0}: Error finding container f5c02d864d9e1e4204b4e0b78e3b42d9cc04af23fe6d43cbbfe397d8a43c64ac: Status 404 returned error can't find the container with id f5c02d864d9e1e4204b4e0b78e3b42d9cc04af23fe6d43cbbfe397d8a43c64ac May 21 16:13:41.264284 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:41.264260 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-n5c9z"] May 21 16:13:41.267074 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:13:41.267048 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod192b3e8b_5e9a_4390_bbe2_a481491eca79.slice/crio-7c9867ae7a5d5aa5db3e8229b88bc60af00718f24b7360af261ab0c110626a3a WatchSource:0}: Error finding container 7c9867ae7a5d5aa5db3e8229b88bc60af00718f24b7360af261ab0c110626a3a: Status 404 returned error can't find the container with id 7c9867ae7a5d5aa5db3e8229b88bc60af00718f24b7360af261ab0c110626a3a May 21 16:13:41.297917 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:41.297880 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7438a0cb-f85b-4259-8030-9c9840e39fb9-service-ca-bundle\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:13:41.298061 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:41.298039 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7438a0cb-f85b-4259-8030-9c9840e39fb9-metrics-certs\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:13:41.298123 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:41.298055 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7438a0cb-f85b-4259-8030-9c9840e39fb9-service-ca-bundle podName:7438a0cb-f85b-4259-8030-9c9840e39fb9 nodeName:}" failed. No retries permitted until 2026-05-21 16:13:42.298032441 +0000 UTC m=+127.596753323 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7438a0cb-f85b-4259-8030-9c9840e39fb9-service-ca-bundle") pod "router-default-6f5959664-vpn5f" (UID: "7438a0cb-f85b-4259-8030-9c9840e39fb9") : configmap references non-existent config key: service-ca.crt May 21 16:13:41.298188 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:41.298123 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-cmnmf\" (UID: \"a3e6e1c3-5727-4f92-aea9-075fa5ca85bb\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-cmnmf" May 21 16:13:41.298188 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:41.298137 2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 16:13:41.298259 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:41.298192 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7438a0cb-f85b-4259-8030-9c9840e39fb9-metrics-certs podName:7438a0cb-f85b-4259-8030-9c9840e39fb9 nodeName:}" failed. No retries permitted until 2026-05-21 16:13:42.298176267 +0000 UTC m=+127.596897159 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7438a0cb-f85b-4259-8030-9c9840e39fb9-metrics-certs") pod "router-default-6f5959664-vpn5f" (UID: "7438a0cb-f85b-4259-8030-9c9840e39fb9") : secret "router-metrics-certs-default" not found May 21 16:13:41.298259 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:41.298245 2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 16:13:41.298324 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:41.298297 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-cluster-monitoring-operator-tls podName:a3e6e1c3-5727-4f92-aea9-075fa5ca85bb nodeName:}" failed. No retries permitted until 2026-05-21 16:13:42.29828303 +0000 UTC m=+127.597003925 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-cmnmf" (UID: "a3e6e1c3-5727-4f92-aea9-075fa5ca85bb") : secret "cluster-monitoring-operator-tls" not found May 21 16:13:41.499989 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:41.499896 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-registry-tls\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:41.500152 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:41.500024 2547 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 16:13:41.500152 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:41.500047 2547 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cb47f7d76-kl985: secret "image-registry-tls" not found May 21 16:13:41.500152 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:41.500114 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-registry-tls podName:33505023-9fe3-4cad-a874-0b521d2f254e nodeName:}" failed. No retries permitted until 2026-05-21 16:13:42.50009283 +0000 UTC m=+127.798813728 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-registry-tls") pod "image-registry-7cb47f7d76-kl985" (UID: "33505023-9fe3-4cad-a874-0b521d2f254e") : secret "image-registry-tls" not found May 21 16:13:41.759008 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:41.758919 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-n5c9z" event={"ID":"192b3e8b-5e9a-4390-bbe2-a481491eca79","Type":"ContainerStarted","Data":"7c9867ae7a5d5aa5db3e8229b88bc60af00718f24b7360af261ab0c110626a3a"} May 21 16:13:41.760165 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:41.760134 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-z6wwz" event={"ID":"066361a8-80f2-4d49-9f40-23277e538536","Type":"ContainerStarted","Data":"f5c02d864d9e1e4204b4e0b78e3b42d9cc04af23fe6d43cbbfe397d8a43c64ac"} May 21 16:13:41.761199 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:41.761174 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8jpcn" event={"ID":"037c5e61-8bb7-474e-b47b-8e98725d9e6f","Type":"ContainerStarted","Data":"011bba856bf6b0165eddbef6bf57f24b011d36cac9d44af0bab19dce87c2827e"} May 21 16:13:41.762275 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:41.762252 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lvpcz" event={"ID":"720b745b-9405-4dfd-b3cd-28f7a1841b92","Type":"ContainerStarted","Data":"650fdbdc4a0e5157633403499e57c0e0bb16ede1674131325ee32c4e79961b6a"} May 21 16:13:42.309187 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:42.308703 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-cmnmf\" (UID: \"a3e6e1c3-5727-4f92-aea9-075fa5ca85bb\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-cmnmf" May 21 16:13:42.309187 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:42.308832 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7438a0cb-f85b-4259-8030-9c9840e39fb9-service-ca-bundle\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:13:42.309187 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:42.308901 2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 16:13:42.309187 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:42.308992 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-cluster-monitoring-operator-tls podName:a3e6e1c3-5727-4f92-aea9-075fa5ca85bb nodeName:}" failed. No retries permitted until 2026-05-21 16:13:44.308967365 +0000 UTC m=+129.607688243 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-cmnmf" (UID: "a3e6e1c3-5727-4f92-aea9-075fa5ca85bb") : secret "cluster-monitoring-operator-tls" not found May 21 16:13:42.309187 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:42.308998 2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 16:13:42.309187 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:42.309048 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7438a0cb-f85b-4259-8030-9c9840e39fb9-metrics-certs podName:7438a0cb-f85b-4259-8030-9c9840e39fb9 nodeName:}" failed. No retries permitted until 2026-05-21 16:13:44.309032834 +0000 UTC m=+129.607753716 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7438a0cb-f85b-4259-8030-9c9840e39fb9-metrics-certs") pod "router-default-6f5959664-vpn5f" (UID: "7438a0cb-f85b-4259-8030-9c9840e39fb9") : secret "router-metrics-certs-default" not found May 21 16:13:42.309187 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:42.309119 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7438a0cb-f85b-4259-8030-9c9840e39fb9-service-ca-bundle podName:7438a0cb-f85b-4259-8030-9c9840e39fb9 nodeName:}" failed. No retries permitted until 2026-05-21 16:13:44.309108621 +0000 UTC m=+129.607829505 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7438a0cb-f85b-4259-8030-9c9840e39fb9-service-ca-bundle") pod "router-default-6f5959664-vpn5f" (UID: "7438a0cb-f85b-4259-8030-9c9840e39fb9") : configmap references non-existent config key: service-ca.crt May 21 16:13:42.309187 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:42.308912 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7438a0cb-f85b-4259-8030-9c9840e39fb9-metrics-certs\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:13:42.511427 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:42.511385 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-registry-tls\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:42.511590 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:42.511531 2547 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 16:13:42.511590 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:42.511549 2547 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cb47f7d76-kl985: secret "image-registry-tls" not found May 21 16:13:42.511707 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:42.511621 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-registry-tls podName:33505023-9fe3-4cad-a874-0b521d2f254e nodeName:}" failed. No retries permitted until 2026-05-21 16:13:44.51159816 +0000 UTC m=+129.810319052 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-registry-tls") pod "image-registry-7cb47f7d76-kl985" (UID: "33505023-9fe3-4cad-a874-0b521d2f254e") : secret "image-registry-tls" not found May 21 16:13:44.328087 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:44.328042 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7438a0cb-f85b-4259-8030-9c9840e39fb9-service-ca-bundle\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:13:44.328520 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:44.328141 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7438a0cb-f85b-4259-8030-9c9840e39fb9-metrics-certs\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:13:44.328520 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:44.328182 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-cmnmf\" (UID: \"a3e6e1c3-5727-4f92-aea9-075fa5ca85bb\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-cmnmf" May 21 16:13:44.328520 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:44.328241 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7438a0cb-f85b-4259-8030-9c9840e39fb9-service-ca-bundle podName:7438a0cb-f85b-4259-8030-9c9840e39fb9 nodeName:}" failed. No retries permitted until 2026-05-21 16:13:48.328220871 +0000 UTC m=+133.626941755 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7438a0cb-f85b-4259-8030-9c9840e39fb9-service-ca-bundle") pod "router-default-6f5959664-vpn5f" (UID: "7438a0cb-f85b-4259-8030-9c9840e39fb9") : configmap references non-existent config key: service-ca.crt May 21 16:13:44.328520 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:44.328313 2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 16:13:44.328520 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:44.328321 2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 16:13:44.328520 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:44.328394 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-cluster-monitoring-operator-tls podName:a3e6e1c3-5727-4f92-aea9-075fa5ca85bb nodeName:}" failed. No retries permitted until 2026-05-21 16:13:48.328380896 +0000 UTC m=+133.627101774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-cmnmf" (UID: "a3e6e1c3-5727-4f92-aea9-075fa5ca85bb") : secret "cluster-monitoring-operator-tls" not found May 21 16:13:44.328520 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:44.328413 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7438a0cb-f85b-4259-8030-9c9840e39fb9-metrics-certs podName:7438a0cb-f85b-4259-8030-9c9840e39fb9 nodeName:}" failed. No retries permitted until 2026-05-21 16:13:48.328403116 +0000 UTC m=+133.627123994 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7438a0cb-f85b-4259-8030-9c9840e39fb9-metrics-certs") pod "router-default-6f5959664-vpn5f" (UID: "7438a0cb-f85b-4259-8030-9c9840e39fb9") : secret "router-metrics-certs-default" not found May 21 16:13:44.529891 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:44.529848 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-registry-tls\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:44.530114 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:44.530085 2547 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 16:13:44.530114 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:44.530111 2547 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cb47f7d76-kl985: secret "image-registry-tls" not found May 21 16:13:44.530287 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:44.530169 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-registry-tls podName:33505023-9fe3-4cad-a874-0b521d2f254e nodeName:}" failed. No retries permitted until 2026-05-21 16:13:48.530151768 +0000 UTC m=+133.828872647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-registry-tls") pod "image-registry-7cb47f7d76-kl985" (UID: "33505023-9fe3-4cad-a874-0b521d2f254e") : secret "image-registry-tls" not found May 21 16:13:44.771984 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:44.771892 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8jpcn" event={"ID":"037c5e61-8bb7-474e-b47b-8e98725d9e6f","Type":"ContainerStarted","Data":"85e9b5c4d7c1f2253c0f3dd663ee6ce0c6403a76a90ff0ad4a38479d914a5dbc"} May 21 16:13:44.773522 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:44.773490 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lvpcz" event={"ID":"720b745b-9405-4dfd-b3cd-28f7a1841b92","Type":"ContainerStarted","Data":"fe898e8795a026311c527bbc95cd689ed6a522b8ce678f723d95226120b317eb"} May 21 16:13:44.774907 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:44.774870 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-n5c9z" event={"ID":"192b3e8b-5e9a-4390-bbe2-a481491eca79","Type":"ContainerStarted","Data":"ca76bdd6436514aaac5f7de349eb90d61050ca21cb574fb80890a7593c27212c"} May 21 16:13:44.776223 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:44.776192 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-z6wwz" event={"ID":"066361a8-80f2-4d49-9f40-23277e538536","Type":"ContainerStarted","Data":"ff2eb0e89f3e4ea62da94908b9cb20f57f928d3120c099e300ffe9be1be8126f"} May 21 16:13:44.788037 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:44.787974 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8jpcn" podStartSLOduration=1.56653618 podStartE2EDuration="4.787960141s" podCreationTimestamp="2026-05-21 16:13:40 +0000 UTC" firstStartedPulling="2026-05-21 16:13:41.107121299 +0000 UTC m=+126.405842180" lastFinishedPulling="2026-05-21 16:13:44.32854525 +0000 UTC m=+129.627266141" observedRunningTime="2026-05-21 16:13:44.787268211 +0000 UTC m=+130.085989110" watchObservedRunningTime="2026-05-21 16:13:44.787960141 +0000 UTC m=+130.086681045" May 21 16:13:44.804222 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:44.804173 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-z6wwz" podStartSLOduration=1.7216163249999998 podStartE2EDuration="4.804161093s" podCreationTimestamp="2026-05-21 16:13:40 +0000 UTC" firstStartedPulling="2026-05-21 16:13:41.252683838 +0000 UTC m=+126.551404719" lastFinishedPulling="2026-05-21 16:13:44.335228608 +0000 UTC m=+129.633949487" observedRunningTime="2026-05-21 16:13:44.803890653 +0000 UTC m=+130.102611553" watchObservedRunningTime="2026-05-21 16:13:44.804161093 +0000 UTC m=+130.102881992" May 21 16:13:44.821576 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:44.821524 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-n5c9z" podStartSLOduration=1.761569926 podStartE2EDuration="4.821507379s" podCreationTimestamp="2026-05-21 16:13:40 +0000 UTC" firstStartedPulling="2026-05-21 16:13:41.268719854 +0000 UTC m=+126.567440731" lastFinishedPulling="2026-05-21 16:13:44.328657305 +0000 UTC m=+129.627378184" observedRunningTime="2026-05-21 16:13:44.820512214 +0000 UTC m=+130.119233115" watchObservedRunningTime="2026-05-21 16:13:44.821507379 +0000 UTC m=+130.120228280" May 21 16:13:44.837758 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:44.837715 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lvpcz" podStartSLOduration=1.735636381 podStartE2EDuration="4.837702246s" podCreationTimestamp="2026-05-21 16:13:40 +0000 UTC" firstStartedPulling="2026-05-21 16:13:41.237329882 +0000 UTC m=+126.536050774" lastFinishedPulling="2026-05-21 16:13:44.339395753 +0000 UTC m=+129.638116639" observedRunningTime="2026-05-21 16:13:44.836707659 +0000 UTC m=+130.135428560" watchObservedRunningTime="2026-05-21 16:13:44.837702246 +0000 UTC m=+130.136423145" May 21 16:13:45.033941 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:45.033841 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs\") pod \"network-metrics-daemon-49jxl\" (UID: \"44a88f02-4431-4214-9629-d63db994abfe\") " pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:13:45.034104 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:45.033974 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 16:13:45.034104 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:45.034042 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs podName:44a88f02-4431-4214-9629-d63db994abfe nodeName:}" failed. No retries permitted until 2026-05-21 16:15:47.034026147 +0000 UTC m=+252.332747025 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs") pod "network-metrics-daemon-49jxl" (UID: "44a88f02-4431-4214-9629-d63db994abfe") : secret "metrics-daemon-secret" not found May 21 16:13:47.643773 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:47.643743 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vbmn8_7b9dc463-4392-4994-9467-5979208be3e2/dns-node-resolver/0.log" May 21 16:13:48.244976 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:48.244947 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-44tws_93d8872f-0f1e-49b5-9204-eb976993ff33/node-ca/0.log" May 21 16:13:48.364099 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:48.364064 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7438a0cb-f85b-4259-8030-9c9840e39fb9-service-ca-bundle\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:13:48.364289 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:48.364247 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7438a0cb-f85b-4259-8030-9c9840e39fb9-service-ca-bundle podName:7438a0cb-f85b-4259-8030-9c9840e39fb9 nodeName:}" failed. No retries permitted until 2026-05-21 16:13:56.364222578 +0000 UTC m=+141.662943455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7438a0cb-f85b-4259-8030-9c9840e39fb9-service-ca-bundle") pod "router-default-6f5959664-vpn5f" (UID: "7438a0cb-f85b-4259-8030-9c9840e39fb9") : configmap references non-existent config key: service-ca.crt May 21 16:13:48.364394 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:48.364288 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7438a0cb-f85b-4259-8030-9c9840e39fb9-metrics-certs\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:13:48.364394 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:48.364348 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-cmnmf\" (UID: \"a3e6e1c3-5727-4f92-aea9-075fa5ca85bb\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-cmnmf" May 21 16:13:48.364546 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:48.364464 2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 16:13:48.364546 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:48.364480 2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 16:13:48.364546 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:48.364530 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7438a0cb-f85b-4259-8030-9c9840e39fb9-metrics-certs podName:7438a0cb-f85b-4259-8030-9c9840e39fb9 nodeName:}" failed. No retries permitted until 2026-05-21 16:13:56.36451241 +0000 UTC m=+141.663233304 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7438a0cb-f85b-4259-8030-9c9840e39fb9-metrics-certs") pod "router-default-6f5959664-vpn5f" (UID: "7438a0cb-f85b-4259-8030-9c9840e39fb9") : secret "router-metrics-certs-default" not found May 21 16:13:48.364665 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:48.364550 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-cluster-monitoring-operator-tls podName:a3e6e1c3-5727-4f92-aea9-075fa5ca85bb nodeName:}" failed. No retries permitted until 2026-05-21 16:13:56.364541202 +0000 UTC m=+141.663262086 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-cmnmf" (UID: "a3e6e1c3-5727-4f92-aea9-075fa5ca85bb") : secret "cluster-monitoring-operator-tls" not found May 21 16:13:48.365194 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:48.365176 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-scn5c"] May 21 16:13:48.369142 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:48.369128 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-scn5c" May 21 16:13:48.372418 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:48.372398 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 21 16:13:48.372516 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:48.372397 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 21 16:13:48.373589 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:48.373565 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-wv942\"" May 21 16:13:48.373706 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:48.373605 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 21 16:13:48.373706 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:48.373615 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 21 16:13:48.377976 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:48.377954 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-scn5c"] May 21 16:13:48.465073 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:48.465033 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5f6302ad-c504-4bce-8d18-5952429ee5a7-signing-key\") pod \"service-ca-67d667c7d-scn5c\" (UID: \"5f6302ad-c504-4bce-8d18-5952429ee5a7\") " pod="openshift-service-ca/service-ca-67d667c7d-scn5c" May 21 16:13:48.465259 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:48.465095 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2vf4\" (UniqueName: \"kubernetes.io/projected/5f6302ad-c504-4bce-8d18-5952429ee5a7-kube-api-access-s2vf4\") pod \"service-ca-67d667c7d-scn5c\" (UID: \"5f6302ad-c504-4bce-8d18-5952429ee5a7\") " pod="openshift-service-ca/service-ca-67d667c7d-scn5c" May 21 16:13:48.465259 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:48.465187 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5f6302ad-c504-4bce-8d18-5952429ee5a7-signing-cabundle\") pod \"service-ca-67d667c7d-scn5c\" (UID: \"5f6302ad-c504-4bce-8d18-5952429ee5a7\") " pod="openshift-service-ca/service-ca-67d667c7d-scn5c" May 21 16:13:48.566565 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:48.566475 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2vf4\" (UniqueName: \"kubernetes.io/projected/5f6302ad-c504-4bce-8d18-5952429ee5a7-kube-api-access-s2vf4\") pod \"service-ca-67d667c7d-scn5c\" (UID: \"5f6302ad-c504-4bce-8d18-5952429ee5a7\") " pod="openshift-service-ca/service-ca-67d667c7d-scn5c" May 21 16:13:48.566565 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:48.566530 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-registry-tls\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:48.566743 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:48.566574 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5f6302ad-c504-4bce-8d18-5952429ee5a7-signing-cabundle\") pod \"service-ca-67d667c7d-scn5c\" (UID: \"5f6302ad-c504-4bce-8d18-5952429ee5a7\") " pod="openshift-service-ca/service-ca-67d667c7d-scn5c" May 21 16:13:48.566743 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:48.566623 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5f6302ad-c504-4bce-8d18-5952429ee5a7-signing-key\") pod \"service-ca-67d667c7d-scn5c\" (UID: \"5f6302ad-c504-4bce-8d18-5952429ee5a7\") " pod="openshift-service-ca/service-ca-67d667c7d-scn5c" May 21 16:13:48.566743 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:48.566684 2547 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 16:13:48.566743 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:48.566706 2547 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cb47f7d76-kl985: secret "image-registry-tls" not found May 21 16:13:48.566926 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:48.566759 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-registry-tls podName:33505023-9fe3-4cad-a874-0b521d2f254e nodeName:}" failed. No retries permitted until 2026-05-21 16:13:56.566738346 +0000 UTC m=+141.865459223 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-registry-tls") pod "image-registry-7cb47f7d76-kl985" (UID: "33505023-9fe3-4cad-a874-0b521d2f254e") : secret "image-registry-tls" not found May 21 16:13:48.567235 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:48.567214 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5f6302ad-c504-4bce-8d18-5952429ee5a7-signing-cabundle\") pod \"service-ca-67d667c7d-scn5c\" (UID: \"5f6302ad-c504-4bce-8d18-5952429ee5a7\") " pod="openshift-service-ca/service-ca-67d667c7d-scn5c" May 21 16:13:48.568982 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:48.568962 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5f6302ad-c504-4bce-8d18-5952429ee5a7-signing-key\") pod \"service-ca-67d667c7d-scn5c\" (UID: \"5f6302ad-c504-4bce-8d18-5952429ee5a7\") " pod="openshift-service-ca/service-ca-67d667c7d-scn5c" May 21 16:13:48.576526 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:48.576508 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2vf4\" (UniqueName: \"kubernetes.io/projected/5f6302ad-c504-4bce-8d18-5952429ee5a7-kube-api-access-s2vf4\") pod \"service-ca-67d667c7d-scn5c\" (UID: \"5f6302ad-c504-4bce-8d18-5952429ee5a7\") " pod="openshift-service-ca/service-ca-67d667c7d-scn5c" May 21 16:13:48.677634 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:48.677597 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-scn5c" May 21 16:13:48.796405 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:48.796375 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-scn5c"] May 21 16:13:48.799670 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:13:48.799646 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f6302ad_c504_4bce_8d18_5952429ee5a7.slice/crio-4952426deaa184458fcf5919df2c7296e0d14526d27381e61f093282d5aa71f6 WatchSource:0}: Error finding container 4952426deaa184458fcf5919df2c7296e0d14526d27381e61f093282d5aa71f6: Status 404 returned error can't find the container with id 4952426deaa184458fcf5919df2c7296e0d14526d27381e61f093282d5aa71f6 May 21 16:13:49.790386 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:49.790350 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-scn5c" event={"ID":"5f6302ad-c504-4bce-8d18-5952429ee5a7","Type":"ContainerStarted","Data":"29509b631ee5f94c33aadc977923a0f8155ddf1a3ac2fbd698307da884b1bd3e"} May 21 16:13:49.790802 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:49.790395 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-scn5c" event={"ID":"5f6302ad-c504-4bce-8d18-5952429ee5a7","Type":"ContainerStarted","Data":"4952426deaa184458fcf5919df2c7296e0d14526d27381e61f093282d5aa71f6"} May 21 16:13:49.808146 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:49.808105 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-scn5c" podStartSLOduration=1.808091436 podStartE2EDuration="1.808091436s" podCreationTimestamp="2026-05-21 16:13:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:13:49.807124846 +0000 UTC m=+135.105845746" watchObservedRunningTime="2026-05-21 16:13:49.808091436 +0000 UTC m=+135.106812335" May 21 16:13:56.428925 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:56.428876 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-cmnmf\" (UID: \"a3e6e1c3-5727-4f92-aea9-075fa5ca85bb\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-cmnmf" May 21 16:13:56.429386 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:56.428966 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7438a0cb-f85b-4259-8030-9c9840e39fb9-service-ca-bundle\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:13:56.429386 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:56.429017 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7438a0cb-f85b-4259-8030-9c9840e39fb9-metrics-certs\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:13:56.429386 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:56.429051 2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 16:13:56.429386 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:56.429133 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7438a0cb-f85b-4259-8030-9c9840e39fb9-service-ca-bundle podName:7438a0cb-f85b-4259-8030-9c9840e39fb9 nodeName:}" failed. No retries permitted until 2026-05-21 16:14:12.429114161 +0000 UTC m=+157.727835042 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7438a0cb-f85b-4259-8030-9c9840e39fb9-service-ca-bundle") pod "router-default-6f5959664-vpn5f" (UID: "7438a0cb-f85b-4259-8030-9c9840e39fb9") : configmap references non-existent config key: service-ca.crt May 21 16:13:56.429386 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:13:56.429160 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-cluster-monitoring-operator-tls podName:a3e6e1c3-5727-4f92-aea9-075fa5ca85bb nodeName:}" failed. No retries permitted until 2026-05-21 16:14:12.429151881 +0000 UTC m=+157.727872759 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-cmnmf" (UID: "a3e6e1c3-5727-4f92-aea9-075fa5ca85bb") : secret "cluster-monitoring-operator-tls" not found May 21 16:13:56.431442 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:56.431419 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7438a0cb-f85b-4259-8030-9c9840e39fb9-metrics-certs\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:13:56.629780 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:56.629742 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-registry-tls\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:56.632263 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:56.632239 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-registry-tls\") pod \"image-registry-7cb47f7d76-kl985\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:56.728738 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:56.728644 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:56.855312 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:56.855283 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cb47f7d76-kl985"] May 21 16:13:56.857876 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:13:56.857846 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33505023_9fe3_4cad_a874_0b521d2f254e.slice/crio-38363b11ab24556b4346714eb341cfd47c9bc6675b1fbbae39a72de8c323971b WatchSource:0}: Error finding container 38363b11ab24556b4346714eb341cfd47c9bc6675b1fbbae39a72de8c323971b: Status 404 returned error can't find the container with id 38363b11ab24556b4346714eb341cfd47c9bc6675b1fbbae39a72de8c323971b May 21 16:13:57.816239 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:57.816195 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" event={"ID":"33505023-9fe3-4cad-a874-0b521d2f254e","Type":"ContainerStarted","Data":"fe2ec41f5132e69541c0c71c93c271571dc861ce6b3e19976f6d10bf0db2d065"} May 21 16:13:57.816239 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:57.816243 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" event={"ID":"33505023-9fe3-4cad-a874-0b521d2f254e","Type":"ContainerStarted","Data":"38363b11ab24556b4346714eb341cfd47c9bc6675b1fbbae39a72de8c323971b"} May 21 16:13:57.816638 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:57.816429 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:13:57.836699 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:13:57.836649 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" podStartSLOduration=17.836635957 podStartE2EDuration="17.836635957s" podCreationTimestamp="2026-05-21 16:13:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:13:57.835489885 +0000 UTC m=+143.134210785" watchObservedRunningTime="2026-05-21 16:13:57.836635957 +0000 UTC m=+143.135356857" May 21 16:14:08.707740 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.707705 2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7cb47f7d76-kl985"] May 21 16:14:08.736540 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.736509 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m47fb"] May 21 16:14:08.742691 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.742672 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m47fb" May 21 16:14:08.745418 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.745392 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t6nsm\"" May 21 16:14:08.745512 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.745462 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 16:14:08.745688 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.745646 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 16:14:08.747255 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.747236 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-89949c9b6-2ll9b"] May 21 16:14:08.750765 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.750744 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m47fb"] May 21 16:14:08.750890 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.750870 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:08.764437 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.764413 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-89949c9b6-2ll9b"] May 21 16:14:08.826116 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.826086 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq9w9\" (UniqueName: \"kubernetes.io/projected/1aab8dfd-75ed-419d-8ea2-38c42d1d6d86-kube-api-access-wq9w9\") pod \"image-registry-89949c9b6-2ll9b\" (UID: \"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86\") " pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:08.826288 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.826144 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1aab8dfd-75ed-419d-8ea2-38c42d1d6d86-installation-pull-secrets\") pod \"image-registry-89949c9b6-2ll9b\" (UID: \"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86\") " pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:08.826288 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.826189 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5de7e62-600e-4904-895d-9d255fdb97e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m47fb\" (UID: \"e5de7e62-600e-4904-895d-9d255fdb97e4\") " pod="openshift-insights/insights-runtime-extractor-m47fb" May 21 16:14:08.826288 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.826217 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1aab8dfd-75ed-419d-8ea2-38c42d1d6d86-bound-sa-token\") pod \"image-registry-89949c9b6-2ll9b\" (UID: \"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86\") " pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:08.826288 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.826241 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1aab8dfd-75ed-419d-8ea2-38c42d1d6d86-ca-trust-extracted\") pod \"image-registry-89949c9b6-2ll9b\" (UID: \"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86\") " pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:08.826288 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.826263 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1aab8dfd-75ed-419d-8ea2-38c42d1d6d86-registry-certificates\") pod \"image-registry-89949c9b6-2ll9b\" (UID: \"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86\") " pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:08.826444 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.826296 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1aab8dfd-75ed-419d-8ea2-38c42d1d6d86-trusted-ca\") pod \"image-registry-89949c9b6-2ll9b\" (UID: \"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86\") " pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:08.826444 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.826377 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5de7e62-600e-4904-895d-9d255fdb97e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m47fb\" (UID: \"e5de7e62-600e-4904-895d-9d255fdb97e4\") " pod="openshift-insights/insights-runtime-extractor-m47fb" May 21 16:14:08.826444 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.826413 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tllzs\" (UniqueName: \"kubernetes.io/projected/e5de7e62-600e-4904-895d-9d255fdb97e4-kube-api-access-tllzs\") pod \"insights-runtime-extractor-m47fb\" (UID: \"e5de7e62-600e-4904-895d-9d255fdb97e4\") " pod="openshift-insights/insights-runtime-extractor-m47fb" May 21 16:14:08.826444 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.826432 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5de7e62-600e-4904-895d-9d255fdb97e4-data-volume\") pod \"insights-runtime-extractor-m47fb\" (UID: \"e5de7e62-600e-4904-895d-9d255fdb97e4\") " pod="openshift-insights/insights-runtime-extractor-m47fb" May 21 16:14:08.826556 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.826451 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1aab8dfd-75ed-419d-8ea2-38c42d1d6d86-image-registry-private-configuration\") pod \"image-registry-89949c9b6-2ll9b\" (UID: \"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86\") " pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:08.826556 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.826468 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1aab8dfd-75ed-419d-8ea2-38c42d1d6d86-registry-tls\") pod \"image-registry-89949c9b6-2ll9b\" (UID: \"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86\") " pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:08.826556 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.826485 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e5de7e62-600e-4904-895d-9d255fdb97e4-crio-socket\") pod \"insights-runtime-extractor-m47fb\" (UID: \"e5de7e62-600e-4904-895d-9d255fdb97e4\") " pod="openshift-insights/insights-runtime-extractor-m47fb" May 21 16:14:08.927601 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.927564 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5de7e62-600e-4904-895d-9d255fdb97e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m47fb\" (UID: \"e5de7e62-600e-4904-895d-9d255fdb97e4\") " pod="openshift-insights/insights-runtime-extractor-m47fb" May 21 16:14:08.927601 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.927602 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1aab8dfd-75ed-419d-8ea2-38c42d1d6d86-bound-sa-token\") pod \"image-registry-89949c9b6-2ll9b\" (UID: \"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86\") " pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:08.927897 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.927627 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1aab8dfd-75ed-419d-8ea2-38c42d1d6d86-ca-trust-extracted\") pod \"image-registry-89949c9b6-2ll9b\" (UID: \"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86\") " pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:08.927897 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.927649 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1aab8dfd-75ed-419d-8ea2-38c42d1d6d86-registry-certificates\") pod \"image-registry-89949c9b6-2ll9b\" (UID: \"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86\") " pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:08.927897 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.927694 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1aab8dfd-75ed-419d-8ea2-38c42d1d6d86-trusted-ca\") pod \"image-registry-89949c9b6-2ll9b\" (UID: \"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86\") " pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:08.927897 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.927742 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5de7e62-600e-4904-895d-9d255fdb97e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m47fb\" (UID: \"e5de7e62-600e-4904-895d-9d255fdb97e4\") " pod="openshift-insights/insights-runtime-extractor-m47fb" May 21 16:14:08.927897 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.927791 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tllzs\" (UniqueName: \"kubernetes.io/projected/e5de7e62-600e-4904-895d-9d255fdb97e4-kube-api-access-tllzs\") pod \"insights-runtime-extractor-m47fb\" (UID: \"e5de7e62-600e-4904-895d-9d255fdb97e4\") " pod="openshift-insights/insights-runtime-extractor-m47fb" May 21 16:14:08.927897 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.927839 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5de7e62-600e-4904-895d-9d255fdb97e4-data-volume\") pod \"insights-runtime-extractor-m47fb\" (UID: \"e5de7e62-600e-4904-895d-9d255fdb97e4\") " pod="openshift-insights/insights-runtime-extractor-m47fb" May 21 16:14:08.929557 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.928501 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1aab8dfd-75ed-419d-8ea2-38c42d1d6d86-image-registry-private-configuration\") pod \"image-registry-89949c9b6-2ll9b\" (UID: \"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86\") " pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:08.929557 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.928730 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1aab8dfd-75ed-419d-8ea2-38c42d1d6d86-ca-trust-extracted\") pod \"image-registry-89949c9b6-2ll9b\" (UID: \"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86\") " pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:08.929557 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.928749 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1aab8dfd-75ed-419d-8ea2-38c42d1d6d86-registry-tls\") pod \"image-registry-89949c9b6-2ll9b\" (UID: \"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86\") " pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:08.929557 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.928812 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e5de7e62-600e-4904-895d-9d255fdb97e4-crio-socket\") pod \"insights-runtime-extractor-m47fb\" (UID: \"e5de7e62-600e-4904-895d-9d255fdb97e4\") " pod="openshift-insights/insights-runtime-extractor-m47fb" May 21 16:14:08.929557 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.928857 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5de7e62-600e-4904-895d-9d255fdb97e4-data-volume\") pod \"insights-runtime-extractor-m47fb\" (UID: \"e5de7e62-600e-4904-895d-9d255fdb97e4\") " pod="openshift-insights/insights-runtime-extractor-m47fb" May 21 16:14:08.929557 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.929103 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e5de7e62-600e-4904-895d-9d255fdb97e4-crio-socket\") pod \"insights-runtime-extractor-m47fb\" (UID: \"e5de7e62-600e-4904-895d-9d255fdb97e4\") " pod="openshift-insights/insights-runtime-extractor-m47fb" May 21 16:14:08.929557 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.929505 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1aab8dfd-75ed-419d-8ea2-38c42d1d6d86-registry-certificates\") pod \"image-registry-89949c9b6-2ll9b\" (UID: \"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86\") " pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:08.930007 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.929848 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wq9w9\" (UniqueName: \"kubernetes.io/projected/1aab8dfd-75ed-419d-8ea2-38c42d1d6d86-kube-api-access-wq9w9\") pod \"image-registry-89949c9b6-2ll9b\" (UID: \"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86\") " pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:08.931490 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.930004 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1aab8dfd-75ed-419d-8ea2-38c42d1d6d86-installation-pull-secrets\") pod \"image-registry-89949c9b6-2ll9b\" (UID: \"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86\") " pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:08.931490 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.930116 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1aab8dfd-75ed-419d-8ea2-38c42d1d6d86-trusted-ca\") pod \"image-registry-89949c9b6-2ll9b\" (UID: \"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86\") " pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:08.931490 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.930737 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5de7e62-600e-4904-895d-9d255fdb97e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m47fb\" (UID: \"e5de7e62-600e-4904-895d-9d255fdb97e4\") " pod="openshift-insights/insights-runtime-extractor-m47fb" May 21 16:14:08.933948 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.932260 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1aab8dfd-75ed-419d-8ea2-38c42d1d6d86-image-registry-private-configuration\") pod \"image-registry-89949c9b6-2ll9b\" (UID: \"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86\") " pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:08.933948 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.932360 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1aab8dfd-75ed-419d-8ea2-38c42d1d6d86-registry-tls\") pod \"image-registry-89949c9b6-2ll9b\" (UID: \"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86\") " pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:08.934382 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.934356 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5de7e62-600e-4904-895d-9d255fdb97e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m47fb\" (UID: \"e5de7e62-600e-4904-895d-9d255fdb97e4\") " pod="openshift-insights/insights-runtime-extractor-m47fb" May 21 16:14:08.934898 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.934878 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1aab8dfd-75ed-419d-8ea2-38c42d1d6d86-installation-pull-secrets\") pod \"image-registry-89949c9b6-2ll9b\" (UID: \"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86\") " pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:08.937504 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.937480 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1aab8dfd-75ed-419d-8ea2-38c42d1d6d86-bound-sa-token\") pod \"image-registry-89949c9b6-2ll9b\" (UID: \"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86\") " pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:08.938359 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.938341 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tllzs\" (UniqueName: \"kubernetes.io/projected/e5de7e62-600e-4904-895d-9d255fdb97e4-kube-api-access-tllzs\") pod \"insights-runtime-extractor-m47fb\" (UID: \"e5de7e62-600e-4904-895d-9d255fdb97e4\") " pod="openshift-insights/insights-runtime-extractor-m47fb" May 21 16:14:08.938483 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:08.938462 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq9w9\" (UniqueName: \"kubernetes.io/projected/1aab8dfd-75ed-419d-8ea2-38c42d1d6d86-kube-api-access-wq9w9\") pod \"image-registry-89949c9b6-2ll9b\" (UID: \"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86\") " pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:09.053007 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:09.052924 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m47fb" May 21 16:14:09.059925 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:09.059895 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:09.186443 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:09.186408 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m47fb"] May 21 16:14:09.189963 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:14:09.189933 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5de7e62_600e_4904_895d_9d255fdb97e4.slice/crio-edcab7f09dd17ee819e7b48393788b6ee5ea900e7190ad50539c492f49bd7466 WatchSource:0}: Error finding container edcab7f09dd17ee819e7b48393788b6ee5ea900e7190ad50539c492f49bd7466: Status 404 returned error can't find the container with id edcab7f09dd17ee819e7b48393788b6ee5ea900e7190ad50539c492f49bd7466 May 21 16:14:09.206839 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:09.206795 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-89949c9b6-2ll9b"] May 21 16:14:09.210476 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:14:09.210445 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aab8dfd_75ed_419d_8ea2_38c42d1d6d86.slice/crio-5db0ee21e22981e6290c491341ddc1fca9efed9ce7f6a33dc4d79ff0d8a5be66 WatchSource:0}: Error finding container 5db0ee21e22981e6290c491341ddc1fca9efed9ce7f6a33dc4d79ff0d8a5be66: Status 404 returned error can't find the container with id 5db0ee21e22981e6290c491341ddc1fca9efed9ce7f6a33dc4d79ff0d8a5be66 May 21 16:14:09.847832 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:09.847778 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" event={"ID":"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86","Type":"ContainerStarted","Data":"c5348c12a0e8191a30266deb97887a16abe4303ad88ccc3386d44fe0ae2f48fc"} May 21 16:14:09.847832 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:09.847830 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" event={"ID":"1aab8dfd-75ed-419d-8ea2-38c42d1d6d86","Type":"ContainerStarted","Data":"5db0ee21e22981e6290c491341ddc1fca9efed9ce7f6a33dc4d79ff0d8a5be66"} May 21 16:14:09.848334 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:09.847874 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:09.849101 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:09.849078 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m47fb" event={"ID":"e5de7e62-600e-4904-895d-9d255fdb97e4","Type":"ContainerStarted","Data":"59e4c5c00c063885d2f7a167460fd6bb2bec8530a0c2e3bbe967b5e98ff626e9"} May 21 16:14:09.849101 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:09.849103 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m47fb" event={"ID":"e5de7e62-600e-4904-895d-9d255fdb97e4","Type":"ContainerStarted","Data":"edcab7f09dd17ee819e7b48393788b6ee5ea900e7190ad50539c492f49bd7466"} May 21 16:14:09.867200 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:09.867156 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" podStartSLOduration=1.867143174 podStartE2EDuration="1.867143174s" podCreationTimestamp="2026-05-21 16:14:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:14:09.866775412 +0000 UTC m=+155.165496313" watchObservedRunningTime="2026-05-21 16:14:09.867143174 +0000 UTC m=+155.165864071" May 21 16:14:10.852733 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:10.852698 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m47fb" event={"ID":"e5de7e62-600e-4904-895d-9d255fdb97e4","Type":"ContainerStarted","Data":"4d6c62a58cd21f97cbaeb57c0f60d5074d639a7b2b1a382ed702c3943cc51db3"} May 21 16:14:11.569805 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:14:11.569761 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-984s7" podUID="44ebd433-29f6-4471-8518-b23a3b13be79" May 21 16:14:11.574951 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:14:11.574914 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-82shb" podUID="0593535c-9146-4f09-8845-dc1bd5e79c6b" May 21 16:14:11.857215 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:11.857191 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-82shb" May 21 16:14:11.857215 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:11.857194 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m47fb" event={"ID":"e5de7e62-600e-4904-895d-9d255fdb97e4","Type":"ContainerStarted","Data":"bfa8756919df82be4de425788f8d1d66d4f47c68973b4a000dbfb4b91f6e6688"} May 21 16:14:11.857658 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:11.857422 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-984s7" May 21 16:14:11.874088 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:11.874044 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m47fb" podStartSLOduration=1.347592835 podStartE2EDuration="3.874031637s" podCreationTimestamp="2026-05-21 16:14:08 +0000 UTC" firstStartedPulling="2026-05-21 16:14:09.258808852 +0000 UTC m=+154.557529730" lastFinishedPulling="2026-05-21 16:14:11.785247654 +0000 UTC m=+157.083968532" observedRunningTime="2026-05-21 16:14:11.874001393 +0000 UTC m=+157.172722295" watchObservedRunningTime="2026-05-21 16:14:11.874031637 +0000 UTC m=+157.172752536" May 21 16:14:12.463280 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:12.463240 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-cmnmf\" (UID: \"a3e6e1c3-5727-4f92-aea9-075fa5ca85bb\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-cmnmf" May 21 16:14:12.463450 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:12.463305 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7438a0cb-f85b-4259-8030-9c9840e39fb9-service-ca-bundle\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:14:12.464012 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:12.463986 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7438a0cb-f85b-4259-8030-9c9840e39fb9-service-ca-bundle\") pod \"router-default-6f5959664-vpn5f\" (UID: \"7438a0cb-f85b-4259-8030-9c9840e39fb9\") " pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:14:12.465658 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:12.465630 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3e6e1c3-5727-4f92-aea9-075fa5ca85bb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-cmnmf\" (UID: \"a3e6e1c3-5727-4f92-aea9-075fa5ca85bb\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-cmnmf" May 21 16:14:12.691658 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:12.691627 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-cmnmf" May 21 16:14:12.696399 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:12.696373 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:14:12.847382 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:12.847353 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-cmnmf"] May 21 16:14:12.850236 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:14:12.850207 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3e6e1c3_5727_4f92_aea9_075fa5ca85bb.slice/crio-d59eb8fee90234488ddaa2fc53db288e2fedd0d2a8d0c6f2bb52d0090a0ddb4e WatchSource:0}: Error finding container d59eb8fee90234488ddaa2fc53db288e2fedd0d2a8d0c6f2bb52d0090a0ddb4e: Status 404 returned error can't find the container with id d59eb8fee90234488ddaa2fc53db288e2fedd0d2a8d0c6f2bb52d0090a0ddb4e May 21 16:14:12.864340 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:12.864291 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-cmnmf" event={"ID":"a3e6e1c3-5727-4f92-aea9-075fa5ca85bb","Type":"ContainerStarted","Data":"d59eb8fee90234488ddaa2fc53db288e2fedd0d2a8d0c6f2bb52d0090a0ddb4e"} May 21 16:14:12.865304 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:12.865287 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f5959664-vpn5f"] May 21 16:14:12.867963 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:14:12.867939 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7438a0cb_f85b_4259_8030_9c9840e39fb9.slice/crio-a5865b318a8cdab5e2656ab44f5d7f76de34ed47beecb6ebf7e7c0c1e53a3e95 WatchSource:0}: Error finding container a5865b318a8cdab5e2656ab44f5d7f76de34ed47beecb6ebf7e7c0c1e53a3e95: Status 404 returned error can't find the container with id a5865b318a8cdab5e2656ab44f5d7f76de34ed47beecb6ebf7e7c0c1e53a3e95 May 21 16:14:13.346498 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:14:13.346459 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-49jxl" podUID="44a88f02-4431-4214-9629-d63db994abfe" May 21 16:14:13.868358 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:13.868320 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f5959664-vpn5f" event={"ID":"7438a0cb-f85b-4259-8030-9c9840e39fb9","Type":"ContainerStarted","Data":"c02186142b4fdcecf33bac597b16e95876117a7d2f90d6ab66ccf3f7b3b9fca7"} May 21 16:14:13.868358 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:13.868360 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f5959664-vpn5f" event={"ID":"7438a0cb-f85b-4259-8030-9c9840e39fb9","Type":"ContainerStarted","Data":"a5865b318a8cdab5e2656ab44f5d7f76de34ed47beecb6ebf7e7c0c1e53a3e95"} May 21 16:14:13.885710 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:13.885663 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-6f5959664-vpn5f" podStartSLOduration=33.885646771 podStartE2EDuration="33.885646771s" podCreationTimestamp="2026-05-21 16:13:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:14:13.884941312 +0000 UTC m=+159.183662224" watchObservedRunningTime="2026-05-21 16:14:13.885646771 +0000 UTC m=+159.184367670" May 21 16:14:14.697025 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:14.696986 2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:14:14.700987 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:14.700959 2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:14:14.871067 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:14.871033 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:14:14.872563 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:14.872539 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6f5959664-vpn5f" May 21 16:14:15.875235 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:15.875196 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-cmnmf" event={"ID":"a3e6e1c3-5727-4f92-aea9-075fa5ca85bb","Type":"ContainerStarted","Data":"c759eb67d46c102c19dcf5b2e15f36df69cb0955457a535c047e812d12997843"} May 21 16:14:15.891771 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:15.891739 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-69jqn"] May 21 16:14:15.894286 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:15.894257 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-69jqn" May 21 16:14:15.894421 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:15.894296 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-cmnmf" podStartSLOduration=33.364114136 podStartE2EDuration="35.894283323s" podCreationTimestamp="2026-05-21 16:13:40 +0000 UTC" firstStartedPulling="2026-05-21 16:14:12.85216283 +0000 UTC m=+158.150883708" lastFinishedPulling="2026-05-21 16:14:15.382332015 +0000 UTC m=+160.681052895" observedRunningTime="2026-05-21 16:14:15.89407015 +0000 UTC m=+161.192791051" watchObservedRunningTime="2026-05-21 16:14:15.894283323 +0000 UTC m=+161.193004223" May 21 16:14:15.896809 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:15.896791 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 21 16:14:15.896927 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:15.896830 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-rb2jq\"" May 21 16:14:15.908315 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:15.908284 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-69jqn"] May 21 16:14:15.994940 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:15.994900 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bce6e240-6d76-484d-b93e-4a642417906f-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-69jqn\" (UID: \"bce6e240-6d76-484d-b93e-4a642417906f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-69jqn" May 21 16:14:16.096145 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:16.096106 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bce6e240-6d76-484d-b93e-4a642417906f-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-69jqn\" (UID: \"bce6e240-6d76-484d-b93e-4a642417906f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-69jqn" May 21 16:14:16.098468 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:16.098447 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bce6e240-6d76-484d-b93e-4a642417906f-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-69jqn\" (UID: \"bce6e240-6d76-484d-b93e-4a642417906f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-69jqn" May 21 16:14:16.205377 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:16.205271 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-69jqn" May 21 16:14:16.326449 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:16.326419 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-69jqn"] May 21 16:14:16.329550 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:14:16.329519 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbce6e240_6d76_484d_b93e_4a642417906f.slice/crio-a350a55ebd266e86750a671161e2fc0ecbbd4679c96c947b12512094c597d05b WatchSource:0}: Error finding container a350a55ebd266e86750a671161e2fc0ecbbd4679c96c947b12512094c597d05b: Status 404 returned error can't find the container with id a350a55ebd266e86750a671161e2fc0ecbbd4679c96c947b12512094c597d05b May 21 16:14:16.399161 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:16.399126 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls\") pod \"dns-default-984s7\" (UID: \"44ebd433-29f6-4471-8518-b23a3b13be79\") " pod="openshift-dns/dns-default-984s7" May 21 16:14:16.399295 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:16.399220 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert\") pod \"ingress-canary-82shb\" (UID: \"0593535c-9146-4f09-8845-dc1bd5e79c6b\") " pod="openshift-ingress-canary/ingress-canary-82shb" May 21 16:14:16.401407 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:16.401385 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44ebd433-29f6-4471-8518-b23a3b13be79-metrics-tls\") pod \"dns-default-984s7\" (UID: \"44ebd433-29f6-4471-8518-b23a3b13be79\") " pod="openshift-dns/dns-default-984s7" May 21 16:14:16.401581 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:16.401564 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0593535c-9146-4f09-8845-dc1bd5e79c6b-cert\") pod \"ingress-canary-82shb\" (UID: \"0593535c-9146-4f09-8845-dc1bd5e79c6b\") " pod="openshift-ingress-canary/ingress-canary-82shb" May 21 16:14:16.662086 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:16.662056 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xl8jw\"" May 21 16:14:16.662086 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:16.662057 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-94pnq\"" May 21 16:14:16.668295 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:16.668273 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-82shb" May 21 16:14:16.668399 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:16.668380 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-984s7" May 21 16:14:16.799714 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:16.799683 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-984s7"] May 21 16:14:16.802487 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:14:16.802442 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44ebd433_29f6_4471_8518_b23a3b13be79.slice/crio-5f9abac5312b5a3c56063dbc7d0e2d30a80ced735f6875e6c5497bb0504e04dd WatchSource:0}: Error finding container 5f9abac5312b5a3c56063dbc7d0e2d30a80ced735f6875e6c5497bb0504e04dd: Status 404 returned error can't find the container with id 5f9abac5312b5a3c56063dbc7d0e2d30a80ced735f6875e6c5497bb0504e04dd May 21 16:14:16.818202 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:16.818178 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-82shb"] May 21 16:14:16.821326 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:14:16.821301 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0593535c_9146_4f09_8845_dc1bd5e79c6b.slice/crio-a3e4c4aeb224cc556ca38b8d2565da3def983d1d3b3b5751128717aa9239638f WatchSource:0}: Error finding container a3e4c4aeb224cc556ca38b8d2565da3def983d1d3b3b5751128717aa9239638f: Status 404 returned error can't find the container with id a3e4c4aeb224cc556ca38b8d2565da3def983d1d3b3b5751128717aa9239638f May 21 16:14:16.879712 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:16.879674 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-69jqn" event={"ID":"bce6e240-6d76-484d-b93e-4a642417906f","Type":"ContainerStarted","Data":"a350a55ebd266e86750a671161e2fc0ecbbd4679c96c947b12512094c597d05b"} May 21 16:14:16.880976 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:16.880931 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-82shb" event={"ID":"0593535c-9146-4f09-8845-dc1bd5e79c6b","Type":"ContainerStarted","Data":"a3e4c4aeb224cc556ca38b8d2565da3def983d1d3b3b5751128717aa9239638f"} May 21 16:14:16.882049 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:16.882026 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-984s7" event={"ID":"44ebd433-29f6-4471-8518-b23a3b13be79","Type":"ContainerStarted","Data":"5f9abac5312b5a3c56063dbc7d0e2d30a80ced735f6875e6c5497bb0504e04dd"} May 21 16:14:17.886680 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:17.886637 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-69jqn" event={"ID":"bce6e240-6d76-484d-b93e-4a642417906f","Type":"ContainerStarted","Data":"37f551e41a6b4c66edcecb684280075f3182a7f91da1092764002bc664c8830c"} May 21 16:14:17.887170 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:17.887126 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-69jqn" May 21 16:14:17.891936 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:17.891910 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-69jqn" May 21 16:14:17.903261 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:17.903212 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-69jqn" podStartSLOduration=1.859817059 podStartE2EDuration="2.903197325s" podCreationTimestamp="2026-05-21 16:14:15 +0000 UTC" firstStartedPulling="2026-05-21 16:14:16.331915016 +0000 UTC m=+161.630635894" lastFinishedPulling="2026-05-21 16:14:17.375295265 +0000 UTC m=+162.674016160" observedRunningTime="2026-05-21 16:14:17.90299061 +0000 UTC m=+163.201711512" watchObservedRunningTime="2026-05-21 16:14:17.903197325 +0000 UTC m=+163.201918227" May 21 16:14:18.713599 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:18.713559 2547 patch_prober.go:28] interesting pod/image-registry-7cb47f7d76-kl985 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 21 16:14:18.713787 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:18.713625 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" podUID="33505023-9fe3-4cad-a874-0b521d2f254e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 16:14:19.894058 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:19.894014 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-984s7" event={"ID":"44ebd433-29f6-4471-8518-b23a3b13be79","Type":"ContainerStarted","Data":"93cda93b576e155b084289c3ec509e4a0c0b5e5c1103a8188b44630a50ad9e45"} May 21 16:14:19.894058 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:19.894062 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-984s7" event={"ID":"44ebd433-29f6-4471-8518-b23a3b13be79","Type":"ContainerStarted","Data":"9c5ebdde424857bf4a1a816269d0de59a0b2202d6298fa589f776547d7402ac9"} May 21 16:14:19.911341 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:19.911289 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-984s7" podStartSLOduration=129.735520621 podStartE2EDuration="2m11.911275507s" podCreationTimestamp="2026-05-21 16:12:08 +0000 UTC" firstStartedPulling="2026-05-21 16:14:16.804369091 +0000 UTC m=+162.103089973" lastFinishedPulling="2026-05-21 16:14:18.980123981 +0000 UTC m=+164.278844859" observedRunningTime="2026-05-21 16:14:19.910165322 +0000 UTC m=+165.208886222" watchObservedRunningTime="2026-05-21 16:14:19.911275507 +0000 UTC m=+165.209996407" May 21 16:14:20.898187 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:20.898147 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-82shb" event={"ID":"0593535c-9146-4f09-8845-dc1bd5e79c6b","Type":"ContainerStarted","Data":"e2fec24b523f3a5f98a8cbbf106c9e329d43e3b091a97e05659a8ca8b928eb49"} May 21 16:14:20.898540 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:20.898499 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-984s7" May 21 16:14:20.914256 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:20.914212 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-82shb" podStartSLOduration=129.057438761 podStartE2EDuration="2m12.914197951s" podCreationTimestamp="2026-05-21 16:12:08 +0000 UTC" firstStartedPulling="2026-05-21 16:14:16.823252668 +0000 UTC m=+162.121973561" lastFinishedPulling="2026-05-21 16:14:20.680011874 +0000 UTC m=+165.978732751" observedRunningTime="2026-05-21 16:14:20.913310709 +0000 UTC m=+166.212031608" watchObservedRunningTime="2026-05-21 16:14:20.914197951 +0000 UTC m=+166.212918896" May 21 16:14:23.315107 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.315015 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6"] May 21 16:14:23.317883 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.317863 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" May 21 16:14:23.321302 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.321279 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 21 16:14:23.323042 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.323022 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 21 16:14:23.323173 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.323061 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 21 16:14:23.323308 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.323288 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-557lf\"" May 21 16:14:23.323435 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.323415 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 16:14:23.337655 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.337630 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6"] May 21 16:14:23.357491 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.357458 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9kt6p"] May 21 16:14:23.360058 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.360036 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.363395 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.363376 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 16:14:23.363683 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.363555 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gsm8b\"" May 21 16:14:23.363683 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.363393 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 16:14:23.363683 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.363433 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 16:14:23.463212 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.463176 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/96433128-be1c-4ab9-8609-aa7a48c33406-node-exporter-textfile\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.463380 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.463217 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96433128-be1c-4ab9-8609-aa7a48c33406-metrics-client-ca\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.463380 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.463243 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfdpb\" (UniqueName: \"kubernetes.io/projected/96433128-be1c-4ab9-8609-aa7a48c33406-kube-api-access-tfdpb\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.463380 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.463273 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/96433128-be1c-4ab9-8609-aa7a48c33406-node-exporter-wtmp\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.463380 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.463316 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f978a1e0-aaef-4dc6-b7ec-44a113855270-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-bv2z6\" (UID: \"f978a1e0-aaef-4dc6-b7ec-44a113855270\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" May 21 16:14:23.463380 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.463366 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f978a1e0-aaef-4dc6-b7ec-44a113855270-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-bv2z6\" (UID: \"f978a1e0-aaef-4dc6-b7ec-44a113855270\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" May 21 16:14:23.463558 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.463397 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/96433128-be1c-4ab9-8609-aa7a48c33406-root\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.463558 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.463444 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/96433128-be1c-4ab9-8609-aa7a48c33406-node-exporter-accelerators-collector-config\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.463558 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.463464 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnl4g\" (UniqueName: \"kubernetes.io/projected/f978a1e0-aaef-4dc6-b7ec-44a113855270-kube-api-access-jnl4g\") pod \"kube-state-metrics-54fd6bc5c4-bv2z6\" (UID: \"f978a1e0-aaef-4dc6-b7ec-44a113855270\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" May 21 16:14:23.463558 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.463478 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96433128-be1c-4ab9-8609-aa7a48c33406-sys\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.463558 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.463508 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f978a1e0-aaef-4dc6-b7ec-44a113855270-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-bv2z6\" (UID: \"f978a1e0-aaef-4dc6-b7ec-44a113855270\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" May 21 16:14:23.463558 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.463533 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96433128-be1c-4ab9-8609-aa7a48c33406-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.463558 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.463553 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f978a1e0-aaef-4dc6-b7ec-44a113855270-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-bv2z6\" (UID: \"f978a1e0-aaef-4dc6-b7ec-44a113855270\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" May 21 16:14:23.463777 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.463573 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f978a1e0-aaef-4dc6-b7ec-44a113855270-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-bv2z6\" (UID: \"f978a1e0-aaef-4dc6-b7ec-44a113855270\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" May 21 16:14:23.463777 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.463597 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/96433128-be1c-4ab9-8609-aa7a48c33406-node-exporter-tls\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.564871 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.564837 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/96433128-be1c-4ab9-8609-aa7a48c33406-node-exporter-textfile\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.564871 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.564879 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96433128-be1c-4ab9-8609-aa7a48c33406-metrics-client-ca\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.565082 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.564899 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tfdpb\" (UniqueName: \"kubernetes.io/projected/96433128-be1c-4ab9-8609-aa7a48c33406-kube-api-access-tfdpb\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.565082 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.564923 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/96433128-be1c-4ab9-8609-aa7a48c33406-node-exporter-wtmp\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.565082 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.564969 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f978a1e0-aaef-4dc6-b7ec-44a113855270-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-bv2z6\" (UID: \"f978a1e0-aaef-4dc6-b7ec-44a113855270\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" May 21 16:14:23.565082 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.565003 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f978a1e0-aaef-4dc6-b7ec-44a113855270-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-bv2z6\" (UID: \"f978a1e0-aaef-4dc6-b7ec-44a113855270\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" May 21 16:14:23.565082 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.565031 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/96433128-be1c-4ab9-8609-aa7a48c33406-root\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.565346 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.565112 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/96433128-be1c-4ab9-8609-aa7a48c33406-root\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.565346 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.565153 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/96433128-be1c-4ab9-8609-aa7a48c33406-node-exporter-accelerators-collector-config\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.565346 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.565280 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jnl4g\" (UniqueName: \"kubernetes.io/projected/f978a1e0-aaef-4dc6-b7ec-44a113855270-kube-api-access-jnl4g\") pod \"kube-state-metrics-54fd6bc5c4-bv2z6\" (UID: \"f978a1e0-aaef-4dc6-b7ec-44a113855270\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" May 21 16:14:23.565346 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.565155 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/96433128-be1c-4ab9-8609-aa7a48c33406-node-exporter-wtmp\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.565346 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.565302 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96433128-be1c-4ab9-8609-aa7a48c33406-sys\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.565606 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.565358 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f978a1e0-aaef-4dc6-b7ec-44a113855270-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-bv2z6\" (UID: \"f978a1e0-aaef-4dc6-b7ec-44a113855270\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" May 21 16:14:23.565606 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.565400 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96433128-be1c-4ab9-8609-aa7a48c33406-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.565606 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.565429 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f978a1e0-aaef-4dc6-b7ec-44a113855270-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-bv2z6\" (UID: \"f978a1e0-aaef-4dc6-b7ec-44a113855270\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" May 21 16:14:23.565606 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.565464 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f978a1e0-aaef-4dc6-b7ec-44a113855270-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-bv2z6\" (UID: \"f978a1e0-aaef-4dc6-b7ec-44a113855270\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" May 21 16:14:23.565606 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.565491 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/96433128-be1c-4ab9-8609-aa7a48c33406-node-exporter-tls\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.565856 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.565650 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f978a1e0-aaef-4dc6-b7ec-44a113855270-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-bv2z6\" (UID: \"f978a1e0-aaef-4dc6-b7ec-44a113855270\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" May 21 16:14:23.565856 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.565693 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/96433128-be1c-4ab9-8609-aa7a48c33406-node-exporter-accelerators-collector-config\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.565856 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.565356 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96433128-be1c-4ab9-8609-aa7a48c33406-sys\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.565856 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.565793 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f978a1e0-aaef-4dc6-b7ec-44a113855270-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-bv2z6\" (UID: \"f978a1e0-aaef-4dc6-b7ec-44a113855270\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" May 21 16:14:23.566231 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.566209 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96433128-be1c-4ab9-8609-aa7a48c33406-metrics-client-ca\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.566312 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.566298 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f978a1e0-aaef-4dc6-b7ec-44a113855270-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-bv2z6\" (UID: \"f978a1e0-aaef-4dc6-b7ec-44a113855270\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" May 21 16:14:23.566427 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.566411 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/96433128-be1c-4ab9-8609-aa7a48c33406-node-exporter-textfile\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.567658 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.567635 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f978a1e0-aaef-4dc6-b7ec-44a113855270-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-bv2z6\" (UID: \"f978a1e0-aaef-4dc6-b7ec-44a113855270\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" May 21 16:14:23.568201 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.568181 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f978a1e0-aaef-4dc6-b7ec-44a113855270-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-bv2z6\" (UID: \"f978a1e0-aaef-4dc6-b7ec-44a113855270\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" May 21 16:14:23.568301 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.568224 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96433128-be1c-4ab9-8609-aa7a48c33406-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.568359 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.568311 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/96433128-be1c-4ab9-8609-aa7a48c33406-node-exporter-tls\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.572925 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.572903 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfdpb\" (UniqueName: \"kubernetes.io/projected/96433128-be1c-4ab9-8609-aa7a48c33406-kube-api-access-tfdpb\") pod \"node-exporter-9kt6p\" (UID: \"96433128-be1c-4ab9-8609-aa7a48c33406\") " pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.573024 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.572981 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnl4g\" (UniqueName: \"kubernetes.io/projected/f978a1e0-aaef-4dc6-b7ec-44a113855270-kube-api-access-jnl4g\") pod \"kube-state-metrics-54fd6bc5c4-bv2z6\" (UID: \"f978a1e0-aaef-4dc6-b7ec-44a113855270\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" May 21 16:14:23.628201 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.628158 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" May 21 16:14:23.669895 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.669864 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9kt6p" May 21 16:14:23.680602 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:14:23.680562 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96433128_be1c_4ab9_8609_aa7a48c33406.slice/crio-d67c0ea076e41627de21f6e90ab177d83de83150a48d63fbee5f3b4610828dee WatchSource:0}: Error finding container d67c0ea076e41627de21f6e90ab177d83de83150a48d63fbee5f3b4610828dee: Status 404 returned error can't find the container with id d67c0ea076e41627de21f6e90ab177d83de83150a48d63fbee5f3b4610828dee May 21 16:14:23.759516 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.759479 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6"] May 21 16:14:23.762760 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:14:23.762731 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf978a1e0_aaef_4dc6_b7ec_44a113855270.slice/crio-33469e4e39f026e90a31b6d0c7a08ee23b90fe605b000ba88e0ff7cb09c695eb WatchSource:0}: Error finding container 33469e4e39f026e90a31b6d0c7a08ee23b90fe605b000ba88e0ff7cb09c695eb: Status 404 returned error can't find the container with id 33469e4e39f026e90a31b6d0c7a08ee23b90fe605b000ba88e0ff7cb09c695eb May 21 16:14:23.906098 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.906056 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9kt6p" event={"ID":"96433128-be1c-4ab9-8609-aa7a48c33406","Type":"ContainerStarted","Data":"d67c0ea076e41627de21f6e90ab177d83de83150a48d63fbee5f3b4610828dee"} May 21 16:14:23.907090 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:23.907054 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" event={"ID":"f978a1e0-aaef-4dc6-b7ec-44a113855270","Type":"ContainerStarted","Data":"33469e4e39f026e90a31b6d0c7a08ee23b90fe605b000ba88e0ff7cb09c695eb"} May 21 16:14:24.331897 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:14:24.331841 2547 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c782ab11a37253e4c3e22070a364001834084354fd210f4cefae62c9b3df178" May 21 16:14:24.332397 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:14:24.332086 2547 kuberuntime_manager.go:1358] "Unhandled Error" err=< May 21 16:14:24.332397 ip-10-0-139-146 kubenswrapper[2547]: container &Container{Name:kube-state-metrics,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c782ab11a37253e4c3e22070a364001834084354fd210f4cefae62c9b3df178,Command:[],Args:[--host=127.0.0.1 --port=8081 --telemetry-host=127.0.0.1 --telemetry-port=8082 --custom-resource-state-config-file=/etc/kube-state-metrics/custom-resource-state-configmap.yaml --metric-denylist= May 21 16:14:24.332397 ip-10-0-139-146 kubenswrapper[2547]: ^kube_secret_labels$, May 21 16:14:24.332397 ip-10-0-139-146 kubenswrapper[2547]: ^kube_.+_annotations$, May 21 16:14:24.332397 ip-10-0-139-146 kubenswrapper[2547]: ^kube_customresource_.+_annotations_info$, May 21 16:14:24.332397 ip-10-0-139-146 kubenswrapper[2547]: ^kube_customresource_.+_labels_info$ May 21 16:14:24.332397 ip-10-0-139-146 kubenswrapper[2547]: --metric-labels-allowlist=pods=[*],nodes=[*],namespaces=[*],persistentvolumes=[*],persistentvolumeclaims=[*],poddisruptionbudgets=[*] --metric-denylist= May 21 16:14:24.332397 ip-10-0-139-146 kubenswrapper[2547]: ^kube_.+_created$, May 21 16:14:24.332397 ip-10-0-139-146 kubenswrapper[2547]: ^kube_.+_metadata_resource_version$, May 21 16:14:24.332397 ip-10-0-139-146 kubenswrapper[2547]: ^kube_replicaset_metadata_generation$, May 21 16:14:24.332397 ip-10-0-139-146 kubenswrapper[2547]: ^kube_replicaset_status_observed_generation$, May 21 16:14:24.332397 ip-10-0-139-146 kubenswrapper[2547]: ^kube_pod_restart_policy$, May 21 16:14:24.332397 ip-10-0-139-146 kubenswrapper[2547]: ^kube_pod_init_container_status_terminated$, May 21 16:14:24.332397 ip-10-0-139-146 kubenswrapper[2547]: ^kube_pod_init_container_status_running$, May 21 16:14:24.332397 ip-10-0-139-146 kubenswrapper[2547]: ^kube_pod_container_status_terminated$, May 21 16:14:24.332397 ip-10-0-139-146 kubenswrapper[2547]: ^kube_pod_container_status_running$, May 21 16:14:24.332397 ip-10-0-139-146 kubenswrapper[2547]: ^kube_pod_completion_time$, May 21 16:14:24.332397 ip-10-0-139-146 kubenswrapper[2547]: ^kube_pod_status_scheduled$ May 21 16:14:24.332397 ip-10-0-139-146 kubenswrapper[2547]: ],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{2 -3} {} 2m DecimalSI},memory: {{83886080 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:volume-directive-shadow,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-state-metrics-custom-resource-state-configmap,ReadOnly:true,MountPath:/etc/kube-state-metrics,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-jnl4g,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000450000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-state-metrics-54fd6bc5c4-bv2z6_openshift-monitoring(f978a1e0-aaef-4dc6-b7ec-44a113855270): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image May 21 16:14:24.332397 ip-10-0-139-146 kubenswrapper[2547]: > logger="UnhandledError" May 21 16:14:24.404494 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.402390 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 16:14:24.406016 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.405990 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.410389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.409901 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 21 16:14:24.410389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.410058 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 21 16:14:24.410389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.410068 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 21 16:14:24.410389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.410199 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 21 16:14:24.410389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.410324 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wfbqg\"" May 21 16:14:24.410733 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.410531 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 21 16:14:24.410733 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.410574 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 21 16:14:24.410733 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.410586 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 21 16:14:24.410963 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.410942 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 21 16:14:24.416103 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.415914 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 21 16:14:24.419864 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.419841 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 16:14:24.476888 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.476853 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-config-volume\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.477079 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.476898 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.477079 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.476984 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cbc9ba35-c11d-4655-8a65-039918a71090-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.477079 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.477010 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.477079 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.477038 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cbc9ba35-c11d-4655-8a65-039918a71090-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.477079 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.477063 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.477321 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.477086 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbc9ba35-c11d-4655-8a65-039918a71090-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.477321 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.477188 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-web-config\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.477321 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.477230 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cbc9ba35-c11d-4655-8a65-039918a71090-config-out\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.477321 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.477259 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbc9ba35-c11d-4655-8a65-039918a71090-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.477518 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.477316 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2v7p\" (UniqueName: \"kubernetes.io/projected/cbc9ba35-c11d-4655-8a65-039918a71090-kube-api-access-h2v7p\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.477518 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.477376 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.477518 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.477442 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.578985 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.578954 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cbc9ba35-c11d-4655-8a65-039918a71090-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.579109 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.579007 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.579109 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.579034 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbc9ba35-c11d-4655-8a65-039918a71090-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.579109 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.579077 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-web-config\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.579109 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.579103 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cbc9ba35-c11d-4655-8a65-039918a71090-config-out\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.579322 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.579125 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbc9ba35-c11d-4655-8a65-039918a71090-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.579322 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.579156 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2v7p\" (UniqueName: \"kubernetes.io/projected/cbc9ba35-c11d-4655-8a65-039918a71090-kube-api-access-h2v7p\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.579322 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.579204 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.579322 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.579253 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.579322 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.579298 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-config-volume\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.579617 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.579327 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.579617 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.579377 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cbc9ba35-c11d-4655-8a65-039918a71090-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.579617 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.579412 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cbc9ba35-c11d-4655-8a65-039918a71090-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.579617 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.579442 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.580406 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:14:24.580228 2547 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found May 21 16:14:24.580406 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:14:24.580298 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-main-tls podName:cbc9ba35-c11d-4655-8a65-039918a71090 nodeName:}" failed. No retries permitted until 2026-05-21 16:14:25.080277872 +0000 UTC m=+170.378998756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "cbc9ba35-c11d-4655-8a65-039918a71090") : secret "alertmanager-main-tls" not found May 21 16:14:24.582684 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.581256 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbc9ba35-c11d-4655-8a65-039918a71090-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.582684 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.581890 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbc9ba35-c11d-4655-8a65-039918a71090-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.585011 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.584625 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.585142 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.585120 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.585559 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.585515 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cbc9ba35-c11d-4655-8a65-039918a71090-config-out\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.586001 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.585979 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-config-volume\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.586397 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.586355 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cbc9ba35-c11d-4655-8a65-039918a71090-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.586781 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.586762 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-web-config\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.588154 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.587696 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.588392 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.588323 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2v7p\" (UniqueName: \"kubernetes.io/projected/cbc9ba35-c11d-4655-8a65-039918a71090-kube-api-access-h2v7p\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.588895 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.588870 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:24.655749 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:14:24.655699 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-state-metrics\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" podUID="f978a1e0-aaef-4dc6-b7ec-44a113855270" May 21 16:14:24.914921 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.914808 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" event={"ID":"f978a1e0-aaef-4dc6-b7ec-44a113855270","Type":"ContainerStarted","Data":"021078649b6dec66eabd3ebe830e0da3235f63525c1e6a9c78dfdebc59ef8dfa"} May 21 16:14:24.914921 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.914868 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" event={"ID":"f978a1e0-aaef-4dc6-b7ec-44a113855270","Type":"ContainerStarted","Data":"9fdd92cb91a1a47f1d30a42abbd5e0a4f5d6b8f23ccecff9a8386b50634c2dbd"} May 21 16:14:24.916236 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:14:24.916193 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-state-metrics\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c782ab11a37253e4c3e22070a364001834084354fd210f4cefae62c9b3df178\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" podUID="f978a1e0-aaef-4dc6-b7ec-44a113855270" May 21 16:14:24.916382 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.916358 2547 generic.go:358] "Generic (PLEG): container finished" podID="96433128-be1c-4ab9-8609-aa7a48c33406" containerID="d8e171baef4ba2dda550deef9c97c842d53d7e18628d481ac1568ec69731221c" exitCode=0 May 21 16:14:24.916434 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:24.916394 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9kt6p" event={"ID":"96433128-be1c-4ab9-8609-aa7a48c33406","Type":"ContainerDied","Data":"d8e171baef4ba2dda550deef9c97c842d53d7e18628d481ac1568ec69731221c"} May 21 16:14:25.085844 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:25.085781 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:25.088593 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:25.088567 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:25.320621 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:25.320534 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 16:14:25.455245 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:25.453976 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 16:14:25.921467 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:25.921393 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9kt6p" event={"ID":"96433128-be1c-4ab9-8609-aa7a48c33406","Type":"ContainerStarted","Data":"0baa49a3dfe4bfc42fd51bf0062cb40e60c9593b034309139ce9077e94ccbae0"} May 21 16:14:25.921467 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:25.921429 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9kt6p" event={"ID":"96433128-be1c-4ab9-8609-aa7a48c33406","Type":"ContainerStarted","Data":"fad7fba09942a0388795f8ea64797bf238dae1ceda275cc0050cb3557ff7c32d"} May 21 16:14:25.922616 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:25.922576 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cbc9ba35-c11d-4655-8a65-039918a71090","Type":"ContainerStarted","Data":"2dd251bb3b5c0dd2f85adb8a9f03061d7328e251d3fe8b6712270fb7fb526148"} May 21 16:14:25.923923 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:14:25.923897 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-state-metrics\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c782ab11a37253e4c3e22070a364001834084354fd210f4cefae62c9b3df178\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" podUID="f978a1e0-aaef-4dc6-b7ec-44a113855270" May 21 16:14:25.940117 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:25.940062 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9kt6p" podStartSLOduration=2.064089098 podStartE2EDuration="2.940044274s" podCreationTimestamp="2026-05-21 16:14:23 +0000 UTC" firstStartedPulling="2026-05-21 16:14:23.683119966 +0000 UTC m=+168.981840851" lastFinishedPulling="2026-05-21 16:14:24.559075133 +0000 UTC m=+169.857796027" observedRunningTime="2026-05-21 16:14:25.939547052 +0000 UTC m=+171.238267952" watchObservedRunningTime="2026-05-21 16:14:25.940044274 +0000 UTC m=+171.238765175" May 21 16:14:26.327238 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:26.327199 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:14:26.927261 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:26.927160 2547 generic.go:358] "Generic (PLEG): container finished" podID="cbc9ba35-c11d-4655-8a65-039918a71090" containerID="55dbb67ea3a4ce0b9c52bc88d6d0755de4e2bc3011b271be0a06e4cb4ed23c78" exitCode=0 May 21 16:14:26.927261 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:26.927245 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cbc9ba35-c11d-4655-8a65-039918a71090","Type":"ContainerDied","Data":"55dbb67ea3a4ce0b9c52bc88d6d0755de4e2bc3011b271be0a06e4cb4ed23c78"} May 21 16:14:27.816566 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:27.816533 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-544cd688cb-cx9hx"] May 21 16:14:27.818882 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:27.818861 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:14:27.822713 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:27.822682 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 21 16:14:27.822851 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:27.822736 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 21 16:14:27.822851 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:27.822747 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-b2xgg\"" May 21 16:14:27.822851 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:27.822682 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 21 16:14:27.823030 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:27.822998 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-69d5886cj2v2r\"" May 21 16:14:27.823086 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:27.823066 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 21 16:14:27.827987 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:27.827938 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-544cd688cb-cx9hx"] May 21 16:14:27.915368 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:27.915331 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/05cf32c8-b9ab-492e-8e5c-25d573f0d733-metrics-server-audit-profiles\") pod \"metrics-server-544cd688cb-cx9hx\" (UID: \"05cf32c8-b9ab-492e-8e5c-25d573f0d733\") " pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:14:27.915514 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:27.915378 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/05cf32c8-b9ab-492e-8e5c-25d573f0d733-audit-log\") pod \"metrics-server-544cd688cb-cx9hx\" (UID: \"05cf32c8-b9ab-492e-8e5c-25d573f0d733\") " pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:14:27.915514 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:27.915400 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/05cf32c8-b9ab-492e-8e5c-25d573f0d733-secret-metrics-server-client-certs\") pod \"metrics-server-544cd688cb-cx9hx\" (UID: \"05cf32c8-b9ab-492e-8e5c-25d573f0d733\") " pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:14:27.915514 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:27.915489 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05cf32c8-b9ab-492e-8e5c-25d573f0d733-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-544cd688cb-cx9hx\" (UID: \"05cf32c8-b9ab-492e-8e5c-25d573f0d733\") " pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:14:27.915630 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:27.915520 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/05cf32c8-b9ab-492e-8e5c-25d573f0d733-secret-metrics-server-tls\") pod \"metrics-server-544cd688cb-cx9hx\" (UID: \"05cf32c8-b9ab-492e-8e5c-25d573f0d733\") " pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:14:27.915630 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:27.915550 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/05cf32c8-b9ab-492e-8e5c-25d573f0d733-client-ca-bundle\") pod \"metrics-server-544cd688cb-cx9hx\" (UID: \"05cf32c8-b9ab-492e-8e5c-25d573f0d733\") " pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:14:27.915630 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:27.915610 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h42wv\" (UniqueName: \"kubernetes.io/projected/05cf32c8-b9ab-492e-8e5c-25d573f0d733-kube-api-access-h42wv\") pod \"metrics-server-544cd688cb-cx9hx\" (UID: \"05cf32c8-b9ab-492e-8e5c-25d573f0d733\") " pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:14:28.016792 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:28.016756 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05cf32c8-b9ab-492e-8e5c-25d573f0d733-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-544cd688cb-cx9hx\" (UID: \"05cf32c8-b9ab-492e-8e5c-25d573f0d733\") " pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:14:28.016792 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:28.016798 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/05cf32c8-b9ab-492e-8e5c-25d573f0d733-secret-metrics-server-tls\") pod \"metrics-server-544cd688cb-cx9hx\" (UID: \"05cf32c8-b9ab-492e-8e5c-25d573f0d733\") " pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:14:28.017272 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:28.016853 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/05cf32c8-b9ab-492e-8e5c-25d573f0d733-client-ca-bundle\") pod \"metrics-server-544cd688cb-cx9hx\" (UID: \"05cf32c8-b9ab-492e-8e5c-25d573f0d733\") " pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:14:28.017272 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:28.016900 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h42wv\" (UniqueName: \"kubernetes.io/projected/05cf32c8-b9ab-492e-8e5c-25d573f0d733-kube-api-access-h42wv\") pod \"metrics-server-544cd688cb-cx9hx\" (UID: \"05cf32c8-b9ab-492e-8e5c-25d573f0d733\") " pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:14:28.017272 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:28.016971 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/05cf32c8-b9ab-492e-8e5c-25d573f0d733-metrics-server-audit-profiles\") pod \"metrics-server-544cd688cb-cx9hx\" (UID: \"05cf32c8-b9ab-492e-8e5c-25d573f0d733\") " pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:14:28.017272 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:28.017010 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/05cf32c8-b9ab-492e-8e5c-25d573f0d733-audit-log\") pod \"metrics-server-544cd688cb-cx9hx\" (UID: \"05cf32c8-b9ab-492e-8e5c-25d573f0d733\") " pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:14:28.017272 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:28.017037 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/05cf32c8-b9ab-492e-8e5c-25d573f0d733-secret-metrics-server-client-certs\") pod \"metrics-server-544cd688cb-cx9hx\" (UID: \"05cf32c8-b9ab-492e-8e5c-25d573f0d733\") " pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:14:28.017517 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:28.017477 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/05cf32c8-b9ab-492e-8e5c-25d573f0d733-audit-log\") pod \"metrics-server-544cd688cb-cx9hx\" (UID: \"05cf32c8-b9ab-492e-8e5c-25d573f0d733\") " pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:14:28.017690 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:28.017666 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05cf32c8-b9ab-492e-8e5c-25d573f0d733-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-544cd688cb-cx9hx\" (UID: \"05cf32c8-b9ab-492e-8e5c-25d573f0d733\") " pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:14:28.018041 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:28.018018 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/05cf32c8-b9ab-492e-8e5c-25d573f0d733-metrics-server-audit-profiles\") pod \"metrics-server-544cd688cb-cx9hx\" (UID: \"05cf32c8-b9ab-492e-8e5c-25d573f0d733\") " pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:14:28.019517 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:28.019481 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/05cf32c8-b9ab-492e-8e5c-25d573f0d733-client-ca-bundle\") pod \"metrics-server-544cd688cb-cx9hx\" (UID: \"05cf32c8-b9ab-492e-8e5c-25d573f0d733\") " pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:14:28.019862 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:28.019844 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/05cf32c8-b9ab-492e-8e5c-25d573f0d733-secret-metrics-server-client-certs\") pod \"metrics-server-544cd688cb-cx9hx\" (UID: \"05cf32c8-b9ab-492e-8e5c-25d573f0d733\") " pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:14:28.020026 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:28.020005 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/05cf32c8-b9ab-492e-8e5c-25d573f0d733-secret-metrics-server-tls\") pod \"metrics-server-544cd688cb-cx9hx\" (UID: \"05cf32c8-b9ab-492e-8e5c-25d573f0d733\") " pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:14:28.025804 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:28.025780 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h42wv\" (UniqueName: \"kubernetes.io/projected/05cf32c8-b9ab-492e-8e5c-25d573f0d733-kube-api-access-h42wv\") pod \"metrics-server-544cd688cb-cx9hx\" (UID: \"05cf32c8-b9ab-492e-8e5c-25d573f0d733\") " pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:14:28.130736 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:28.130699 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:14:28.275257 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:28.275225 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-544cd688cb-cx9hx"] May 21 16:14:28.278311 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:14:28.278267 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05cf32c8_b9ab_492e_8e5c_25d573f0d733.slice/crio-d0f68e4309728ba3ba5995f1ce2d2bc04db5a721f477190bf09d5c51b7674804 WatchSource:0}: Error finding container d0f68e4309728ba3ba5995f1ce2d2bc04db5a721f477190bf09d5c51b7674804: Status 404 returned error can't find the container with id d0f68e4309728ba3ba5995f1ce2d2bc04db5a721f477190bf09d5c51b7674804 May 21 16:14:28.713697 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:28.713651 2547 patch_prober.go:28] interesting pod/image-registry-7cb47f7d76-kl985 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 21 16:14:28.713882 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:28.713722 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" podUID="33505023-9fe3-4cad-a874-0b521d2f254e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 16:14:28.935204 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:28.935179 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" event={"ID":"05cf32c8-b9ab-492e-8e5c-25d573f0d733","Type":"ContainerStarted","Data":"d0f68e4309728ba3ba5995f1ce2d2bc04db5a721f477190bf09d5c51b7674804"} May 21 16:14:29.064799 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:29.064768 2547 patch_prober.go:28] interesting pod/image-registry-89949c9b6-2ll9b container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 21 16:14:29.065108 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:29.064838 2547 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" podUID="1aab8dfd-75ed-419d-8ea2-38c42d1d6d86" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 16:14:29.941340 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:29.941309 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cbc9ba35-c11d-4655-8a65-039918a71090","Type":"ContainerStarted","Data":"916cd19b10dcafe9fc828cfcfcb11ad5206a380db27b1c9d777c5d404f451b73"} May 21 16:14:29.941340 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:29.941346 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cbc9ba35-c11d-4655-8a65-039918a71090","Type":"ContainerStarted","Data":"7f7f58020f7a98473c59f9e2b29ff424f7d946db1fbf6b2dba91f3bda990fdf0"} May 21 16:14:29.941654 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:29.941360 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cbc9ba35-c11d-4655-8a65-039918a71090","Type":"ContainerStarted","Data":"d1bf25781d207ff55510552655820ebc2c594aca84c931b2219b336aa2db7e6a"} May 21 16:14:29.941654 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:29.941373 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cbc9ba35-c11d-4655-8a65-039918a71090","Type":"ContainerStarted","Data":"412302c657fac7ac3421b3bb48d87ac7a18e8bddfbc21ae29745f1e6b0d51b96"} May 21 16:14:29.941654 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:29.941381 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cbc9ba35-c11d-4655-8a65-039918a71090","Type":"ContainerStarted","Data":"839b70a8dcc2dd40f47b4f8fa3e2ef1d445637f5480defdd32a2e7dce5475d77"} May 21 16:14:30.857200 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:30.857166 2547 patch_prober.go:28] interesting pod/image-registry-89949c9b6-2ll9b container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 21 16:14:30.857559 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:30.857217 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" podUID="1aab8dfd-75ed-419d-8ea2-38c42d1d6d86" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 16:14:30.902662 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:30.902632 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-984s7" May 21 16:14:30.947664 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:30.947626 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cbc9ba35-c11d-4655-8a65-039918a71090","Type":"ContainerStarted","Data":"84b9f54ec5aa71e009d16d100b93d2e7973ebf17f1f7d4c4bd532cb90bd110d4"} May 21 16:14:30.949117 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:30.949082 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" event={"ID":"05cf32c8-b9ab-492e-8e5c-25d573f0d733","Type":"ContainerStarted","Data":"61ae91c58a52c078ba847a50e5320f40ed4542e3a4775fd203ab2e7e3699e0a4"} May 21 16:14:30.979710 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:30.979645 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.123684916 podStartE2EDuration="6.979623989s" podCreationTimestamp="2026-05-21 16:14:24 +0000 UTC" firstStartedPulling="2026-05-21 16:14:25.457350617 +0000 UTC m=+170.756071495" lastFinishedPulling="2026-05-21 16:14:30.313289687 +0000 UTC m=+175.612010568" observedRunningTime="2026-05-21 16:14:30.9759185 +0000 UTC m=+176.274639411" watchObservedRunningTime="2026-05-21 16:14:30.979623989 +0000 UTC m=+176.278344892" May 21 16:14:30.997734 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:30.997672 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" podStartSLOduration=1.9677439209999998 podStartE2EDuration="3.997652177s" podCreationTimestamp="2026-05-21 16:14:27 +0000 UTC" firstStartedPulling="2026-05-21 16:14:28.281844857 +0000 UTC m=+173.580565752" lastFinishedPulling="2026-05-21 16:14:30.311753107 +0000 UTC m=+175.610474008" observedRunningTime="2026-05-21 16:14:30.99610599 +0000 UTC m=+176.294826903" watchObservedRunningTime="2026-05-21 16:14:30.997652177 +0000 UTC m=+176.296373080" May 21 16:14:33.726619 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:33.726551 2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" podUID="33505023-9fe3-4cad-a874-0b521d2f254e" containerName="registry" containerID="cri-o://fe2ec41f5132e69541c0c71c93c271571dc861ce6b3e19976f6d10bf0db2d065" gracePeriod=30 May 21 16:14:33.959743 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:33.959715 2547 generic.go:358] "Generic (PLEG): container finished" podID="33505023-9fe3-4cad-a874-0b521d2f254e" containerID="fe2ec41f5132e69541c0c71c93c271571dc861ce6b3e19976f6d10bf0db2d065" exitCode=0 May 21 16:14:33.959862 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:33.959771 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" event={"ID":"33505023-9fe3-4cad-a874-0b521d2f254e","Type":"ContainerDied","Data":"fe2ec41f5132e69541c0c71c93c271571dc861ce6b3e19976f6d10bf0db2d065"} May 21 16:14:33.959862 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:33.959795 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" event={"ID":"33505023-9fe3-4cad-a874-0b521d2f254e","Type":"ContainerDied","Data":"38363b11ab24556b4346714eb341cfd47c9bc6675b1fbbae39a72de8c323971b"} May 21 16:14:33.959862 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:33.959807 2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38363b11ab24556b4346714eb341cfd47c9bc6675b1fbbae39a72de8c323971b" May 21 16:14:33.966794 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:33.966776 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:14:33.972077 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:33.972060 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-bound-sa-token\") pod \"33505023-9fe3-4cad-a874-0b521d2f254e\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " May 21 16:14:33.972167 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:33.972089 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/33505023-9fe3-4cad-a874-0b521d2f254e-image-registry-private-configuration\") pod \"33505023-9fe3-4cad-a874-0b521d2f254e\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " May 21 16:14:33.972167 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:33.972133 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfw78\" (UniqueName: \"kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-kube-api-access-rfw78\") pod \"33505023-9fe3-4cad-a874-0b521d2f254e\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " May 21 16:14:33.972167 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:33.972160 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/33505023-9fe3-4cad-a874-0b521d2f254e-registry-certificates\") pod \"33505023-9fe3-4cad-a874-0b521d2f254e\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " May 21 16:14:33.972321 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:33.972192 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33505023-9fe3-4cad-a874-0b521d2f254e-trusted-ca\") pod \"33505023-9fe3-4cad-a874-0b521d2f254e\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " May 21 16:14:33.972321 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:33.972277 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/33505023-9fe3-4cad-a874-0b521d2f254e-installation-pull-secrets\") pod \"33505023-9fe3-4cad-a874-0b521d2f254e\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " May 21 16:14:33.972321 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:33.972315 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-registry-tls\") pod \"33505023-9fe3-4cad-a874-0b521d2f254e\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " May 21 16:14:33.972462 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:33.972344 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/33505023-9fe3-4cad-a874-0b521d2f254e-ca-trust-extracted\") pod \"33505023-9fe3-4cad-a874-0b521d2f254e\" (UID: \"33505023-9fe3-4cad-a874-0b521d2f254e\") " May 21 16:14:33.972689 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:33.972637 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33505023-9fe3-4cad-a874-0b521d2f254e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "33505023-9fe3-4cad-a874-0b521d2f254e" (UID: "33505023-9fe3-4cad-a874-0b521d2f254e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 16:14:33.972913 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:33.972851 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33505023-9fe3-4cad-a874-0b521d2f254e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "33505023-9fe3-4cad-a874-0b521d2f254e" (UID: "33505023-9fe3-4cad-a874-0b521d2f254e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 16:14:33.974571 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:33.974543 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33505023-9fe3-4cad-a874-0b521d2f254e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "33505023-9fe3-4cad-a874-0b521d2f254e" (UID: "33505023-9fe3-4cad-a874-0b521d2f254e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 16:14:33.974688 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:33.974566 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-kube-api-access-rfw78" (OuterVolumeSpecName: "kube-api-access-rfw78") pod "33505023-9fe3-4cad-a874-0b521d2f254e" (UID: "33505023-9fe3-4cad-a874-0b521d2f254e"). InnerVolumeSpecName "kube-api-access-rfw78". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:14:33.974688 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:33.974656 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33505023-9fe3-4cad-a874-0b521d2f254e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "33505023-9fe3-4cad-a874-0b521d2f254e" (UID: "33505023-9fe3-4cad-a874-0b521d2f254e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 16:14:33.974850 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:33.974812 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "33505023-9fe3-4cad-a874-0b521d2f254e" (UID: "33505023-9fe3-4cad-a874-0b521d2f254e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:14:33.974938 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:33.974917 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "33505023-9fe3-4cad-a874-0b521d2f254e" (UID: "33505023-9fe3-4cad-a874-0b521d2f254e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:14:33.981249 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:33.981224 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33505023-9fe3-4cad-a874-0b521d2f254e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "33505023-9fe3-4cad-a874-0b521d2f254e" (UID: "33505023-9fe3-4cad-a874-0b521d2f254e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:14:34.073577 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:34.073535 2547 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/33505023-9fe3-4cad-a874-0b521d2f254e-installation-pull-secrets\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:14:34.073577 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:34.073569 2547 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-registry-tls\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:14:34.073577 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:34.073579 2547 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/33505023-9fe3-4cad-a874-0b521d2f254e-ca-trust-extracted\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:14:34.073577 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:34.073589 2547 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-bound-sa-token\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:14:34.073872 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:34.073598 2547 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/33505023-9fe3-4cad-a874-0b521d2f254e-image-registry-private-configuration\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:14:34.073872 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:34.073608 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfw78\" (UniqueName: \"kubernetes.io/projected/33505023-9fe3-4cad-a874-0b521d2f254e-kube-api-access-rfw78\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:14:34.073872 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:34.073616 2547 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/33505023-9fe3-4cad-a874-0b521d2f254e-registry-certificates\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:14:34.073872 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:34.073627 2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33505023-9fe3-4cad-a874-0b521d2f254e-trusted-ca\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:14:34.966344 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:34.963320 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cb47f7d76-kl985" May 21 16:14:34.985003 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:34.984974 2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7cb47f7d76-kl985"] May 21 16:14:34.988663 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:34.988640 2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7cb47f7d76-kl985"] May 21 16:14:35.331410 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:35.331378 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33505023-9fe3-4cad-a874-0b521d2f254e" path="/var/lib/kubelet/pods/33505023-9fe3-4cad-a874-0b521d2f254e/volumes" May 21 16:14:39.064654 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:39.064619 2547 patch_prober.go:28] interesting pod/image-registry-89949c9b6-2ll9b container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 21 16:14:39.065064 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:39.064672 2547 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" podUID="1aab8dfd-75ed-419d-8ea2-38c42d1d6d86" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 16:14:40.857207 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:40.857176 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-89949c9b6-2ll9b" May 21 16:14:40.982718 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:40.982570 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" event={"ID":"f978a1e0-aaef-4dc6-b7ec-44a113855270","Type":"ContainerStarted","Data":"95a22402a0cb69e56bf31a31f12bc6e51ba186a7ed77a9a1612a9b57e16f93c9"} May 21 16:14:41.003967 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:41.003887 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bv2z6" podStartSLOduration=0.892033886 podStartE2EDuration="18.003865758s" podCreationTimestamp="2026-05-21 16:14:23 +0000 UTC" firstStartedPulling="2026-05-21 16:14:23.764706422 +0000 UTC m=+169.063427302" lastFinishedPulling="2026-05-21 16:14:40.876538295 +0000 UTC m=+186.175259174" observedRunningTime="2026-05-21 16:14:41.002841238 +0000 UTC m=+186.301562139" watchObservedRunningTime="2026-05-21 16:14:41.003865758 +0000 UTC m=+186.302586662" May 21 16:14:48.131330 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:48.131289 2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:14:48.131330 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:14:48.131336 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:15:00.040071 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:00.039982 2547 generic.go:358] "Generic (PLEG): container finished" podID="192b3e8b-5e9a-4390-bbe2-a481491eca79" containerID="ca76bdd6436514aaac5f7de349eb90d61050ca21cb574fb80890a7593c27212c" exitCode=0 May 21 16:15:00.040071 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:00.040038 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-n5c9z" event={"ID":"192b3e8b-5e9a-4390-bbe2-a481491eca79","Type":"ContainerDied","Data":"ca76bdd6436514aaac5f7de349eb90d61050ca21cb574fb80890a7593c27212c"} May 21 16:15:00.040470 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:00.040387 2547 scope.go:117] "RemoveContainer" containerID="ca76bdd6436514aaac5f7de349eb90d61050ca21cb574fb80890a7593c27212c" May 21 16:15:01.043884 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:01.043855 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-n5c9z" event={"ID":"192b3e8b-5e9a-4390-bbe2-a481491eca79","Type":"ContainerStarted","Data":"f7117602339911a0cc74e66baccc5f8c80cde58606b0bef512acd527a9e5c458"} May 21 16:15:01.519696 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:01.519664 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-984s7_44ebd433-29f6-4471-8518-b23a3b13be79/dns/0.log" May 21 16:15:01.718996 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:01.718961 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-984s7_44ebd433-29f6-4471-8518-b23a3b13be79/kube-rbac-proxy/0.log" May 21 16:15:02.319190 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:02.319160 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vbmn8_7b9dc463-4392-4994-9467-5979208be3e2/dns-node-resolver/0.log" May 21 16:15:02.518930 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:02.518895 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f5959664-vpn5f_7438a0cb-f85b-4259-8030-9c9840e39fb9/router/0.log" May 21 16:15:02.919041 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:02.919013 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-82shb_0593535c-9146-4f09-8845-dc1bd5e79c6b/serve-healthcheck-canary/0.log" May 21 16:15:08.137188 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:08.137156 2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:15:08.141455 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:08.141431 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-544cd688cb-cx9hx" May 21 16:15:11.074684 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:11.074645 2547 generic.go:358] "Generic (PLEG): container finished" podID="066361a8-80f2-4d49-9f40-23277e538536" containerID="ff2eb0e89f3e4ea62da94908b9cb20f57f928d3120c099e300ffe9be1be8126f" exitCode=0 May 21 16:15:11.075071 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:11.074700 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-z6wwz" event={"ID":"066361a8-80f2-4d49-9f40-23277e538536","Type":"ContainerDied","Data":"ff2eb0e89f3e4ea62da94908b9cb20f57f928d3120c099e300ffe9be1be8126f"} May 21 16:15:11.075143 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:11.075125 2547 scope.go:117] "RemoveContainer" containerID="ff2eb0e89f3e4ea62da94908b9cb20f57f928d3120c099e300ffe9be1be8126f" May 21 16:15:12.082679 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:12.082641 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-z6wwz" event={"ID":"066361a8-80f2-4d49-9f40-23277e538536","Type":"ContainerStarted","Data":"094b11a904c26c711656bc0804a51b6398393ac7e6e8925053ea25867d0c30bb"} May 21 16:15:16.095369 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:16.095331 2547 generic.go:358] "Generic (PLEG): container finished" podID="720b745b-9405-4dfd-b3cd-28f7a1841b92" containerID="fe898e8795a026311c527bbc95cd689ed6a522b8ce678f723d95226120b317eb" exitCode=0 May 21 16:15:16.095753 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:16.095389 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lvpcz" event={"ID":"720b745b-9405-4dfd-b3cd-28f7a1841b92","Type":"ContainerDied","Data":"fe898e8795a026311c527bbc95cd689ed6a522b8ce678f723d95226120b317eb"} May 21 16:15:16.095753 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:16.095680 2547 scope.go:117] "RemoveContainer" containerID="fe898e8795a026311c527bbc95cd689ed6a522b8ce678f723d95226120b317eb" May 21 16:15:17.099873 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:17.099835 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lvpcz" event={"ID":"720b745b-9405-4dfd-b3cd-28f7a1841b92","Type":"ContainerStarted","Data":"95e6a7bc0d96c438e0998f335af40f036d460790d70dca303730b61f91fa8aef"} May 21 16:15:43.552348 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:43.552309 2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 16:15:43.552884 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:43.552851 2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="alertmanager" containerID="cri-o://839b70a8dcc2dd40f47b4f8fa3e2ef1d445637f5480defdd32a2e7dce5475d77" gracePeriod=120 May 21 16:15:43.552963 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:43.552874 2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="kube-rbac-proxy-web" containerID="cri-o://d1bf25781d207ff55510552655820ebc2c594aca84c931b2219b336aa2db7e6a" gracePeriod=120 May 21 16:15:43.552963 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:43.552881 2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="kube-rbac-proxy" containerID="cri-o://7f7f58020f7a98473c59f9e2b29ff424f7d946db1fbf6b2dba91f3bda990fdf0" gracePeriod=120 May 21 16:15:43.552963 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:43.552869 2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="kube-rbac-proxy-metric" containerID="cri-o://916cd19b10dcafe9fc828cfcfcb11ad5206a380db27b1c9d777c5d404f451b73" gracePeriod=120 May 21 16:15:43.552963 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:43.552911 2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="prom-label-proxy" containerID="cri-o://84b9f54ec5aa71e009d16d100b93d2e7973ebf17f1f7d4c4bd532cb90bd110d4" gracePeriod=120 May 21 16:15:43.553118 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:43.552920 2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="config-reloader" containerID="cri-o://412302c657fac7ac3421b3bb48d87ac7a18e8bddfbc21ae29745f1e6b0d51b96" gracePeriod=120 May 21 16:15:44.179018 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.178984 2547 generic.go:358] "Generic (PLEG): container finished" podID="cbc9ba35-c11d-4655-8a65-039918a71090" containerID="84b9f54ec5aa71e009d16d100b93d2e7973ebf17f1f7d4c4bd532cb90bd110d4" exitCode=0 May 21 16:15:44.179018 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.179012 2547 generic.go:358] "Generic (PLEG): container finished" podID="cbc9ba35-c11d-4655-8a65-039918a71090" containerID="7f7f58020f7a98473c59f9e2b29ff424f7d946db1fbf6b2dba91f3bda990fdf0" exitCode=0 May 21 16:15:44.179018 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.179019 2547 generic.go:358] "Generic (PLEG): container finished" podID="cbc9ba35-c11d-4655-8a65-039918a71090" containerID="412302c657fac7ac3421b3bb48d87ac7a18e8bddfbc21ae29745f1e6b0d51b96" exitCode=0 May 21 16:15:44.179018 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.179025 2547 generic.go:358] "Generic (PLEG): container finished" podID="cbc9ba35-c11d-4655-8a65-039918a71090" containerID="839b70a8dcc2dd40f47b4f8fa3e2ef1d445637f5480defdd32a2e7dce5475d77" exitCode=0 May 21 16:15:44.179309 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.179064 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cbc9ba35-c11d-4655-8a65-039918a71090","Type":"ContainerDied","Data":"84b9f54ec5aa71e009d16d100b93d2e7973ebf17f1f7d4c4bd532cb90bd110d4"} May 21 16:15:44.179309 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.179107 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cbc9ba35-c11d-4655-8a65-039918a71090","Type":"ContainerDied","Data":"7f7f58020f7a98473c59f9e2b29ff424f7d946db1fbf6b2dba91f3bda990fdf0"} May 21 16:15:44.179309 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.179121 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cbc9ba35-c11d-4655-8a65-039918a71090","Type":"ContainerDied","Data":"412302c657fac7ac3421b3bb48d87ac7a18e8bddfbc21ae29745f1e6b0d51b96"} May 21 16:15:44.179309 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.179133 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cbc9ba35-c11d-4655-8a65-039918a71090","Type":"ContainerDied","Data":"839b70a8dcc2dd40f47b4f8fa3e2ef1d445637f5480defdd32a2e7dce5475d77"} May 21 16:15:44.790722 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.790696 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:44.901424 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.901329 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbc9ba35-c11d-4655-8a65-039918a71090-alertmanager-trusted-ca-bundle\") pod \"cbc9ba35-c11d-4655-8a65-039918a71090\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " May 21 16:15:44.901424 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.901369 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-config-volume\") pod \"cbc9ba35-c11d-4655-8a65-039918a71090\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " May 21 16:15:44.901424 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.901393 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2v7p\" (UniqueName: \"kubernetes.io/projected/cbc9ba35-c11d-4655-8a65-039918a71090-kube-api-access-h2v7p\") pod \"cbc9ba35-c11d-4655-8a65-039918a71090\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " May 21 16:15:44.901700 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.901438 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cbc9ba35-c11d-4655-8a65-039918a71090-tls-assets\") pod \"cbc9ba35-c11d-4655-8a65-039918a71090\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " May 21 16:15:44.901700 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.901482 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-kube-rbac-proxy\") pod \"cbc9ba35-c11d-4655-8a65-039918a71090\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " May 21 16:15:44.901700 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.901520 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-kube-rbac-proxy-web\") pod \"cbc9ba35-c11d-4655-8a65-039918a71090\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " May 21 16:15:44.901700 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.901553 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cbc9ba35-c11d-4655-8a65-039918a71090-config-out\") pod \"cbc9ba35-c11d-4655-8a65-039918a71090\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " May 21 16:15:44.901700 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.901587 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cbc9ba35-c11d-4655-8a65-039918a71090-alertmanager-main-db\") pod \"cbc9ba35-c11d-4655-8a65-039918a71090\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " May 21 16:15:44.901977 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.901888 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbc9ba35-c11d-4655-8a65-039918a71090-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "cbc9ba35-c11d-4655-8a65-039918a71090" (UID: "cbc9ba35-c11d-4655-8a65-039918a71090"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 16:15:44.902032 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.901971 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbc9ba35-c11d-4655-8a65-039918a71090-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "cbc9ba35-c11d-4655-8a65-039918a71090" (UID: "cbc9ba35-c11d-4655-8a65-039918a71090"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:15:44.902087 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.902023 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-kube-rbac-proxy-metric\") pod \"cbc9ba35-c11d-4655-8a65-039918a71090\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " May 21 16:15:44.902087 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.902069 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-web-config\") pod \"cbc9ba35-c11d-4655-8a65-039918a71090\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " May 21 16:15:44.902184 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.902112 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-cluster-tls-config\") pod \"cbc9ba35-c11d-4655-8a65-039918a71090\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " May 21 16:15:44.902236 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.902185 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-main-tls\") pod \"cbc9ba35-c11d-4655-8a65-039918a71090\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " May 21 16:15:44.902236 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.902219 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbc9ba35-c11d-4655-8a65-039918a71090-metrics-client-ca\") pod \"cbc9ba35-c11d-4655-8a65-039918a71090\" (UID: \"cbc9ba35-c11d-4655-8a65-039918a71090\") " May 21 16:15:44.902800 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.902509 2547 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cbc9ba35-c11d-4655-8a65-039918a71090-alertmanager-main-db\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:15:44.902800 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.902536 2547 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbc9ba35-c11d-4655-8a65-039918a71090-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:15:44.903205 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.903162 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbc9ba35-c11d-4655-8a65-039918a71090-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "cbc9ba35-c11d-4655-8a65-039918a71090" (UID: "cbc9ba35-c11d-4655-8a65-039918a71090"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 16:15:44.904400 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.904365 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "cbc9ba35-c11d-4655-8a65-039918a71090" (UID: "cbc9ba35-c11d-4655-8a65-039918a71090"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 16:15:44.904536 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.904416 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "cbc9ba35-c11d-4655-8a65-039918a71090" (UID: "cbc9ba35-c11d-4655-8a65-039918a71090"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 16:15:44.904774 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.904748 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbc9ba35-c11d-4655-8a65-039918a71090-kube-api-access-h2v7p" (OuterVolumeSpecName: "kube-api-access-h2v7p") pod "cbc9ba35-c11d-4655-8a65-039918a71090" (UID: "cbc9ba35-c11d-4655-8a65-039918a71090"). InnerVolumeSpecName "kube-api-access-h2v7p". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:15:44.904973 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.904932 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-config-volume" (OuterVolumeSpecName: "config-volume") pod "cbc9ba35-c11d-4655-8a65-039918a71090" (UID: "cbc9ba35-c11d-4655-8a65-039918a71090"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 16:15:44.904973 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.904948 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbc9ba35-c11d-4655-8a65-039918a71090-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "cbc9ba35-c11d-4655-8a65-039918a71090" (UID: "cbc9ba35-c11d-4655-8a65-039918a71090"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:15:44.905142 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.905119 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbc9ba35-c11d-4655-8a65-039918a71090-config-out" (OuterVolumeSpecName: "config-out") pod "cbc9ba35-c11d-4655-8a65-039918a71090" (UID: "cbc9ba35-c11d-4655-8a65-039918a71090"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:15:44.905610 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.905581 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "cbc9ba35-c11d-4655-8a65-039918a71090" (UID: "cbc9ba35-c11d-4655-8a65-039918a71090"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 16:15:44.905691 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.905674 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "cbc9ba35-c11d-4655-8a65-039918a71090" (UID: "cbc9ba35-c11d-4655-8a65-039918a71090"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 16:15:44.910033 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.910008 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "cbc9ba35-c11d-4655-8a65-039918a71090" (UID: "cbc9ba35-c11d-4655-8a65-039918a71090"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 16:15:44.916052 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:44.916031 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-web-config" (OuterVolumeSpecName: "web-config") pod "cbc9ba35-c11d-4655-8a65-039918a71090" (UID: "cbc9ba35-c11d-4655-8a65-039918a71090"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 16:15:45.003760 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.003713 2547 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbc9ba35-c11d-4655-8a65-039918a71090-metrics-client-ca\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:15:45.003760 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.003758 2547 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-config-volume\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:15:45.003760 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.003772 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2v7p\" (UniqueName: \"kubernetes.io/projected/cbc9ba35-c11d-4655-8a65-039918a71090-kube-api-access-h2v7p\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:15:45.003760 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.003781 2547 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cbc9ba35-c11d-4655-8a65-039918a71090-tls-assets\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:15:45.004036 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.003791 2547 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:15:45.004036 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.003801 2547 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:15:45.004036 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.003810 2547 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cbc9ba35-c11d-4655-8a65-039918a71090-config-out\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:15:45.004036 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.003851 2547 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:15:45.004036 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.003868 2547 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-web-config\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:15:45.004036 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.003881 2547 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-cluster-tls-config\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:15:45.004036 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.003895 2547 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cbc9ba35-c11d-4655-8a65-039918a71090-secret-alertmanager-main-tls\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:15:45.184456 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.184370 2547 generic.go:358] "Generic (PLEG): container finished" podID="cbc9ba35-c11d-4655-8a65-039918a71090" containerID="916cd19b10dcafe9fc828cfcfcb11ad5206a380db27b1c9d777c5d404f451b73" exitCode=0 May 21 16:15:45.184456 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.184399 2547 generic.go:358] "Generic (PLEG): container finished" podID="cbc9ba35-c11d-4655-8a65-039918a71090" containerID="d1bf25781d207ff55510552655820ebc2c594aca84c931b2219b336aa2db7e6a" exitCode=0 May 21 16:15:45.184456 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.184437 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cbc9ba35-c11d-4655-8a65-039918a71090","Type":"ContainerDied","Data":"916cd19b10dcafe9fc828cfcfcb11ad5206a380db27b1c9d777c5d404f451b73"} May 21 16:15:45.184674 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.184468 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cbc9ba35-c11d-4655-8a65-039918a71090","Type":"ContainerDied","Data":"d1bf25781d207ff55510552655820ebc2c594aca84c931b2219b336aa2db7e6a"} May 21 16:15:45.184674 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.184474 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.184674 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.184481 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cbc9ba35-c11d-4655-8a65-039918a71090","Type":"ContainerDied","Data":"2dd251bb3b5c0dd2f85adb8a9f03061d7328e251d3fe8b6712270fb7fb526148"} May 21 16:15:45.184674 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.184498 2547 scope.go:117] "RemoveContainer" containerID="84b9f54ec5aa71e009d16d100b93d2e7973ebf17f1f7d4c4bd532cb90bd110d4" May 21 16:15:45.191837 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.191800 2547 scope.go:117] "RemoveContainer" containerID="916cd19b10dcafe9fc828cfcfcb11ad5206a380db27b1c9d777c5d404f451b73" May 21 16:15:45.198804 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.198787 2547 scope.go:117] "RemoveContainer" containerID="7f7f58020f7a98473c59f9e2b29ff424f7d946db1fbf6b2dba91f3bda990fdf0" May 21 16:15:45.205312 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.205292 2547 scope.go:117] "RemoveContainer" containerID="d1bf25781d207ff55510552655820ebc2c594aca84c931b2219b336aa2db7e6a" May 21 16:15:45.209983 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.209959 2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 16:15:45.212644 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.212625 2547 scope.go:117] "RemoveContainer" containerID="412302c657fac7ac3421b3bb48d87ac7a18e8bddfbc21ae29745f1e6b0d51b96" May 21 16:15:45.215935 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.215915 2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 16:15:45.219972 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.219946 2547 scope.go:117] "RemoveContainer" containerID="839b70a8dcc2dd40f47b4f8fa3e2ef1d445637f5480defdd32a2e7dce5475d77" May 21 16:15:45.226065 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.226052 2547 scope.go:117] "RemoveContainer" containerID="55dbb67ea3a4ce0b9c52bc88d6d0755de4e2bc3011b271be0a06e4cb4ed23c78" May 21 16:15:45.231963 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.231948 2547 scope.go:117] "RemoveContainer" containerID="84b9f54ec5aa71e009d16d100b93d2e7973ebf17f1f7d4c4bd532cb90bd110d4" May 21 16:15:45.232185 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:15:45.232165 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84b9f54ec5aa71e009d16d100b93d2e7973ebf17f1f7d4c4bd532cb90bd110d4\": container with ID starting with 84b9f54ec5aa71e009d16d100b93d2e7973ebf17f1f7d4c4bd532cb90bd110d4 not found: ID does not exist" containerID="84b9f54ec5aa71e009d16d100b93d2e7973ebf17f1f7d4c4bd532cb90bd110d4" May 21 16:15:45.232243 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.232191 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84b9f54ec5aa71e009d16d100b93d2e7973ebf17f1f7d4c4bd532cb90bd110d4"} err="failed to get container status \"84b9f54ec5aa71e009d16d100b93d2e7973ebf17f1f7d4c4bd532cb90bd110d4\": rpc error: code = NotFound desc = could not find container \"84b9f54ec5aa71e009d16d100b93d2e7973ebf17f1f7d4c4bd532cb90bd110d4\": container with ID starting with 84b9f54ec5aa71e009d16d100b93d2e7973ebf17f1f7d4c4bd532cb90bd110d4 not found: ID does not exist" May 21 16:15:45.232243 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.232222 2547 scope.go:117] "RemoveContainer" containerID="916cd19b10dcafe9fc828cfcfcb11ad5206a380db27b1c9d777c5d404f451b73" May 21 16:15:45.232458 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:15:45.232441 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"916cd19b10dcafe9fc828cfcfcb11ad5206a380db27b1c9d777c5d404f451b73\": container with ID starting with 916cd19b10dcafe9fc828cfcfcb11ad5206a380db27b1c9d777c5d404f451b73 not found: ID does not exist" containerID="916cd19b10dcafe9fc828cfcfcb11ad5206a380db27b1c9d777c5d404f451b73" May 21 16:15:45.232497 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.232465 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"916cd19b10dcafe9fc828cfcfcb11ad5206a380db27b1c9d777c5d404f451b73"} err="failed to get container status \"916cd19b10dcafe9fc828cfcfcb11ad5206a380db27b1c9d777c5d404f451b73\": rpc error: code = NotFound desc = could not find container \"916cd19b10dcafe9fc828cfcfcb11ad5206a380db27b1c9d777c5d404f451b73\": container with ID starting with 916cd19b10dcafe9fc828cfcfcb11ad5206a380db27b1c9d777c5d404f451b73 not found: ID does not exist" May 21 16:15:45.232497 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.232482 2547 scope.go:117] "RemoveContainer" containerID="7f7f58020f7a98473c59f9e2b29ff424f7d946db1fbf6b2dba91f3bda990fdf0" May 21 16:15:45.232714 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:15:45.232698 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f7f58020f7a98473c59f9e2b29ff424f7d946db1fbf6b2dba91f3bda990fdf0\": container with ID starting with 7f7f58020f7a98473c59f9e2b29ff424f7d946db1fbf6b2dba91f3bda990fdf0 not found: ID does not exist" containerID="7f7f58020f7a98473c59f9e2b29ff424f7d946db1fbf6b2dba91f3bda990fdf0" May 21 16:15:45.232752 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.232720 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f7f58020f7a98473c59f9e2b29ff424f7d946db1fbf6b2dba91f3bda990fdf0"} err="failed to get container status \"7f7f58020f7a98473c59f9e2b29ff424f7d946db1fbf6b2dba91f3bda990fdf0\": rpc error: code = NotFound desc = could not find container \"7f7f58020f7a98473c59f9e2b29ff424f7d946db1fbf6b2dba91f3bda990fdf0\": container with ID starting with 7f7f58020f7a98473c59f9e2b29ff424f7d946db1fbf6b2dba91f3bda990fdf0 not found: ID does not exist" May 21 16:15:45.232752 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.232732 2547 scope.go:117] "RemoveContainer" containerID="d1bf25781d207ff55510552655820ebc2c594aca84c931b2219b336aa2db7e6a" May 21 16:15:45.232999 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:15:45.232978 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1bf25781d207ff55510552655820ebc2c594aca84c931b2219b336aa2db7e6a\": container with ID starting with d1bf25781d207ff55510552655820ebc2c594aca84c931b2219b336aa2db7e6a not found: ID does not exist" containerID="d1bf25781d207ff55510552655820ebc2c594aca84c931b2219b336aa2db7e6a" May 21 16:15:45.233040 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.233005 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1bf25781d207ff55510552655820ebc2c594aca84c931b2219b336aa2db7e6a"} err="failed to get container status \"d1bf25781d207ff55510552655820ebc2c594aca84c931b2219b336aa2db7e6a\": rpc error: code = NotFound desc = could not find container \"d1bf25781d207ff55510552655820ebc2c594aca84c931b2219b336aa2db7e6a\": container with ID starting with d1bf25781d207ff55510552655820ebc2c594aca84c931b2219b336aa2db7e6a not found: ID does not exist" May 21 16:15:45.233040 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.233023 2547 scope.go:117] "RemoveContainer" containerID="412302c657fac7ac3421b3bb48d87ac7a18e8bddfbc21ae29745f1e6b0d51b96" May 21 16:15:45.233274 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:15:45.233254 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"412302c657fac7ac3421b3bb48d87ac7a18e8bddfbc21ae29745f1e6b0d51b96\": container with ID starting with 412302c657fac7ac3421b3bb48d87ac7a18e8bddfbc21ae29745f1e6b0d51b96 not found: ID does not exist" containerID="412302c657fac7ac3421b3bb48d87ac7a18e8bddfbc21ae29745f1e6b0d51b96" May 21 16:15:45.233320 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.233278 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"412302c657fac7ac3421b3bb48d87ac7a18e8bddfbc21ae29745f1e6b0d51b96"} err="failed to get container status \"412302c657fac7ac3421b3bb48d87ac7a18e8bddfbc21ae29745f1e6b0d51b96\": rpc error: code = NotFound desc = could not find container \"412302c657fac7ac3421b3bb48d87ac7a18e8bddfbc21ae29745f1e6b0d51b96\": container with ID starting with 412302c657fac7ac3421b3bb48d87ac7a18e8bddfbc21ae29745f1e6b0d51b96 not found: ID does not exist" May 21 16:15:45.233320 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.233292 2547 scope.go:117] "RemoveContainer" containerID="839b70a8dcc2dd40f47b4f8fa3e2ef1d445637f5480defdd32a2e7dce5475d77" May 21 16:15:45.233500 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:15:45.233483 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"839b70a8dcc2dd40f47b4f8fa3e2ef1d445637f5480defdd32a2e7dce5475d77\": container with ID starting with 839b70a8dcc2dd40f47b4f8fa3e2ef1d445637f5480defdd32a2e7dce5475d77 not found: ID does not exist" containerID="839b70a8dcc2dd40f47b4f8fa3e2ef1d445637f5480defdd32a2e7dce5475d77" May 21 16:15:45.233560 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.233508 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"839b70a8dcc2dd40f47b4f8fa3e2ef1d445637f5480defdd32a2e7dce5475d77"} err="failed to get container status \"839b70a8dcc2dd40f47b4f8fa3e2ef1d445637f5480defdd32a2e7dce5475d77\": rpc error: code = NotFound desc = could not find container \"839b70a8dcc2dd40f47b4f8fa3e2ef1d445637f5480defdd32a2e7dce5475d77\": container with ID starting with 839b70a8dcc2dd40f47b4f8fa3e2ef1d445637f5480defdd32a2e7dce5475d77 not found: ID does not exist" May 21 16:15:45.233560 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.233530 2547 scope.go:117] "RemoveContainer" containerID="55dbb67ea3a4ce0b9c52bc88d6d0755de4e2bc3011b271be0a06e4cb4ed23c78" May 21 16:15:45.233747 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:15:45.233732 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55dbb67ea3a4ce0b9c52bc88d6d0755de4e2bc3011b271be0a06e4cb4ed23c78\": container with ID starting with 55dbb67ea3a4ce0b9c52bc88d6d0755de4e2bc3011b271be0a06e4cb4ed23c78 not found: ID does not exist" containerID="55dbb67ea3a4ce0b9c52bc88d6d0755de4e2bc3011b271be0a06e4cb4ed23c78" May 21 16:15:45.233784 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.233752 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55dbb67ea3a4ce0b9c52bc88d6d0755de4e2bc3011b271be0a06e4cb4ed23c78"} err="failed to get container status \"55dbb67ea3a4ce0b9c52bc88d6d0755de4e2bc3011b271be0a06e4cb4ed23c78\": rpc error: code = NotFound desc = could not find container \"55dbb67ea3a4ce0b9c52bc88d6d0755de4e2bc3011b271be0a06e4cb4ed23c78\": container with ID starting with 55dbb67ea3a4ce0b9c52bc88d6d0755de4e2bc3011b271be0a06e4cb4ed23c78 not found: ID does not exist" May 21 16:15:45.233784 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.233764 2547 scope.go:117] "RemoveContainer" containerID="84b9f54ec5aa71e009d16d100b93d2e7973ebf17f1f7d4c4bd532cb90bd110d4" May 21 16:15:45.234001 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.233984 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84b9f54ec5aa71e009d16d100b93d2e7973ebf17f1f7d4c4bd532cb90bd110d4"} err="failed to get container status \"84b9f54ec5aa71e009d16d100b93d2e7973ebf17f1f7d4c4bd532cb90bd110d4\": rpc error: code = NotFound desc = could not find container \"84b9f54ec5aa71e009d16d100b93d2e7973ebf17f1f7d4c4bd532cb90bd110d4\": container with ID starting with 84b9f54ec5aa71e009d16d100b93d2e7973ebf17f1f7d4c4bd532cb90bd110d4 not found: ID does not exist" May 21 16:15:45.234063 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.234003 2547 scope.go:117] "RemoveContainer" containerID="916cd19b10dcafe9fc828cfcfcb11ad5206a380db27b1c9d777c5d404f451b73" May 21 16:15:45.234200 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.234184 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"916cd19b10dcafe9fc828cfcfcb11ad5206a380db27b1c9d777c5d404f451b73"} err="failed to get container status \"916cd19b10dcafe9fc828cfcfcb11ad5206a380db27b1c9d777c5d404f451b73\": rpc error: code = NotFound desc = could not find container \"916cd19b10dcafe9fc828cfcfcb11ad5206a380db27b1c9d777c5d404f451b73\": container with ID starting with 916cd19b10dcafe9fc828cfcfcb11ad5206a380db27b1c9d777c5d404f451b73 not found: ID does not exist" May 21 16:15:45.234266 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.234201 2547 scope.go:117] "RemoveContainer" containerID="7f7f58020f7a98473c59f9e2b29ff424f7d946db1fbf6b2dba91f3bda990fdf0" May 21 16:15:45.234383 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.234367 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f7f58020f7a98473c59f9e2b29ff424f7d946db1fbf6b2dba91f3bda990fdf0"} err="failed to get container status \"7f7f58020f7a98473c59f9e2b29ff424f7d946db1fbf6b2dba91f3bda990fdf0\": rpc error: code = NotFound desc = could not find container \"7f7f58020f7a98473c59f9e2b29ff424f7d946db1fbf6b2dba91f3bda990fdf0\": container with ID starting with 7f7f58020f7a98473c59f9e2b29ff424f7d946db1fbf6b2dba91f3bda990fdf0 not found: ID does not exist" May 21 16:15:45.234448 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.234385 2547 scope.go:117] "RemoveContainer" containerID="d1bf25781d207ff55510552655820ebc2c594aca84c931b2219b336aa2db7e6a" May 21 16:15:45.234593 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.234575 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1bf25781d207ff55510552655820ebc2c594aca84c931b2219b336aa2db7e6a"} err="failed to get container status \"d1bf25781d207ff55510552655820ebc2c594aca84c931b2219b336aa2db7e6a\": rpc error: code = NotFound desc = could not find container \"d1bf25781d207ff55510552655820ebc2c594aca84c931b2219b336aa2db7e6a\": container with ID starting with d1bf25781d207ff55510552655820ebc2c594aca84c931b2219b336aa2db7e6a not found: ID does not exist" May 21 16:15:45.234635 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.234594 2547 scope.go:117] "RemoveContainer" containerID="412302c657fac7ac3421b3bb48d87ac7a18e8bddfbc21ae29745f1e6b0d51b96" May 21 16:15:45.234789 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.234765 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"412302c657fac7ac3421b3bb48d87ac7a18e8bddfbc21ae29745f1e6b0d51b96"} err="failed to get container status \"412302c657fac7ac3421b3bb48d87ac7a18e8bddfbc21ae29745f1e6b0d51b96\": rpc error: code = NotFound desc = could not find container \"412302c657fac7ac3421b3bb48d87ac7a18e8bddfbc21ae29745f1e6b0d51b96\": container with ID starting with 412302c657fac7ac3421b3bb48d87ac7a18e8bddfbc21ae29745f1e6b0d51b96 not found: ID does not exist" May 21 16:15:45.234789 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.234788 2547 scope.go:117] "RemoveContainer" containerID="839b70a8dcc2dd40f47b4f8fa3e2ef1d445637f5480defdd32a2e7dce5475d77" May 21 16:15:45.235097 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.235068 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"839b70a8dcc2dd40f47b4f8fa3e2ef1d445637f5480defdd32a2e7dce5475d77"} err="failed to get container status \"839b70a8dcc2dd40f47b4f8fa3e2ef1d445637f5480defdd32a2e7dce5475d77\": rpc error: code = NotFound desc = could not find container \"839b70a8dcc2dd40f47b4f8fa3e2ef1d445637f5480defdd32a2e7dce5475d77\": container with ID starting with 839b70a8dcc2dd40f47b4f8fa3e2ef1d445637f5480defdd32a2e7dce5475d77 not found: ID does not exist" May 21 16:15:45.235097 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.235088 2547 scope.go:117] "RemoveContainer" containerID="55dbb67ea3a4ce0b9c52bc88d6d0755de4e2bc3011b271be0a06e4cb4ed23c78" May 21 16:15:45.235408 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.235383 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55dbb67ea3a4ce0b9c52bc88d6d0755de4e2bc3011b271be0a06e4cb4ed23c78"} err="failed to get container status \"55dbb67ea3a4ce0b9c52bc88d6d0755de4e2bc3011b271be0a06e4cb4ed23c78\": rpc error: code = NotFound desc = could not find container \"55dbb67ea3a4ce0b9c52bc88d6d0755de4e2bc3011b271be0a06e4cb4ed23c78\": container with ID starting with 55dbb67ea3a4ce0b9c52bc88d6d0755de4e2bc3011b271be0a06e4cb4ed23c78 not found: ID does not exist" May 21 16:15:45.243803 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.243778 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 16:15:45.244086 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.244074 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="kube-rbac-proxy" May 21 16:15:45.244134 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.244088 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="kube-rbac-proxy" May 21 16:15:45.244134 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.244097 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="kube-rbac-proxy-web" May 21 16:15:45.244134 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.244104 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="kube-rbac-proxy-web" May 21 16:15:45.244134 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.244113 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="alertmanager" May 21 16:15:45.244134 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.244118 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="alertmanager" May 21 16:15:45.244134 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.244124 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33505023-9fe3-4cad-a874-0b521d2f254e" containerName="registry" May 21 16:15:45.244134 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.244129 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="33505023-9fe3-4cad-a874-0b521d2f254e" containerName="registry" May 21 16:15:45.244369 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.244140 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="config-reloader" May 21 16:15:45.244369 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.244146 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="config-reloader" May 21 16:15:45.244369 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.244153 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="kube-rbac-proxy-metric" May 21 16:15:45.244369 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.244158 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="kube-rbac-proxy-metric" May 21 16:15:45.244369 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.244169 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="init-config-reloader" May 21 16:15:45.244369 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.244174 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="init-config-reloader" May 21 16:15:45.244369 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.244182 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="prom-label-proxy" May 21 16:15:45.244369 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.244187 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="prom-label-proxy" May 21 16:15:45.244369 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.244228 2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="kube-rbac-proxy" May 21 16:15:45.244369 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.244234 2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="config-reloader" May 21 16:15:45.244369 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.244240 2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="kube-rbac-proxy-web" May 21 16:15:45.244369 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.244247 2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="33505023-9fe3-4cad-a874-0b521d2f254e" containerName="registry" May 21 16:15:45.244369 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.244253 2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="prom-label-proxy" May 21 16:15:45.244369 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.244260 2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="alertmanager" May 21 16:15:45.244369 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.244273 2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" containerName="kube-rbac-proxy-metric" May 21 16:15:45.249343 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.249328 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.252084 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.252060 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 21 16:15:45.252084 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.252076 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 21 16:15:45.252247 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.252092 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 21 16:15:45.252247 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.252076 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 21 16:15:45.252247 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.252076 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 21 16:15:45.252552 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.252537 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wfbqg\"" May 21 16:15:45.252701 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.252682 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 21 16:15:45.252775 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.252720 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 21 16:15:45.252775 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.252771 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 21 16:15:45.257404 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.257381 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 21 16:15:45.259915 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.259896 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 16:15:45.331558 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.331525 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbc9ba35-c11d-4655-8a65-039918a71090" path="/var/lib/kubelet/pods/cbc9ba35-c11d-4655-8a65-039918a71090/volumes" May 21 16:15:45.406155 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.406121 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h9mc\" (UniqueName: \"kubernetes.io/projected/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-kube-api-access-7h9mc\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.406155 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.406157 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.406395 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.406178 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.406395 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.406268 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.406395 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.406306 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.406395 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.406342 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.406577 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.406442 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.406577 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.406488 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-web-config\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.406577 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.406558 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-config-out\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.406679 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.406583 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.406679 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.406616 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.406679 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.406635 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-config-volume\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.406787 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.406701 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.507501 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.507412 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.507501 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.507457 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.507501 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.507489 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.507749 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.507720 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.507810 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.507772 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-web-config\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.507894 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.507851 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-config-out\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.507894 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.507884 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.507997 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.507927 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.508570 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.508538 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.508686 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.508611 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-config-volume\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.508686 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.508668 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.508804 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.508712 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7h9mc\" (UniqueName: \"kubernetes.io/projected/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-kube-api-access-7h9mc\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.508804 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.508732 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.508804 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.508744 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.508804 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.508788 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.510162 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.510131 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.510395 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.510361 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-config-out\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.511011 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.510808 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.511011 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.510965 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.511148 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.511098 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.511347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.511326 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.511429 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.511374 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-web-config\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.511429 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.511398 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.511516 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.511455 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.512501 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.512482 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-config-volume\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.517988 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.517967 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h9mc\" (UniqueName: \"kubernetes.io/projected/32c9a691-3b1c-4ccd-9b91-0434f8e4562f-kube-api-access-7h9mc\") pod \"alertmanager-main-0\" (UID: \"32c9a691-3b1c-4ccd-9b91-0434f8e4562f\") " pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.560156 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.560127 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 16:15:45.698508 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:45.698390 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 16:15:45.702608 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:15:45.702576 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32c9a691_3b1c_4ccd_9b91_0434f8e4562f.slice/crio-10e2e969fef2bffadbb02c5d5eda6012c99527b3df3a5603650163ac6ad1608b WatchSource:0}: Error finding container 10e2e969fef2bffadbb02c5d5eda6012c99527b3df3a5603650163ac6ad1608b: Status 404 returned error can't find the container with id 10e2e969fef2bffadbb02c5d5eda6012c99527b3df3a5603650163ac6ad1608b May 21 16:15:46.188886 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:46.188852 2547 generic.go:358] "Generic (PLEG): container finished" podID="32c9a691-3b1c-4ccd-9b91-0434f8e4562f" containerID="9159fb0119ec0167dace459949dc0fcf6fc1e5d3de67001ee6b19bb070971ba8" exitCode=0 May 21 16:15:46.189318 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:46.188943 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32c9a691-3b1c-4ccd-9b91-0434f8e4562f","Type":"ContainerDied","Data":"9159fb0119ec0167dace459949dc0fcf6fc1e5d3de67001ee6b19bb070971ba8"} May 21 16:15:46.189318 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:46.188989 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32c9a691-3b1c-4ccd-9b91-0434f8e4562f","Type":"ContainerStarted","Data":"10e2e969fef2bffadbb02c5d5eda6012c99527b3df3a5603650163ac6ad1608b"} May 21 16:15:47.123460 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.123417 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs\") pod \"network-metrics-daemon-49jxl\" (UID: \"44a88f02-4431-4214-9629-d63db994abfe\") " pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:15:47.125799 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.125772 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a88f02-4431-4214-9629-d63db994abfe-metrics-certs\") pod \"network-metrics-daemon-49jxl\" (UID: \"44a88f02-4431-4214-9629-d63db994abfe\") " pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:15:47.195859 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.195803 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32c9a691-3b1c-4ccd-9b91-0434f8e4562f","Type":"ContainerStarted","Data":"daff85ba7d273c878afd41e868cc5a6a9c5978202131240a59bb865c4e3ef765"} May 21 16:15:47.195859 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.195862 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32c9a691-3b1c-4ccd-9b91-0434f8e4562f","Type":"ContainerStarted","Data":"611c5e8f5cae885f55d869f68ee7b0d0f3a7b3cac8a529b7689452a5ae88ec03"} May 21 16:15:47.196254 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.195875 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32c9a691-3b1c-4ccd-9b91-0434f8e4562f","Type":"ContainerStarted","Data":"065fb3574f3d48115bd1860d1c400d204efc668ea57e61f5216cbebc531d6b59"} May 21 16:15:47.196254 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.195886 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32c9a691-3b1c-4ccd-9b91-0434f8e4562f","Type":"ContainerStarted","Data":"548d73c040ed6e3e798ec7b9585e9a22bc115e7a58c0ffe39836e28f179c4c78"} May 21 16:15:47.196254 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.195898 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32c9a691-3b1c-4ccd-9b91-0434f8e4562f","Type":"ContainerStarted","Data":"ce7192111f5ca0dd1c1a803f57929e1ef2a93defa592dda4d3da61919f4580d9"} May 21 16:15:47.196254 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.195911 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32c9a691-3b1c-4ccd-9b91-0434f8e4562f","Type":"ContainerStarted","Data":"ba930a8b7f7bdfef2e92c9ee760becacfcf6beaad75fc1b773bfd54bb1571026"} May 21 16:15:47.224361 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.224238 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.224219392 podStartE2EDuration="2.224219392s" podCreationTimestamp="2026-05-21 16:15:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:15:47.222624937 +0000 UTC m=+252.521345836" watchObservedRunningTime="2026-05-21 16:15:47.224219392 +0000 UTC m=+252.522940293" May 21 16:15:47.330957 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.330926 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4jlj8\"" May 21 16:15:47.339309 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.339287 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49jxl" May 21 16:15:47.462309 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.462278 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-49jxl"] May 21 16:15:47.465596 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:15:47.465568 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44a88f02_4431_4214_9629_d63db994abfe.slice/crio-bb89dfd3344c4045d1989173f9264d9c61217f5c82ae67c2d5b91ce81fa5f15b WatchSource:0}: Error finding container bb89dfd3344c4045d1989173f9264d9c61217f5c82ae67c2d5b91ce81fa5f15b: Status 404 returned error can't find the container with id bb89dfd3344c4045d1989173f9264d9c61217f5c82ae67c2d5b91ce81fa5f15b May 21 16:15:47.579781 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.579749 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-858d679499-gz4sh"] May 21 16:15:47.584444 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.584419 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:47.587213 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.587135 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 21 16:15:47.587346 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.587222 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 21 16:15:47.587346 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.587257 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 21 16:15:47.587346 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.587297 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 21 16:15:47.587346 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.587307 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 21 16:15:47.587601 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.587582 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-6hvqk\"" May 21 16:15:47.595680 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.595658 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 21 16:15:47.603916 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.603891 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-858d679499-gz4sh"] May 21 16:15:47.728880 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.728751 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtgkl\" (UniqueName: \"kubernetes.io/projected/3e7a3435-a6ba-4822-8bb7-d7383d301538-kube-api-access-gtgkl\") pod \"telemeter-client-858d679499-gz4sh\" (UID: \"3e7a3435-a6ba-4822-8bb7-d7383d301538\") " pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:47.728880 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.728806 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e7a3435-a6ba-4822-8bb7-d7383d301538-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-858d679499-gz4sh\" (UID: \"3e7a3435-a6ba-4822-8bb7-d7383d301538\") " pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:47.728880 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.728866 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3e7a3435-a6ba-4822-8bb7-d7383d301538-secret-telemeter-client\") pod \"telemeter-client-858d679499-gz4sh\" (UID: \"3e7a3435-a6ba-4822-8bb7-d7383d301538\") " pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:47.729130 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.728900 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3e7a3435-a6ba-4822-8bb7-d7383d301538-federate-client-tls\") pod \"telemeter-client-858d679499-gz4sh\" (UID: \"3e7a3435-a6ba-4822-8bb7-d7383d301538\") " pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:47.729130 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.728924 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e7a3435-a6ba-4822-8bb7-d7383d301538-serving-certs-ca-bundle\") pod \"telemeter-client-858d679499-gz4sh\" (UID: \"3e7a3435-a6ba-4822-8bb7-d7383d301538\") " pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:47.729130 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.729021 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e7a3435-a6ba-4822-8bb7-d7383d301538-telemeter-trusted-ca-bundle\") pod \"telemeter-client-858d679499-gz4sh\" (UID: \"3e7a3435-a6ba-4822-8bb7-d7383d301538\") " pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:47.729130 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.729056 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e7a3435-a6ba-4822-8bb7-d7383d301538-metrics-client-ca\") pod \"telemeter-client-858d679499-gz4sh\" (UID: \"3e7a3435-a6ba-4822-8bb7-d7383d301538\") " pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:47.729130 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.729091 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3e7a3435-a6ba-4822-8bb7-d7383d301538-telemeter-client-tls\") pod \"telemeter-client-858d679499-gz4sh\" (UID: \"3e7a3435-a6ba-4822-8bb7-d7383d301538\") " pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:47.830079 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.830037 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtgkl\" (UniqueName: \"kubernetes.io/projected/3e7a3435-a6ba-4822-8bb7-d7383d301538-kube-api-access-gtgkl\") pod \"telemeter-client-858d679499-gz4sh\" (UID: \"3e7a3435-a6ba-4822-8bb7-d7383d301538\") " pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:47.830271 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.830090 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e7a3435-a6ba-4822-8bb7-d7383d301538-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-858d679499-gz4sh\" (UID: \"3e7a3435-a6ba-4822-8bb7-d7383d301538\") " pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:47.830333 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.830268 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3e7a3435-a6ba-4822-8bb7-d7383d301538-secret-telemeter-client\") pod \"telemeter-client-858d679499-gz4sh\" (UID: \"3e7a3435-a6ba-4822-8bb7-d7383d301538\") " pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:47.830333 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.830314 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3e7a3435-a6ba-4822-8bb7-d7383d301538-federate-client-tls\") pod \"telemeter-client-858d679499-gz4sh\" (UID: \"3e7a3435-a6ba-4822-8bb7-d7383d301538\") " pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:47.830433 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.830341 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e7a3435-a6ba-4822-8bb7-d7383d301538-serving-certs-ca-bundle\") pod \"telemeter-client-858d679499-gz4sh\" (UID: \"3e7a3435-a6ba-4822-8bb7-d7383d301538\") " pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:47.830433 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.830379 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e7a3435-a6ba-4822-8bb7-d7383d301538-telemeter-trusted-ca-bundle\") pod \"telemeter-client-858d679499-gz4sh\" (UID: \"3e7a3435-a6ba-4822-8bb7-d7383d301538\") " pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:47.830433 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.830408 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e7a3435-a6ba-4822-8bb7-d7383d301538-metrics-client-ca\") pod \"telemeter-client-858d679499-gz4sh\" (UID: \"3e7a3435-a6ba-4822-8bb7-d7383d301538\") " pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:47.830580 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.830453 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3e7a3435-a6ba-4822-8bb7-d7383d301538-telemeter-client-tls\") pod \"telemeter-client-858d679499-gz4sh\" (UID: \"3e7a3435-a6ba-4822-8bb7-d7383d301538\") " pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:47.831215 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.831184 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e7a3435-a6ba-4822-8bb7-d7383d301538-serving-certs-ca-bundle\") pod \"telemeter-client-858d679499-gz4sh\" (UID: \"3e7a3435-a6ba-4822-8bb7-d7383d301538\") " pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:47.831352 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.831184 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e7a3435-a6ba-4822-8bb7-d7383d301538-metrics-client-ca\") pod \"telemeter-client-858d679499-gz4sh\" (UID: \"3e7a3435-a6ba-4822-8bb7-d7383d301538\") " pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:47.831419 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.831365 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e7a3435-a6ba-4822-8bb7-d7383d301538-telemeter-trusted-ca-bundle\") pod \"telemeter-client-858d679499-gz4sh\" (UID: \"3e7a3435-a6ba-4822-8bb7-d7383d301538\") " pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:47.832890 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.832865 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3e7a3435-a6ba-4822-8bb7-d7383d301538-secret-telemeter-client\") pod \"telemeter-client-858d679499-gz4sh\" (UID: \"3e7a3435-a6ba-4822-8bb7-d7383d301538\") " pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:47.832987 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.832908 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3e7a3435-a6ba-4822-8bb7-d7383d301538-telemeter-client-tls\") pod \"telemeter-client-858d679499-gz4sh\" (UID: \"3e7a3435-a6ba-4822-8bb7-d7383d301538\") " pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:47.833066 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.833045 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e7a3435-a6ba-4822-8bb7-d7383d301538-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-858d679499-gz4sh\" (UID: \"3e7a3435-a6ba-4822-8bb7-d7383d301538\") " pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:47.833101 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.833050 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3e7a3435-a6ba-4822-8bb7-d7383d301538-federate-client-tls\") pod \"telemeter-client-858d679499-gz4sh\" (UID: \"3e7a3435-a6ba-4822-8bb7-d7383d301538\") " pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:47.838191 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.838168 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtgkl\" (UniqueName: \"kubernetes.io/projected/3e7a3435-a6ba-4822-8bb7-d7383d301538-kube-api-access-gtgkl\") pod \"telemeter-client-858d679499-gz4sh\" (UID: \"3e7a3435-a6ba-4822-8bb7-d7383d301538\") " pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:47.896458 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:47.896426 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" May 21 16:15:48.024929 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:48.024845 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-858d679499-gz4sh"] May 21 16:15:48.028618 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:15:48.028584 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e7a3435_a6ba_4822_8bb7_d7383d301538.slice/crio-804f0d8bad960b6c255e9e87722e5adb5810be1cafe4ac0ae4be7331d82b349f WatchSource:0}: Error finding container 804f0d8bad960b6c255e9e87722e5adb5810be1cafe4ac0ae4be7331d82b349f: Status 404 returned error can't find the container with id 804f0d8bad960b6c255e9e87722e5adb5810be1cafe4ac0ae4be7331d82b349f May 21 16:15:48.199754 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:48.199714 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-49jxl" event={"ID":"44a88f02-4431-4214-9629-d63db994abfe","Type":"ContainerStarted","Data":"bb89dfd3344c4045d1989173f9264d9c61217f5c82ae67c2d5b91ce81fa5f15b"} May 21 16:15:48.200761 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:48.200732 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" event={"ID":"3e7a3435-a6ba-4822-8bb7-d7383d301538","Type":"ContainerStarted","Data":"804f0d8bad960b6c255e9e87722e5adb5810be1cafe4ac0ae4be7331d82b349f"} May 21 16:15:49.205013 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:49.204929 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-49jxl" event={"ID":"44a88f02-4431-4214-9629-d63db994abfe","Type":"ContainerStarted","Data":"b017c2c4e25ddfde868b223efa4ff1cfb1efd88efd551ac401bba0502301fed8"} May 21 16:15:49.205013 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:49.204967 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-49jxl" event={"ID":"44a88f02-4431-4214-9629-d63db994abfe","Type":"ContainerStarted","Data":"a06fa04e4d344363393f725354eee971f9473f8c70405d29d2ed20e2ce805f7f"} May 21 16:15:49.223705 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:49.223645 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-49jxl" podStartSLOduration=252.825541146 podStartE2EDuration="4m14.223624907s" podCreationTimestamp="2026-05-21 16:11:35 +0000 UTC" firstStartedPulling="2026-05-21 16:15:47.468034262 +0000 UTC m=+252.766755146" lastFinishedPulling="2026-05-21 16:15:48.866118025 +0000 UTC m=+254.164838907" observedRunningTime="2026-05-21 16:15:49.221452229 +0000 UTC m=+254.520173129" watchObservedRunningTime="2026-05-21 16:15:49.223624907 +0000 UTC m=+254.522345809" May 21 16:15:50.210125 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:50.210092 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" event={"ID":"3e7a3435-a6ba-4822-8bb7-d7383d301538","Type":"ContainerStarted","Data":"a0ea054c82642d9b3a9ba9f70489adc331fc09352ffb0455fe9cd9e29bcce436"} May 21 16:15:50.210125 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:50.210127 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" event={"ID":"3e7a3435-a6ba-4822-8bb7-d7383d301538","Type":"ContainerStarted","Data":"1effa9f11ad87124f304edf850f00f0ba588ebadbea3a7582f5777b9085a13a1"} May 21 16:15:51.215481 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:51.215447 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" event={"ID":"3e7a3435-a6ba-4822-8bb7-d7383d301538","Type":"ContainerStarted","Data":"59b05310cad2898fe3bd7091434877f0724d60789fbc571699caf2f6a143a2e8"} May 21 16:15:51.239680 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:15:51.239601 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-858d679499-gz4sh" podStartSLOduration=2.22738882 podStartE2EDuration="4.239581939s" podCreationTimestamp="2026-05-21 16:15:47 +0000 UTC" firstStartedPulling="2026-05-21 16:15:48.031308183 +0000 UTC m=+253.330029069" lastFinishedPulling="2026-05-21 16:15:50.043501307 +0000 UTC m=+255.342222188" observedRunningTime="2026-05-21 16:15:51.236523205 +0000 UTC m=+256.535244129" watchObservedRunningTime="2026-05-21 16:15:51.239581939 +0000 UTC m=+256.538302840" May 21 16:16:35.205373 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:16:35.205346 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/ovn-acl-logging/0.log" May 21 16:16:35.205790 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:16:35.205673 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/ovn-acl-logging/0.log" May 21 16:16:35.215258 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:16:35.215235 2547 kubelet.go:1628] "Image garbage collection succeeded" May 21 16:17:37.833883 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:17:37.833762 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-xgz2p"] May 21 16:17:37.837081 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:17:37.837058 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgz2p" May 21 16:17:37.839498 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:17:37.839479 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 16:17:37.843956 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:17:37.843675 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xgz2p"] May 21 16:17:37.869021 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:17:37.868994 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1048ec11-779f-4384-8207-1fb5593c5fbb-kubelet-config\") pod \"global-pull-secret-syncer-xgz2p\" (UID: \"1048ec11-779f-4384-8207-1fb5593c5fbb\") " pod="kube-system/global-pull-secret-syncer-xgz2p" May 21 16:17:37.869151 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:17:37.869025 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1048ec11-779f-4384-8207-1fb5593c5fbb-dbus\") pod \"global-pull-secret-syncer-xgz2p\" (UID: \"1048ec11-779f-4384-8207-1fb5593c5fbb\") " pod="kube-system/global-pull-secret-syncer-xgz2p" May 21 16:17:37.869151 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:17:37.869097 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1048ec11-779f-4384-8207-1fb5593c5fbb-original-pull-secret\") pod \"global-pull-secret-syncer-xgz2p\" (UID: \"1048ec11-779f-4384-8207-1fb5593c5fbb\") " pod="kube-system/global-pull-secret-syncer-xgz2p" May 21 16:17:37.969601 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:17:37.969562 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1048ec11-779f-4384-8207-1fb5593c5fbb-kubelet-config\") pod \"global-pull-secret-syncer-xgz2p\" (UID: \"1048ec11-779f-4384-8207-1fb5593c5fbb\") " pod="kube-system/global-pull-secret-syncer-xgz2p" May 21 16:17:37.969601 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:17:37.969606 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1048ec11-779f-4384-8207-1fb5593c5fbb-dbus\") pod \"global-pull-secret-syncer-xgz2p\" (UID: \"1048ec11-779f-4384-8207-1fb5593c5fbb\") " pod="kube-system/global-pull-secret-syncer-xgz2p" May 21 16:17:37.969878 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:17:37.969653 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1048ec11-779f-4384-8207-1fb5593c5fbb-original-pull-secret\") pod \"global-pull-secret-syncer-xgz2p\" (UID: \"1048ec11-779f-4384-8207-1fb5593c5fbb\") " pod="kube-system/global-pull-secret-syncer-xgz2p" May 21 16:17:37.969878 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:17:37.969691 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1048ec11-779f-4384-8207-1fb5593c5fbb-kubelet-config\") pod \"global-pull-secret-syncer-xgz2p\" (UID: \"1048ec11-779f-4384-8207-1fb5593c5fbb\") " pod="kube-system/global-pull-secret-syncer-xgz2p" May 21 16:17:37.969878 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:17:37.969804 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1048ec11-779f-4384-8207-1fb5593c5fbb-dbus\") pod \"global-pull-secret-syncer-xgz2p\" (UID: \"1048ec11-779f-4384-8207-1fb5593c5fbb\") " pod="kube-system/global-pull-secret-syncer-xgz2p" May 21 16:17:37.972060 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:17:37.972028 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1048ec11-779f-4384-8207-1fb5593c5fbb-original-pull-secret\") pod \"global-pull-secret-syncer-xgz2p\" (UID: \"1048ec11-779f-4384-8207-1fb5593c5fbb\") " pod="kube-system/global-pull-secret-syncer-xgz2p" May 21 16:17:38.146302 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:17:38.146222 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgz2p" May 21 16:17:38.272401 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:17:38.272375 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xgz2p"] May 21 16:17:38.275098 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:17:38.275069 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1048ec11_779f_4384_8207_1fb5593c5fbb.slice/crio-ecae3c0a04e4643f6ce08e176c59292b0498b82e3506b6544327e0d5cc3c2b43 WatchSource:0}: Error finding container ecae3c0a04e4643f6ce08e176c59292b0498b82e3506b6544327e0d5cc3c2b43: Status 404 returned error can't find the container with id ecae3c0a04e4643f6ce08e176c59292b0498b82e3506b6544327e0d5cc3c2b43 May 21 16:17:38.277043 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:17:38.277027 2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 16:17:38.534929 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:17:38.534843 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xgz2p" event={"ID":"1048ec11-779f-4384-8207-1fb5593c5fbb","Type":"ContainerStarted","Data":"ecae3c0a04e4643f6ce08e176c59292b0498b82e3506b6544327e0d5cc3c2b43"} May 21 16:17:42.548558 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:17:42.548520 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xgz2p" event={"ID":"1048ec11-779f-4384-8207-1fb5593c5fbb","Type":"ContainerStarted","Data":"99194a29c44cf43f39fae3fb4980620d94e65bbab0e66ae68453a61b29cc7bdc"} May 21 16:17:42.564804 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:17:42.564753 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xgz2p" podStartSLOduration=1.933843445 podStartE2EDuration="5.564740036s" podCreationTimestamp="2026-05-21 16:17:37 +0000 UTC" firstStartedPulling="2026-05-21 16:17:38.27715391 +0000 UTC m=+363.575874792" lastFinishedPulling="2026-05-21 16:17:41.908050505 +0000 UTC m=+367.206771383" observedRunningTime="2026-05-21 16:17:42.562902246 +0000 UTC m=+367.861623141" watchObservedRunningTime="2026-05-21 16:17:42.564740036 +0000 UTC m=+367.863460936" May 21 16:18:07.572712 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:07.572677 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t"] May 21 16:18:07.576098 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:07.576082 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t" May 21 16:18:07.579047 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:07.579022 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 16:18:07.579177 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:07.579025 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2l7zb\"" May 21 16:18:07.580015 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:07.579998 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 16:18:07.589775 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:07.586890 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t"] May 21 16:18:07.714046 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:07.713995 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b0d4ef8-2cab-452f-a506-a7955fd49192-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t\" (UID: \"2b0d4ef8-2cab-452f-a506-a7955fd49192\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t" May 21 16:18:07.714221 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:07.714071 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b0d4ef8-2cab-452f-a506-a7955fd49192-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t\" (UID: \"2b0d4ef8-2cab-452f-a506-a7955fd49192\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t" May 21 16:18:07.714221 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:07.714108 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5ddm\" (UniqueName: \"kubernetes.io/projected/2b0d4ef8-2cab-452f-a506-a7955fd49192-kube-api-access-r5ddm\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t\" (UID: \"2b0d4ef8-2cab-452f-a506-a7955fd49192\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t" May 21 16:18:07.815253 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:07.815218 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b0d4ef8-2cab-452f-a506-a7955fd49192-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t\" (UID: \"2b0d4ef8-2cab-452f-a506-a7955fd49192\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t" May 21 16:18:07.815409 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:07.815261 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5ddm\" (UniqueName: \"kubernetes.io/projected/2b0d4ef8-2cab-452f-a506-a7955fd49192-kube-api-access-r5ddm\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t\" (UID: \"2b0d4ef8-2cab-452f-a506-a7955fd49192\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t" May 21 16:18:07.815409 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:07.815306 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b0d4ef8-2cab-452f-a506-a7955fd49192-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t\" (UID: \"2b0d4ef8-2cab-452f-a506-a7955fd49192\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t" May 21 16:18:07.815613 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:07.815598 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b0d4ef8-2cab-452f-a506-a7955fd49192-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t\" (UID: \"2b0d4ef8-2cab-452f-a506-a7955fd49192\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t" May 21 16:18:07.815708 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:07.815682 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b0d4ef8-2cab-452f-a506-a7955fd49192-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t\" (UID: \"2b0d4ef8-2cab-452f-a506-a7955fd49192\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t" May 21 16:18:07.823645 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:07.823584 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5ddm\" (UniqueName: \"kubernetes.io/projected/2b0d4ef8-2cab-452f-a506-a7955fd49192-kube-api-access-r5ddm\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t\" (UID: \"2b0d4ef8-2cab-452f-a506-a7955fd49192\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t" May 21 16:18:07.892159 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:07.892135 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t" May 21 16:18:08.017839 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:08.017791 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t"] May 21 16:18:08.020135 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:18:08.020104 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0d4ef8_2cab_452f_a506_a7955fd49192.slice/crio-4fb6638fb46b697009a2d6edc5213b0e6a73fbf3238db5299506010aeb3fcdaf WatchSource:0}: Error finding container 4fb6638fb46b697009a2d6edc5213b0e6a73fbf3238db5299506010aeb3fcdaf: Status 404 returned error can't find the container with id 4fb6638fb46b697009a2d6edc5213b0e6a73fbf3238db5299506010aeb3fcdaf May 21 16:18:08.628036 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:08.627997 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t" event={"ID":"2b0d4ef8-2cab-452f-a506-a7955fd49192","Type":"ContainerStarted","Data":"4fb6638fb46b697009a2d6edc5213b0e6a73fbf3238db5299506010aeb3fcdaf"} May 21 16:18:16.652447 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:16.652415 2547 generic.go:358] "Generic (PLEG): container finished" podID="2b0d4ef8-2cab-452f-a506-a7955fd49192" containerID="c66cec82f14f151b2ebc405b3993f4d482816d5faa20f7c71c9c76c3f3f1278c" exitCode=0 May 21 16:18:16.652838 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:16.652502 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t" event={"ID":"2b0d4ef8-2cab-452f-a506-a7955fd49192","Type":"ContainerDied","Data":"c66cec82f14f151b2ebc405b3993f4d482816d5faa20f7c71c9c76c3f3f1278c"} May 21 16:18:19.664144 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:19.664108 2547 generic.go:358] "Generic (PLEG): container finished" podID="2b0d4ef8-2cab-452f-a506-a7955fd49192" containerID="57111724f1f2862b25e63e40bca4e762abff3bb497dd7cdd5acf0c8be503d1d4" exitCode=0 May 21 16:18:19.664569 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:19.664195 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t" event={"ID":"2b0d4ef8-2cab-452f-a506-a7955fd49192","Type":"ContainerDied","Data":"57111724f1f2862b25e63e40bca4e762abff3bb497dd7cdd5acf0c8be503d1d4"} May 21 16:18:25.684779 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:25.684749 2547 generic.go:358] "Generic (PLEG): container finished" podID="2b0d4ef8-2cab-452f-a506-a7955fd49192" containerID="4478a25f62af24de7bfb3ccd22dfdc7493983b3b8f88c65d267c37f55c777e30" exitCode=0 May 21 16:18:25.685098 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:25.684790 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t" event={"ID":"2b0d4ef8-2cab-452f-a506-a7955fd49192","Type":"ContainerDied","Data":"4478a25f62af24de7bfb3ccd22dfdc7493983b3b8f88c65d267c37f55c777e30"} May 21 16:18:26.808785 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:26.808759 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t" May 21 16:18:26.983414 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:26.983328 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b0d4ef8-2cab-452f-a506-a7955fd49192-bundle\") pod \"2b0d4ef8-2cab-452f-a506-a7955fd49192\" (UID: \"2b0d4ef8-2cab-452f-a506-a7955fd49192\") " May 21 16:18:26.983414 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:26.983384 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5ddm\" (UniqueName: \"kubernetes.io/projected/2b0d4ef8-2cab-452f-a506-a7955fd49192-kube-api-access-r5ddm\") pod \"2b0d4ef8-2cab-452f-a506-a7955fd49192\" (UID: \"2b0d4ef8-2cab-452f-a506-a7955fd49192\") " May 21 16:18:26.983648 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:26.983442 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b0d4ef8-2cab-452f-a506-a7955fd49192-util\") pod \"2b0d4ef8-2cab-452f-a506-a7955fd49192\" (UID: \"2b0d4ef8-2cab-452f-a506-a7955fd49192\") " May 21 16:18:26.984225 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:26.984193 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b0d4ef8-2cab-452f-a506-a7955fd49192-bundle" (OuterVolumeSpecName: "bundle") pod "2b0d4ef8-2cab-452f-a506-a7955fd49192" (UID: "2b0d4ef8-2cab-452f-a506-a7955fd49192"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:18:26.985592 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:26.985569 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b0d4ef8-2cab-452f-a506-a7955fd49192-kube-api-access-r5ddm" (OuterVolumeSpecName: "kube-api-access-r5ddm") pod "2b0d4ef8-2cab-452f-a506-a7955fd49192" (UID: "2b0d4ef8-2cab-452f-a506-a7955fd49192"). InnerVolumeSpecName "kube-api-access-r5ddm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:18:26.989203 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:26.989177 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b0d4ef8-2cab-452f-a506-a7955fd49192-util" (OuterVolumeSpecName: "util") pod "2b0d4ef8-2cab-452f-a506-a7955fd49192" (UID: "2b0d4ef8-2cab-452f-a506-a7955fd49192"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:18:27.084205 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:27.084166 2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b0d4ef8-2cab-452f-a506-a7955fd49192-bundle\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:18:27.084205 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:27.084201 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5ddm\" (UniqueName: \"kubernetes.io/projected/2b0d4ef8-2cab-452f-a506-a7955fd49192-kube-api-access-r5ddm\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:18:27.084205 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:27.084212 2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b0d4ef8-2cab-452f-a506-a7955fd49192-util\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:18:27.692061 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:27.691984 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t" May 21 16:18:27.692203 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:27.691984 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlrc5t" event={"ID":"2b0d4ef8-2cab-452f-a506-a7955fd49192","Type":"ContainerDied","Data":"4fb6638fb46b697009a2d6edc5213b0e6a73fbf3238db5299506010aeb3fcdaf"} May 21 16:18:27.692203 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:27.692093 2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4fb6638fb46b697009a2d6edc5213b0e6a73fbf3238db5299506010aeb3fcdaf" May 21 16:18:40.253156 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:40.253118 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx"] May 21 16:18:40.253723 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:40.253606 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b0d4ef8-2cab-452f-a506-a7955fd49192" containerName="pull" May 21 16:18:40.253723 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:40.253625 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b0d4ef8-2cab-452f-a506-a7955fd49192" containerName="pull" May 21 16:18:40.253723 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:40.253640 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b0d4ef8-2cab-452f-a506-a7955fd49192" containerName="util" May 21 16:18:40.253723 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:40.253649 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b0d4ef8-2cab-452f-a506-a7955fd49192" containerName="util" May 21 16:18:40.253723 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:40.253658 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b0d4ef8-2cab-452f-a506-a7955fd49192" containerName="extract" May 21 16:18:40.253723 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:40.253669 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b0d4ef8-2cab-452f-a506-a7955fd49192" containerName="extract" May 21 16:18:40.254047 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:40.253733 2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="2b0d4ef8-2cab-452f-a506-a7955fd49192" containerName="extract" May 21 16:18:40.258325 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:40.258302 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx" May 21 16:18:40.262018 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:40.261990 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 16:18:40.263227 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:40.263203 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2l7zb\"" May 21 16:18:40.263322 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:40.263203 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 16:18:40.271648 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:40.271616 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx"] May 21 16:18:40.293246 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:40.293210 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbqhv\" (UniqueName: \"kubernetes.io/projected/eefe7271-50fb-403c-9071-05cf9c3f5830-kube-api-access-vbqhv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx\" (UID: \"eefe7271-50fb-403c-9071-05cf9c3f5830\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx" May 21 16:18:40.293390 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:40.293270 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eefe7271-50fb-403c-9071-05cf9c3f5830-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx\" (UID: \"eefe7271-50fb-403c-9071-05cf9c3f5830\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx" May 21 16:18:40.293390 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:40.293330 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eefe7271-50fb-403c-9071-05cf9c3f5830-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx\" (UID: \"eefe7271-50fb-403c-9071-05cf9c3f5830\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx" May 21 16:18:40.394017 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:40.393975 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eefe7271-50fb-403c-9071-05cf9c3f5830-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx\" (UID: \"eefe7271-50fb-403c-9071-05cf9c3f5830\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx" May 21 16:18:40.394176 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:40.394059 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vbqhv\" (UniqueName: \"kubernetes.io/projected/eefe7271-50fb-403c-9071-05cf9c3f5830-kube-api-access-vbqhv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx\" (UID: \"eefe7271-50fb-403c-9071-05cf9c3f5830\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx" May 21 16:18:40.394176 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:40.394102 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eefe7271-50fb-403c-9071-05cf9c3f5830-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx\" (UID: \"eefe7271-50fb-403c-9071-05cf9c3f5830\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx" May 21 16:18:40.394427 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:40.394411 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eefe7271-50fb-403c-9071-05cf9c3f5830-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx\" (UID: \"eefe7271-50fb-403c-9071-05cf9c3f5830\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx" May 21 16:18:40.394463 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:40.394411 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eefe7271-50fb-403c-9071-05cf9c3f5830-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx\" (UID: \"eefe7271-50fb-403c-9071-05cf9c3f5830\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx" May 21 16:18:40.405618 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:40.405589 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbqhv\" (UniqueName: \"kubernetes.io/projected/eefe7271-50fb-403c-9071-05cf9c3f5830-kube-api-access-vbqhv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx\" (UID: \"eefe7271-50fb-403c-9071-05cf9c3f5830\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx" May 21 16:18:40.567183 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:40.567091 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx" May 21 16:18:40.720503 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:40.720472 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx"] May 21 16:18:40.721978 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:18:40.721947 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeefe7271_50fb_403c_9071_05cf9c3f5830.slice/crio-71ca5f7c290f6b439ce672a22a7013e14265ff094dd683e895be9be41db9ec65 WatchSource:0}: Error finding container 71ca5f7c290f6b439ce672a22a7013e14265ff094dd683e895be9be41db9ec65: Status 404 returned error can't find the container with id 71ca5f7c290f6b439ce672a22a7013e14265ff094dd683e895be9be41db9ec65 May 21 16:18:40.730162 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:40.730137 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx" event={"ID":"eefe7271-50fb-403c-9071-05cf9c3f5830","Type":"ContainerStarted","Data":"71ca5f7c290f6b439ce672a22a7013e14265ff094dd683e895be9be41db9ec65"} May 21 16:18:41.734508 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:41.734416 2547 generic.go:358] "Generic (PLEG): container finished" podID="eefe7271-50fb-403c-9071-05cf9c3f5830" containerID="fe23e147aa0353c8b963b87f604ef589a4c96ec29f077245adb28071cb4dc8ae" exitCode=0 May 21 16:18:41.734508 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:41.734475 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx" event={"ID":"eefe7271-50fb-403c-9071-05cf9c3f5830","Type":"ContainerDied","Data":"fe23e147aa0353c8b963b87f604ef589a4c96ec29f077245adb28071cb4dc8ae"} May 21 16:18:45.201060 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:45.201024 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-cbnqz"] May 21 16:18:45.204325 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:45.204307 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-cbnqz" May 21 16:18:45.209484 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:45.209458 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 21 16:18:45.209631 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:45.209461 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 21 16:18:45.210655 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:45.210634 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-c95bz\"" May 21 16:18:45.221720 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:45.221697 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-cbnqz"] May 21 16:18:45.237899 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:45.237874 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhzd7\" (UniqueName: \"kubernetes.io/projected/62f48b3b-9baf-43ca-87c0-715f1c310ed9-kube-api-access-lhzd7\") pod \"cert-manager-cainjector-68b757865b-cbnqz\" (UID: \"62f48b3b-9baf-43ca-87c0-715f1c310ed9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-cbnqz" May 21 16:18:45.238024 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:45.237986 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62f48b3b-9baf-43ca-87c0-715f1c310ed9-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-cbnqz\" (UID: \"62f48b3b-9baf-43ca-87c0-715f1c310ed9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-cbnqz" May 21 16:18:45.338420 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:45.338385 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62f48b3b-9baf-43ca-87c0-715f1c310ed9-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-cbnqz\" (UID: \"62f48b3b-9baf-43ca-87c0-715f1c310ed9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-cbnqz" May 21 16:18:45.338609 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:45.338491 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lhzd7\" (UniqueName: \"kubernetes.io/projected/62f48b3b-9baf-43ca-87c0-715f1c310ed9-kube-api-access-lhzd7\") pod \"cert-manager-cainjector-68b757865b-cbnqz\" (UID: \"62f48b3b-9baf-43ca-87c0-715f1c310ed9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-cbnqz" May 21 16:18:45.349859 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:45.349800 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62f48b3b-9baf-43ca-87c0-715f1c310ed9-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-cbnqz\" (UID: \"62f48b3b-9baf-43ca-87c0-715f1c310ed9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-cbnqz" May 21 16:18:45.350052 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:45.349906 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhzd7\" (UniqueName: \"kubernetes.io/projected/62f48b3b-9baf-43ca-87c0-715f1c310ed9-kube-api-access-lhzd7\") pod \"cert-manager-cainjector-68b757865b-cbnqz\" (UID: \"62f48b3b-9baf-43ca-87c0-715f1c310ed9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-cbnqz" May 21 16:18:45.522215 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:45.522126 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-cbnqz" May 21 16:18:45.645415 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:45.645247 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-cbnqz"] May 21 16:18:45.647977 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:18:45.647944 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62f48b3b_9baf_43ca_87c0_715f1c310ed9.slice/crio-c699ad968a2f4d8bb1f0b03bce8d23af32b5c472da5893ae3162d6fb6d767599 WatchSource:0}: Error finding container c699ad968a2f4d8bb1f0b03bce8d23af32b5c472da5893ae3162d6fb6d767599: Status 404 returned error can't find the container with id c699ad968a2f4d8bb1f0b03bce8d23af32b5c472da5893ae3162d6fb6d767599 May 21 16:18:45.746872 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:45.746838 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-cbnqz" event={"ID":"62f48b3b-9baf-43ca-87c0-715f1c310ed9","Type":"ContainerStarted","Data":"c699ad968a2f4d8bb1f0b03bce8d23af32b5c472da5893ae3162d6fb6d767599"} May 21 16:18:49.759994 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:49.759956 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-cbnqz" event={"ID":"62f48b3b-9baf-43ca-87c0-715f1c310ed9","Type":"ContainerStarted","Data":"3e803c85555b218b90f488fa9180488a2d932f6a27dad7bd6fc285907bd07a4d"} May 21 16:18:49.776247 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:18:49.776194 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-cbnqz" podStartSLOduration=1.203585364 podStartE2EDuration="4.77618159s" podCreationTimestamp="2026-05-21 16:18:45 +0000 UTC" firstStartedPulling="2026-05-21 16:18:45.650124003 +0000 UTC m=+430.948844882" lastFinishedPulling="2026-05-21 16:18:49.222720219 +0000 UTC m=+434.521441108" observedRunningTime="2026-05-21 16:18:49.774994522 +0000 UTC m=+435.073715422" watchObservedRunningTime="2026-05-21 16:18:49.77618159 +0000 UTC m=+435.074902492" May 21 16:19:00.793144 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:00.793040 2547 generic.go:358] "Generic (PLEG): container finished" podID="eefe7271-50fb-403c-9071-05cf9c3f5830" containerID="c5c67ee86f55bc44713fb36263a2450a4d7804dacfcb814bbbfb4a3d2a0d40e0" exitCode=0 May 21 16:19:00.793144 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:00.793123 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx" event={"ID":"eefe7271-50fb-403c-9071-05cf9c3f5830","Type":"ContainerDied","Data":"c5c67ee86f55bc44713fb36263a2450a4d7804dacfcb814bbbfb4a3d2a0d40e0"} May 21 16:19:01.797542 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:01.797506 2547 generic.go:358] "Generic (PLEG): container finished" podID="eefe7271-50fb-403c-9071-05cf9c3f5830" containerID="a59dd4b101ba404da1ad80b390d7b3179f08a2a83b5688e5f23026faf3465320" exitCode=0 May 21 16:19:01.797542 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:01.797549 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx" event={"ID":"eefe7271-50fb-403c-9071-05cf9c3f5830","Type":"ContainerDied","Data":"a59dd4b101ba404da1ad80b390d7b3179f08a2a83b5688e5f23026faf3465320"} May 21 16:19:02.920096 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:02.920075 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx" May 21 16:19:02.993100 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:02.993005 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbqhv\" (UniqueName: \"kubernetes.io/projected/eefe7271-50fb-403c-9071-05cf9c3f5830-kube-api-access-vbqhv\") pod \"eefe7271-50fb-403c-9071-05cf9c3f5830\" (UID: \"eefe7271-50fb-403c-9071-05cf9c3f5830\") " May 21 16:19:02.993266 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:02.993153 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eefe7271-50fb-403c-9071-05cf9c3f5830-util\") pod \"eefe7271-50fb-403c-9071-05cf9c3f5830\" (UID: \"eefe7271-50fb-403c-9071-05cf9c3f5830\") " May 21 16:19:02.993266 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:02.993243 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eefe7271-50fb-403c-9071-05cf9c3f5830-bundle\") pod \"eefe7271-50fb-403c-9071-05cf9c3f5830\" (UID: \"eefe7271-50fb-403c-9071-05cf9c3f5830\") " May 21 16:19:02.993628 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:02.993606 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eefe7271-50fb-403c-9071-05cf9c3f5830-bundle" (OuterVolumeSpecName: "bundle") pod "eefe7271-50fb-403c-9071-05cf9c3f5830" (UID: "eefe7271-50fb-403c-9071-05cf9c3f5830"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:19:02.995006 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:02.994985 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eefe7271-50fb-403c-9071-05cf9c3f5830-kube-api-access-vbqhv" (OuterVolumeSpecName: "kube-api-access-vbqhv") pod "eefe7271-50fb-403c-9071-05cf9c3f5830" (UID: "eefe7271-50fb-403c-9071-05cf9c3f5830"). InnerVolumeSpecName "kube-api-access-vbqhv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:19:02.999602 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:02.999568 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eefe7271-50fb-403c-9071-05cf9c3f5830-util" (OuterVolumeSpecName: "util") pod "eefe7271-50fb-403c-9071-05cf9c3f5830" (UID: "eefe7271-50fb-403c-9071-05cf9c3f5830"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:19:03.094590 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:03.094560 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbqhv\" (UniqueName: \"kubernetes.io/projected/eefe7271-50fb-403c-9071-05cf9c3f5830-kube-api-access-vbqhv\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:19:03.094590 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:03.094591 2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eefe7271-50fb-403c-9071-05cf9c3f5830-util\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:19:03.094776 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:03.094601 2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eefe7271-50fb-403c-9071-05cf9c3f5830-bundle\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:19:03.805727 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:03.805696 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx" May 21 16:19:03.805727 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:03.805714 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb24gx" event={"ID":"eefe7271-50fb-403c-9071-05cf9c3f5830","Type":"ContainerDied","Data":"71ca5f7c290f6b439ce672a22a7013e14265ff094dd683e895be9be41db9ec65"} May 21 16:19:03.805959 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:03.805745 2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71ca5f7c290f6b439ce672a22a7013e14265ff094dd683e895be9be41db9ec65" May 21 16:19:08.162989 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:08.162952 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-bs7kp"] May 21 16:19:08.163373 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:08.163264 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eefe7271-50fb-403c-9071-05cf9c3f5830" containerName="util" May 21 16:19:08.163373 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:08.163274 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="eefe7271-50fb-403c-9071-05cf9c3f5830" containerName="util" May 21 16:19:08.163373 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:08.163282 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eefe7271-50fb-403c-9071-05cf9c3f5830" containerName="extract" May 21 16:19:08.163373 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:08.163287 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="eefe7271-50fb-403c-9071-05cf9c3f5830" containerName="extract" May 21 16:19:08.163373 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:08.163295 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eefe7271-50fb-403c-9071-05cf9c3f5830" containerName="pull" May 21 16:19:08.163373 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:08.163300 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="eefe7271-50fb-403c-9071-05cf9c3f5830" containerName="pull" May 21 16:19:08.163373 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:08.163350 2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="eefe7271-50fb-403c-9071-05cf9c3f5830" containerName="extract" May 21 16:19:08.165326 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:08.165310 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-bs7kp" May 21 16:19:08.168978 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:08.168955 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 16:19:08.169227 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:08.169213 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-j8bnd\"" May 21 16:19:08.169971 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:08.169955 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 16:19:08.175570 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:08.175547 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-bs7kp"] May 21 16:19:08.242277 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:08.242241 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsc6b\" (UniqueName: \"kubernetes.io/projected/be60e7c3-5de4-427c-bc5f-e10eb39323c0-kube-api-access-dsc6b\") pod \"openshift-lws-operator-bfc7f696d-bs7kp\" (UID: \"be60e7c3-5de4-427c-bc5f-e10eb39323c0\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-bs7kp" May 21 16:19:08.242448 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:08.242289 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be60e7c3-5de4-427c-bc5f-e10eb39323c0-tmp\") pod \"openshift-lws-operator-bfc7f696d-bs7kp\" (UID: \"be60e7c3-5de4-427c-bc5f-e10eb39323c0\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-bs7kp" May 21 16:19:08.343832 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:08.343775 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dsc6b\" (UniqueName: \"kubernetes.io/projected/be60e7c3-5de4-427c-bc5f-e10eb39323c0-kube-api-access-dsc6b\") pod \"openshift-lws-operator-bfc7f696d-bs7kp\" (UID: \"be60e7c3-5de4-427c-bc5f-e10eb39323c0\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-bs7kp" May 21 16:19:08.343978 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:08.343847 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be60e7c3-5de4-427c-bc5f-e10eb39323c0-tmp\") pod \"openshift-lws-operator-bfc7f696d-bs7kp\" (UID: \"be60e7c3-5de4-427c-bc5f-e10eb39323c0\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-bs7kp" May 21 16:19:08.344184 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:08.344169 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be60e7c3-5de4-427c-bc5f-e10eb39323c0-tmp\") pod \"openshift-lws-operator-bfc7f696d-bs7kp\" (UID: \"be60e7c3-5de4-427c-bc5f-e10eb39323c0\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-bs7kp" May 21 16:19:08.352179 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:08.352148 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsc6b\" (UniqueName: \"kubernetes.io/projected/be60e7c3-5de4-427c-bc5f-e10eb39323c0-kube-api-access-dsc6b\") pod \"openshift-lws-operator-bfc7f696d-bs7kp\" (UID: \"be60e7c3-5de4-427c-bc5f-e10eb39323c0\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-bs7kp" May 21 16:19:08.475003 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:08.474903 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-bs7kp" May 21 16:19:08.599086 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:08.599059 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-bs7kp"] May 21 16:19:08.601201 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:19:08.601174 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe60e7c3_5de4_427c_bc5f_e10eb39323c0.slice/crio-db6a8a500d78224522a861c1115c8b473eabfad5da1da711a0a8cd5dd22eb328 WatchSource:0}: Error finding container db6a8a500d78224522a861c1115c8b473eabfad5da1da711a0a8cd5dd22eb328: Status 404 returned error can't find the container with id db6a8a500d78224522a861c1115c8b473eabfad5da1da711a0a8cd5dd22eb328 May 21 16:19:08.821947 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:08.821856 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-bs7kp" event={"ID":"be60e7c3-5de4-427c-bc5f-e10eb39323c0","Type":"ContainerStarted","Data":"db6a8a500d78224522a861c1115c8b473eabfad5da1da711a0a8cd5dd22eb328"} May 21 16:19:11.833342 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:11.833304 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-bs7kp" event={"ID":"be60e7c3-5de4-427c-bc5f-e10eb39323c0","Type":"ContainerStarted","Data":"cab4f4cddcdb7f79c07575ee74fdd087dd03a98314fd2a5e9f480d3266198415"} May 21 16:19:11.853107 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:11.853049 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-bs7kp" podStartSLOduration=1.666694425 podStartE2EDuration="3.853033651s" podCreationTimestamp="2026-05-21 16:19:08 +0000 UTC" firstStartedPulling="2026-05-21 16:19:08.602780764 +0000 UTC m=+453.901501646" lastFinishedPulling="2026-05-21 16:19:10.789119994 +0000 UTC m=+456.087840872" observedRunningTime="2026-05-21 16:19:11.851301611 +0000 UTC m=+457.150022511" watchObservedRunningTime="2026-05-21 16:19:11.853033651 +0000 UTC m=+457.151754550" May 21 16:19:14.075925 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:14.075887 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f"] May 21 16:19:14.079451 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:14.079435 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f" May 21 16:19:14.082157 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:14.082133 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 16:19:14.082157 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:14.082142 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 16:19:14.082349 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:14.082233 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2l7zb\"" May 21 16:19:14.086720 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:14.086694 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f"] May 21 16:19:14.198807 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:14.198764 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bb142bd-ad22-4618-b436-51424cf9e364-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f\" (UID: \"7bb142bd-ad22-4618-b436-51424cf9e364\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f" May 21 16:19:14.199017 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:14.198845 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdmwg\" (UniqueName: \"kubernetes.io/projected/7bb142bd-ad22-4618-b436-51424cf9e364-kube-api-access-wdmwg\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f\" (UID: \"7bb142bd-ad22-4618-b436-51424cf9e364\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f" May 21 16:19:14.199017 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:14.198928 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bb142bd-ad22-4618-b436-51424cf9e364-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f\" (UID: \"7bb142bd-ad22-4618-b436-51424cf9e364\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f" May 21 16:19:14.299350 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:14.299315 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdmwg\" (UniqueName: \"kubernetes.io/projected/7bb142bd-ad22-4618-b436-51424cf9e364-kube-api-access-wdmwg\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f\" (UID: \"7bb142bd-ad22-4618-b436-51424cf9e364\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f" May 21 16:19:14.299528 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:14.299386 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bb142bd-ad22-4618-b436-51424cf9e364-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f\" (UID: \"7bb142bd-ad22-4618-b436-51424cf9e364\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f" May 21 16:19:14.299528 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:14.299421 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bb142bd-ad22-4618-b436-51424cf9e364-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f\" (UID: \"7bb142bd-ad22-4618-b436-51424cf9e364\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f" May 21 16:19:14.299811 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:14.299786 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bb142bd-ad22-4618-b436-51424cf9e364-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f\" (UID: \"7bb142bd-ad22-4618-b436-51424cf9e364\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f" May 21 16:19:14.299913 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:14.299859 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bb142bd-ad22-4618-b436-51424cf9e364-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f\" (UID: \"7bb142bd-ad22-4618-b436-51424cf9e364\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f" May 21 16:19:14.309659 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:14.309634 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdmwg\" (UniqueName: \"kubernetes.io/projected/7bb142bd-ad22-4618-b436-51424cf9e364-kube-api-access-wdmwg\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f\" (UID: \"7bb142bd-ad22-4618-b436-51424cf9e364\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f" May 21 16:19:14.390077 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:14.389995 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f" May 21 16:19:14.528851 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:14.528797 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f"] May 21 16:19:14.530706 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:19:14.530677 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bb142bd_ad22_4618_b436_51424cf9e364.slice/crio-85ed6ee8469c9ff89a63eb5e9760163abaf77c0259025a83c1032ab9a0d587e8 WatchSource:0}: Error finding container 85ed6ee8469c9ff89a63eb5e9760163abaf77c0259025a83c1032ab9a0d587e8: Status 404 returned error can't find the container with id 85ed6ee8469c9ff89a63eb5e9760163abaf77c0259025a83c1032ab9a0d587e8 May 21 16:19:14.846051 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:14.846010 2547 generic.go:358] "Generic (PLEG): container finished" podID="7bb142bd-ad22-4618-b436-51424cf9e364" containerID="eb9d8ecb69f8d2cf036c32997619d600006af08f1abc640cccfc7a715f685fbb" exitCode=0 May 21 16:19:14.846239 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:14.846072 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f" event={"ID":"7bb142bd-ad22-4618-b436-51424cf9e364","Type":"ContainerDied","Data":"eb9d8ecb69f8d2cf036c32997619d600006af08f1abc640cccfc7a715f685fbb"} May 21 16:19:14.846239 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:14.846110 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f" event={"ID":"7bb142bd-ad22-4618-b436-51424cf9e364","Type":"ContainerStarted","Data":"85ed6ee8469c9ff89a63eb5e9760163abaf77c0259025a83c1032ab9a0d587e8"} May 21 16:19:15.853967 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:15.853933 2547 generic.go:358] "Generic (PLEG): container finished" podID="7bb142bd-ad22-4618-b436-51424cf9e364" containerID="cdeeba995752e9ff9b6a27e15b1ca50e3224c46800044135e2162d8aea7a476a" exitCode=0 May 21 16:19:15.854365 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:15.854021 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f" event={"ID":"7bb142bd-ad22-4618-b436-51424cf9e364","Type":"ContainerDied","Data":"cdeeba995752e9ff9b6a27e15b1ca50e3224c46800044135e2162d8aea7a476a"} May 21 16:19:16.859367 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:16.859328 2547 generic.go:358] "Generic (PLEG): container finished" podID="7bb142bd-ad22-4618-b436-51424cf9e364" containerID="742ed76d3c60629fc7f5800f00e86c13d77a80fc290256ecfbfc5f60498e6bc9" exitCode=0 May 21 16:19:16.859752 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:16.859413 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f" event={"ID":"7bb142bd-ad22-4618-b436-51424cf9e364","Type":"ContainerDied","Data":"742ed76d3c60629fc7f5800f00e86c13d77a80fc290256ecfbfc5f60498e6bc9"} May 21 16:19:17.993699 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:17.993673 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f" May 21 16:19:18.130406 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:18.130312 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bb142bd-ad22-4618-b436-51424cf9e364-util\") pod \"7bb142bd-ad22-4618-b436-51424cf9e364\" (UID: \"7bb142bd-ad22-4618-b436-51424cf9e364\") " May 21 16:19:18.130406 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:18.130382 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bb142bd-ad22-4618-b436-51424cf9e364-bundle\") pod \"7bb142bd-ad22-4618-b436-51424cf9e364\" (UID: \"7bb142bd-ad22-4618-b436-51424cf9e364\") " May 21 16:19:18.130586 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:18.130451 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdmwg\" (UniqueName: \"kubernetes.io/projected/7bb142bd-ad22-4618-b436-51424cf9e364-kube-api-access-wdmwg\") pod \"7bb142bd-ad22-4618-b436-51424cf9e364\" (UID: \"7bb142bd-ad22-4618-b436-51424cf9e364\") " May 21 16:19:18.131204 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:18.131161 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bb142bd-ad22-4618-b436-51424cf9e364-bundle" (OuterVolumeSpecName: "bundle") pod "7bb142bd-ad22-4618-b436-51424cf9e364" (UID: "7bb142bd-ad22-4618-b436-51424cf9e364"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:19:18.132688 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:18.132653 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bb142bd-ad22-4618-b436-51424cf9e364-kube-api-access-wdmwg" (OuterVolumeSpecName: "kube-api-access-wdmwg") pod "7bb142bd-ad22-4618-b436-51424cf9e364" (UID: "7bb142bd-ad22-4618-b436-51424cf9e364"). InnerVolumeSpecName "kube-api-access-wdmwg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:19:18.135931 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:18.135908 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bb142bd-ad22-4618-b436-51424cf9e364-util" (OuterVolumeSpecName: "util") pod "7bb142bd-ad22-4618-b436-51424cf9e364" (UID: "7bb142bd-ad22-4618-b436-51424cf9e364"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:19:18.231504 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:18.231467 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdmwg\" (UniqueName: \"kubernetes.io/projected/7bb142bd-ad22-4618-b436-51424cf9e364-kube-api-access-wdmwg\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:19:18.231504 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:18.231498 2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bb142bd-ad22-4618-b436-51424cf9e364-util\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:19:18.231504 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:18.231508 2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bb142bd-ad22-4618-b436-51424cf9e364-bundle\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:19:18.869309 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:18.869281 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f" May 21 16:19:18.869505 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:18.869279 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5qjr8f" event={"ID":"7bb142bd-ad22-4618-b436-51424cf9e364","Type":"ContainerDied","Data":"85ed6ee8469c9ff89a63eb5e9760163abaf77c0259025a83c1032ab9a0d587e8"} May 21 16:19:18.869505 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:18.869386 2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85ed6ee8469c9ff89a63eb5e9760163abaf77c0259025a83c1032ab9a0d587e8" May 21 16:19:25.115790 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.115749 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d586fd4bc-z7nd6"] May 21 16:19:25.116250 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.116065 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bb142bd-ad22-4618-b436-51424cf9e364" containerName="pull" May 21 16:19:25.116250 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.116077 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bb142bd-ad22-4618-b436-51424cf9e364" containerName="pull" May 21 16:19:25.116250 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.116087 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bb142bd-ad22-4618-b436-51424cf9e364" containerName="extract" May 21 16:19:25.116250 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.116093 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bb142bd-ad22-4618-b436-51424cf9e364" containerName="extract" May 21 16:19:25.116250 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.116113 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bb142bd-ad22-4618-b436-51424cf9e364" containerName="util" May 21 16:19:25.116250 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.116119 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bb142bd-ad22-4618-b436-51424cf9e364" containerName="util" May 21 16:19:25.116250 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.116184 2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="7bb142bd-ad22-4618-b436-51424cf9e364" containerName="extract" May 21 16:19:25.119221 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.119195 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d586fd4bc-z7nd6" May 21 16:19:25.123663 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.123638 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 16:19:25.123800 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.123779 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 16:19:25.123902 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.123807 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 16:19:25.123961 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.123810 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-kd8kp\"" May 21 16:19:25.131278 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.131255 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d586fd4bc-z7nd6"] May 21 16:19:25.193293 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.193255 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36f1c08b-1fd8-4e2d-a27a-4de787882db3-cert\") pod \"lws-controller-manager-d586fd4bc-z7nd6\" (UID: \"36f1c08b-1fd8-4e2d-a27a-4de787882db3\") " pod="openshift-lws-operator/lws-controller-manager-d586fd4bc-z7nd6" May 21 16:19:25.193478 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.193310 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/36f1c08b-1fd8-4e2d-a27a-4de787882db3-manager-config\") pod \"lws-controller-manager-d586fd4bc-z7nd6\" (UID: \"36f1c08b-1fd8-4e2d-a27a-4de787882db3\") " pod="openshift-lws-operator/lws-controller-manager-d586fd4bc-z7nd6" May 21 16:19:25.193478 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.193394 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/36f1c08b-1fd8-4e2d-a27a-4de787882db3-metrics-cert\") pod \"lws-controller-manager-d586fd4bc-z7nd6\" (UID: \"36f1c08b-1fd8-4e2d-a27a-4de787882db3\") " pod="openshift-lws-operator/lws-controller-manager-d586fd4bc-z7nd6" May 21 16:19:25.193478 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.193422 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shhsx\" (UniqueName: \"kubernetes.io/projected/36f1c08b-1fd8-4e2d-a27a-4de787882db3-kube-api-access-shhsx\") pod \"lws-controller-manager-d586fd4bc-z7nd6\" (UID: \"36f1c08b-1fd8-4e2d-a27a-4de787882db3\") " pod="openshift-lws-operator/lws-controller-manager-d586fd4bc-z7nd6" May 21 16:19:25.294237 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.294197 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/36f1c08b-1fd8-4e2d-a27a-4de787882db3-metrics-cert\") pod \"lws-controller-manager-d586fd4bc-z7nd6\" (UID: \"36f1c08b-1fd8-4e2d-a27a-4de787882db3\") " pod="openshift-lws-operator/lws-controller-manager-d586fd4bc-z7nd6" May 21 16:19:25.294407 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.294249 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-shhsx\" (UniqueName: \"kubernetes.io/projected/36f1c08b-1fd8-4e2d-a27a-4de787882db3-kube-api-access-shhsx\") pod \"lws-controller-manager-d586fd4bc-z7nd6\" (UID: \"36f1c08b-1fd8-4e2d-a27a-4de787882db3\") " pod="openshift-lws-operator/lws-controller-manager-d586fd4bc-z7nd6" May 21 16:19:25.294407 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.294306 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36f1c08b-1fd8-4e2d-a27a-4de787882db3-cert\") pod \"lws-controller-manager-d586fd4bc-z7nd6\" (UID: \"36f1c08b-1fd8-4e2d-a27a-4de787882db3\") " pod="openshift-lws-operator/lws-controller-manager-d586fd4bc-z7nd6" May 21 16:19:25.294407 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.294340 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/36f1c08b-1fd8-4e2d-a27a-4de787882db3-manager-config\") pod \"lws-controller-manager-d586fd4bc-z7nd6\" (UID: \"36f1c08b-1fd8-4e2d-a27a-4de787882db3\") " pod="openshift-lws-operator/lws-controller-manager-d586fd4bc-z7nd6" May 21 16:19:25.295059 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.295036 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/36f1c08b-1fd8-4e2d-a27a-4de787882db3-manager-config\") pod \"lws-controller-manager-d586fd4bc-z7nd6\" (UID: \"36f1c08b-1fd8-4e2d-a27a-4de787882db3\") " pod="openshift-lws-operator/lws-controller-manager-d586fd4bc-z7nd6" May 21 16:19:25.296916 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.296895 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36f1c08b-1fd8-4e2d-a27a-4de787882db3-cert\") pod \"lws-controller-manager-d586fd4bc-z7nd6\" (UID: \"36f1c08b-1fd8-4e2d-a27a-4de787882db3\") " pod="openshift-lws-operator/lws-controller-manager-d586fd4bc-z7nd6" May 21 16:19:25.296998 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.296895 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/36f1c08b-1fd8-4e2d-a27a-4de787882db3-metrics-cert\") pod \"lws-controller-manager-d586fd4bc-z7nd6\" (UID: \"36f1c08b-1fd8-4e2d-a27a-4de787882db3\") " pod="openshift-lws-operator/lws-controller-manager-d586fd4bc-z7nd6" May 21 16:19:25.304774 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.304753 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shhsx\" (UniqueName: \"kubernetes.io/projected/36f1c08b-1fd8-4e2d-a27a-4de787882db3-kube-api-access-shhsx\") pod \"lws-controller-manager-d586fd4bc-z7nd6\" (UID: \"36f1c08b-1fd8-4e2d-a27a-4de787882db3\") " pod="openshift-lws-operator/lws-controller-manager-d586fd4bc-z7nd6" May 21 16:19:25.429326 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.429241 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d586fd4bc-z7nd6" May 21 16:19:25.571051 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.571030 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d586fd4bc-z7nd6"] May 21 16:19:25.573363 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:19:25.573336 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36f1c08b_1fd8_4e2d_a27a_4de787882db3.slice/crio-0de6851d2c98e0c79bcfe9f9b95ce2ef08b897525bebf9f48af787192f32efd6 WatchSource:0}: Error finding container 0de6851d2c98e0c79bcfe9f9b95ce2ef08b897525bebf9f48af787192f32efd6: Status 404 returned error can't find the container with id 0de6851d2c98e0c79bcfe9f9b95ce2ef08b897525bebf9f48af787192f32efd6 May 21 16:19:25.892096 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:25.892059 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d586fd4bc-z7nd6" event={"ID":"36f1c08b-1fd8-4e2d-a27a-4de787882db3","Type":"ContainerStarted","Data":"0de6851d2c98e0c79bcfe9f9b95ce2ef08b897525bebf9f48af787192f32efd6"} May 21 16:19:27.899902 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:27.899865 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d586fd4bc-z7nd6" event={"ID":"36f1c08b-1fd8-4e2d-a27a-4de787882db3","Type":"ContainerStarted","Data":"3a1a959f4145f48d3bdbfe059aad572a31d70ef21325aa710bbef20396249e4d"} May 21 16:19:27.900276 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:27.899991 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d586fd4bc-z7nd6" May 21 16:19:27.927459 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:27.927394 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d586fd4bc-z7nd6" podStartSLOduration=0.986854143 podStartE2EDuration="2.927373984s" podCreationTimestamp="2026-05-21 16:19:25 +0000 UTC" firstStartedPulling="2026-05-21 16:19:25.575051309 +0000 UTC m=+470.873772191" lastFinishedPulling="2026-05-21 16:19:27.515571151 +0000 UTC m=+472.814292032" observedRunningTime="2026-05-21 16:19:27.924596681 +0000 UTC m=+473.223317603" watchObservedRunningTime="2026-05-21 16:19:27.927373984 +0000 UTC m=+473.226094886" May 21 16:19:28.143255 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.143223 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77666b9699-62v4j"] May 21 16:19:28.146733 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.146713 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-62v4j" May 21 16:19:28.154582 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.154557 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2574d\"" May 21 16:19:28.154961 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.154917 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 16:19:28.154961 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.154957 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 16:19:28.155139 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.154958 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 16:19:28.155237 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.155222 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 16:19:28.168114 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.168073 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77666b9699-62v4j"] May 21 16:19:28.222179 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.222134 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e432296a-5307-4053-b42d-b34b56a4e3ff-webhook-cert\") pod \"opendatahub-operator-controller-manager-77666b9699-62v4j\" (UID: \"e432296a-5307-4053-b42d-b34b56a4e3ff\") " pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-62v4j" May 21 16:19:28.222341 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.222191 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e432296a-5307-4053-b42d-b34b56a4e3ff-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77666b9699-62v4j\" (UID: \"e432296a-5307-4053-b42d-b34b56a4e3ff\") " pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-62v4j" May 21 16:19:28.222341 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.222221 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv96n\" (UniqueName: \"kubernetes.io/projected/e432296a-5307-4053-b42d-b34b56a4e3ff-kube-api-access-fv96n\") pod \"opendatahub-operator-controller-manager-77666b9699-62v4j\" (UID: \"e432296a-5307-4053-b42d-b34b56a4e3ff\") " pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-62v4j" May 21 16:19:28.322666 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.322627 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e432296a-5307-4053-b42d-b34b56a4e3ff-webhook-cert\") pod \"opendatahub-operator-controller-manager-77666b9699-62v4j\" (UID: \"e432296a-5307-4053-b42d-b34b56a4e3ff\") " pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-62v4j" May 21 16:19:28.322882 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.322675 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e432296a-5307-4053-b42d-b34b56a4e3ff-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77666b9699-62v4j\" (UID: \"e432296a-5307-4053-b42d-b34b56a4e3ff\") " pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-62v4j" May 21 16:19:28.322882 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.322703 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fv96n\" (UniqueName: \"kubernetes.io/projected/e432296a-5307-4053-b42d-b34b56a4e3ff-kube-api-access-fv96n\") pod \"opendatahub-operator-controller-manager-77666b9699-62v4j\" (UID: \"e432296a-5307-4053-b42d-b34b56a4e3ff\") " pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-62v4j" May 21 16:19:28.325266 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.325236 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e432296a-5307-4053-b42d-b34b56a4e3ff-webhook-cert\") pod \"opendatahub-operator-controller-manager-77666b9699-62v4j\" (UID: \"e432296a-5307-4053-b42d-b34b56a4e3ff\") " pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-62v4j" May 21 16:19:28.325266 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.325245 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e432296a-5307-4053-b42d-b34b56a4e3ff-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77666b9699-62v4j\" (UID: \"e432296a-5307-4053-b42d-b34b56a4e3ff\") " pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-62v4j" May 21 16:19:28.337758 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.337732 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv96n\" (UniqueName: \"kubernetes.io/projected/e432296a-5307-4053-b42d-b34b56a4e3ff-kube-api-access-fv96n\") pod \"opendatahub-operator-controller-manager-77666b9699-62v4j\" (UID: \"e432296a-5307-4053-b42d-b34b56a4e3ff\") " pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-62v4j" May 21 16:19:28.458089 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.458004 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-62v4j" May 21 16:19:28.508613 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.508362 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp"] May 21 16:19:28.513840 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.513796 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp" May 21 16:19:28.517334 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.516808 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 16:19:28.517334 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.516898 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 16:19:28.517334 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.517143 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2l7zb\"" May 21 16:19:28.521869 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.521842 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp"] May 21 16:19:28.524597 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.524380 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a177d127-6447-4230-97fd-e14b4160ec19-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp\" (UID: \"a177d127-6447-4230-97fd-e14b4160ec19\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp" May 21 16:19:28.524597 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.524449 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wwrm\" (UniqueName: \"kubernetes.io/projected/a177d127-6447-4230-97fd-e14b4160ec19-kube-api-access-4wwrm\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp\" (UID: \"a177d127-6447-4230-97fd-e14b4160ec19\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp" May 21 16:19:28.524597 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.524500 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a177d127-6447-4230-97fd-e14b4160ec19-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp\" (UID: \"a177d127-6447-4230-97fd-e14b4160ec19\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp" May 21 16:19:28.607392 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.607363 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77666b9699-62v4j"] May 21 16:19:28.609771 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:19:28.609743 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode432296a_5307_4053_b42d_b34b56a4e3ff.slice/crio-7f060388fce60e37d15514b7e19a9b8630daf958873f1577b207183d607d2cf2 WatchSource:0}: Error finding container 7f060388fce60e37d15514b7e19a9b8630daf958873f1577b207183d607d2cf2: Status 404 returned error can't find the container with id 7f060388fce60e37d15514b7e19a9b8630daf958873f1577b207183d607d2cf2 May 21 16:19:28.625970 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.625946 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a177d127-6447-4230-97fd-e14b4160ec19-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp\" (UID: \"a177d127-6447-4230-97fd-e14b4160ec19\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp" May 21 16:19:28.626079 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.626010 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4wwrm\" (UniqueName: \"kubernetes.io/projected/a177d127-6447-4230-97fd-e14b4160ec19-kube-api-access-4wwrm\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp\" (UID: \"a177d127-6447-4230-97fd-e14b4160ec19\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp" May 21 16:19:28.626079 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.626049 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a177d127-6447-4230-97fd-e14b4160ec19-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp\" (UID: \"a177d127-6447-4230-97fd-e14b4160ec19\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp" May 21 16:19:28.626386 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.626362 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a177d127-6447-4230-97fd-e14b4160ec19-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp\" (UID: \"a177d127-6447-4230-97fd-e14b4160ec19\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp" May 21 16:19:28.626463 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.626387 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a177d127-6447-4230-97fd-e14b4160ec19-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp\" (UID: \"a177d127-6447-4230-97fd-e14b4160ec19\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp" May 21 16:19:28.634618 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.634594 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wwrm\" (UniqueName: \"kubernetes.io/projected/a177d127-6447-4230-97fd-e14b4160ec19-kube-api-access-4wwrm\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp\" (UID: \"a177d127-6447-4230-97fd-e14b4160ec19\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp" May 21 16:19:28.837012 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.836978 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp" May 21 16:19:28.905086 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.905048 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-62v4j" event={"ID":"e432296a-5307-4053-b42d-b34b56a4e3ff","Type":"ContainerStarted","Data":"7f060388fce60e37d15514b7e19a9b8630daf958873f1577b207183d607d2cf2"} May 21 16:19:28.974510 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:28.972132 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp"] May 21 16:19:29.909754 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:29.909718 2547 generic.go:358] "Generic (PLEG): container finished" podID="a177d127-6447-4230-97fd-e14b4160ec19" containerID="6dde4c611c8129df1ea50b85fc539ccc05deb9cbbebbffe397137f8de03eeaa7" exitCode=0 May 21 16:19:29.910250 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:29.909813 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp" event={"ID":"a177d127-6447-4230-97fd-e14b4160ec19","Type":"ContainerDied","Data":"6dde4c611c8129df1ea50b85fc539ccc05deb9cbbebbffe397137f8de03eeaa7"} May 21 16:19:29.910250 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:29.909867 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp" event={"ID":"a177d127-6447-4230-97fd-e14b4160ec19","Type":"ContainerStarted","Data":"8fcf3d40984fc7e69aca2bc55c47e5defa320f183988b3d25bb8188dbdd7c583"} May 21 16:19:31.919541 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:31.919501 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-62v4j" event={"ID":"e432296a-5307-4053-b42d-b34b56a4e3ff","Type":"ContainerStarted","Data":"34c28c494bc52554e556e7915f7da03510d7fc04e74ea2945cd6b029ee367b94"} May 21 16:19:31.920041 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:31.919576 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-62v4j" May 21 16:19:31.921232 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:31.921208 2547 generic.go:358] "Generic (PLEG): container finished" podID="a177d127-6447-4230-97fd-e14b4160ec19" containerID="d31a7b021b6fbe153f61ba7965a97ed4158872c4d323660d4d3bdaceb0a805c0" exitCode=0 May 21 16:19:31.921326 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:31.921243 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp" event={"ID":"a177d127-6447-4230-97fd-e14b4160ec19","Type":"ContainerDied","Data":"d31a7b021b6fbe153f61ba7965a97ed4158872c4d323660d4d3bdaceb0a805c0"} May 21 16:19:31.976949 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:31.976886 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-62v4j" podStartSLOduration=1.5349677800000001 podStartE2EDuration="3.97686526s" podCreationTimestamp="2026-05-21 16:19:28 +0000 UTC" firstStartedPulling="2026-05-21 16:19:28.611541607 +0000 UTC m=+473.910262485" lastFinishedPulling="2026-05-21 16:19:31.053439071 +0000 UTC m=+476.352159965" observedRunningTime="2026-05-21 16:19:31.949296941 +0000 UTC m=+477.248017841" watchObservedRunningTime="2026-05-21 16:19:31.97686526 +0000 UTC m=+477.275586363" May 21 16:19:32.927015 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:32.926978 2547 generic.go:358] "Generic (PLEG): container finished" podID="a177d127-6447-4230-97fd-e14b4160ec19" containerID="045bec9b07298f833de4ef84645df5f70ecf1e1f734577f5b9effa4c0a8712c2" exitCode=0 May 21 16:19:32.927388 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:32.927053 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp" event={"ID":"a177d127-6447-4230-97fd-e14b4160ec19","Type":"ContainerDied","Data":"045bec9b07298f833de4ef84645df5f70ecf1e1f734577f5b9effa4c0a8712c2"} May 21 16:19:34.055696 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:34.055671 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp" May 21 16:19:34.076938 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:34.076900 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wwrm\" (UniqueName: \"kubernetes.io/projected/a177d127-6447-4230-97fd-e14b4160ec19-kube-api-access-4wwrm\") pod \"a177d127-6447-4230-97fd-e14b4160ec19\" (UID: \"a177d127-6447-4230-97fd-e14b4160ec19\") " May 21 16:19:34.077121 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:34.076995 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a177d127-6447-4230-97fd-e14b4160ec19-bundle\") pod \"a177d127-6447-4230-97fd-e14b4160ec19\" (UID: \"a177d127-6447-4230-97fd-e14b4160ec19\") " May 21 16:19:34.077121 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:34.077060 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a177d127-6447-4230-97fd-e14b4160ec19-util\") pod \"a177d127-6447-4230-97fd-e14b4160ec19\" (UID: \"a177d127-6447-4230-97fd-e14b4160ec19\") " May 21 16:19:34.078162 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:34.078102 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a177d127-6447-4230-97fd-e14b4160ec19-bundle" (OuterVolumeSpecName: "bundle") pod "a177d127-6447-4230-97fd-e14b4160ec19" (UID: "a177d127-6447-4230-97fd-e14b4160ec19"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:19:34.079542 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:34.079516 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a177d127-6447-4230-97fd-e14b4160ec19-kube-api-access-4wwrm" (OuterVolumeSpecName: "kube-api-access-4wwrm") pod "a177d127-6447-4230-97fd-e14b4160ec19" (UID: "a177d127-6447-4230-97fd-e14b4160ec19"). InnerVolumeSpecName "kube-api-access-4wwrm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:19:34.082476 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:34.082449 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a177d127-6447-4230-97fd-e14b4160ec19-util" (OuterVolumeSpecName: "util") pod "a177d127-6447-4230-97fd-e14b4160ec19" (UID: "a177d127-6447-4230-97fd-e14b4160ec19"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:19:34.178389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:34.178342 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wwrm\" (UniqueName: \"kubernetes.io/projected/a177d127-6447-4230-97fd-e14b4160ec19-kube-api-access-4wwrm\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:19:34.178389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:34.178381 2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a177d127-6447-4230-97fd-e14b4160ec19-bundle\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:19:34.178389 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:34.178390 2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a177d127-6447-4230-97fd-e14b4160ec19-util\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:19:34.936063 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:34.936030 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp" May 21 16:19:34.936234 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:34.936029 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lvgcp" event={"ID":"a177d127-6447-4230-97fd-e14b4160ec19","Type":"ContainerDied","Data":"8fcf3d40984fc7e69aca2bc55c47e5defa320f183988b3d25bb8188dbdd7c583"} May 21 16:19:34.936234 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:34.936141 2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8fcf3d40984fc7e69aca2bc55c47e5defa320f183988b3d25bb8188dbdd7c583" May 21 16:19:38.907469 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:38.907434 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d586fd4bc-z7nd6" May 21 16:19:42.929948 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:19:42.929917 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-77666b9699-62v4j" May 21 16:20:06.880518 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:06.880478 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4"] May 21 16:20:06.881051 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:06.881007 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a177d127-6447-4230-97fd-e14b4160ec19" containerName="pull" May 21 16:20:06.881051 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:06.881026 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a177d127-6447-4230-97fd-e14b4160ec19" containerName="pull" May 21 16:20:06.881051 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:06.881051 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a177d127-6447-4230-97fd-e14b4160ec19" containerName="extract" May 21 16:20:06.881207 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:06.881060 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a177d127-6447-4230-97fd-e14b4160ec19" containerName="extract" May 21 16:20:06.881207 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:06.881087 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a177d127-6447-4230-97fd-e14b4160ec19" containerName="util" May 21 16:20:06.881207 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:06.881097 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a177d127-6447-4230-97fd-e14b4160ec19" containerName="util" May 21 16:20:06.881207 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:06.881187 2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="a177d127-6447-4230-97fd-e14b4160ec19" containerName="extract" May 21 16:20:06.887102 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:06.887078 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4" May 21 16:20:06.890091 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:06.890070 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 16:20:06.891134 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:06.891116 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 16:20:06.891395 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:06.891379 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2l7zb\"" May 21 16:20:06.900142 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:06.900121 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4"] May 21 16:20:06.966991 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:06.966955 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/145e3162-ceeb-4cd5-a07c-c11b89834c26-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4\" (UID: \"145e3162-ceeb-4cd5-a07c-c11b89834c26\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4" May 21 16:20:06.967163 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:06.967031 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/145e3162-ceeb-4cd5-a07c-c11b89834c26-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4\" (UID: \"145e3162-ceeb-4cd5-a07c-c11b89834c26\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4" May 21 16:20:06.967163 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:06.967109 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnqnk\" (UniqueName: \"kubernetes.io/projected/145e3162-ceeb-4cd5-a07c-c11b89834c26-kube-api-access-pnqnk\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4\" (UID: \"145e3162-ceeb-4cd5-a07c-c11b89834c26\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4" May 21 16:20:07.068366 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:07.068329 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/145e3162-ceeb-4cd5-a07c-c11b89834c26-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4\" (UID: \"145e3162-ceeb-4cd5-a07c-c11b89834c26\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4" May 21 16:20:07.068553 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:07.068414 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pnqnk\" (UniqueName: \"kubernetes.io/projected/145e3162-ceeb-4cd5-a07c-c11b89834c26-kube-api-access-pnqnk\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4\" (UID: \"145e3162-ceeb-4cd5-a07c-c11b89834c26\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4" May 21 16:20:07.068553 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:07.068472 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/145e3162-ceeb-4cd5-a07c-c11b89834c26-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4\" (UID: \"145e3162-ceeb-4cd5-a07c-c11b89834c26\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4" May 21 16:20:07.068675 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:07.068658 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/145e3162-ceeb-4cd5-a07c-c11b89834c26-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4\" (UID: \"145e3162-ceeb-4cd5-a07c-c11b89834c26\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4" May 21 16:20:07.068805 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:07.068786 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/145e3162-ceeb-4cd5-a07c-c11b89834c26-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4\" (UID: \"145e3162-ceeb-4cd5-a07c-c11b89834c26\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4" May 21 16:20:07.076700 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:07.076675 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnqnk\" (UniqueName: \"kubernetes.io/projected/145e3162-ceeb-4cd5-a07c-c11b89834c26-kube-api-access-pnqnk\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4\" (UID: \"145e3162-ceeb-4cd5-a07c-c11b89834c26\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4" May 21 16:20:07.196726 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:07.196642 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4" May 21 16:20:07.333524 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:07.333496 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4"] May 21 16:20:07.335760 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:20:07.335734 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod145e3162_ceeb_4cd5_a07c_c11b89834c26.slice/crio-1def56cb9a3b976b4b60603a1c56dfd275f739abeb69d11cfd6387e7f43143ab WatchSource:0}: Error finding container 1def56cb9a3b976b4b60603a1c56dfd275f739abeb69d11cfd6387e7f43143ab: Status 404 returned error can't find the container with id 1def56cb9a3b976b4b60603a1c56dfd275f739abeb69d11cfd6387e7f43143ab May 21 16:20:08.050535 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:08.050501 2547 generic.go:358] "Generic (PLEG): container finished" podID="145e3162-ceeb-4cd5-a07c-c11b89834c26" containerID="da91718e856f002592e4efdda0668a3c56d37620f7752912f1011a9225e7635d" exitCode=0 May 21 16:20:08.050925 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:08.050564 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4" event={"ID":"145e3162-ceeb-4cd5-a07c-c11b89834c26","Type":"ContainerDied","Data":"da91718e856f002592e4efdda0668a3c56d37620f7752912f1011a9225e7635d"} May 21 16:20:08.050925 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:08.050589 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4" event={"ID":"145e3162-ceeb-4cd5-a07c-c11b89834c26","Type":"ContainerStarted","Data":"1def56cb9a3b976b4b60603a1c56dfd275f739abeb69d11cfd6387e7f43143ab"} May 21 16:20:09.056081 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:09.056048 2547 generic.go:358] "Generic (PLEG): container finished" podID="145e3162-ceeb-4cd5-a07c-c11b89834c26" containerID="38b5091682565ecd0aa8996466020be9987fae48a8e3e93162bb92e2436f64c8" exitCode=0 May 21 16:20:09.056434 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:09.056094 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4" event={"ID":"145e3162-ceeb-4cd5-a07c-c11b89834c26","Type":"ContainerDied","Data":"38b5091682565ecd0aa8996466020be9987fae48a8e3e93162bb92e2436f64c8"} May 21 16:20:10.061306 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:10.061268 2547 generic.go:358] "Generic (PLEG): container finished" podID="145e3162-ceeb-4cd5-a07c-c11b89834c26" containerID="4501b13b0ba05145562356c7e7399fa479087ce493096676a04c387b74b4e4d2" exitCode=0 May 21 16:20:10.061741 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:10.061347 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4" event={"ID":"145e3162-ceeb-4cd5-a07c-c11b89834c26","Type":"ContainerDied","Data":"4501b13b0ba05145562356c7e7399fa479087ce493096676a04c387b74b4e4d2"} May 21 16:20:11.195302 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:11.195276 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4" May 21 16:20:11.306427 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:11.306392 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnqnk\" (UniqueName: \"kubernetes.io/projected/145e3162-ceeb-4cd5-a07c-c11b89834c26-kube-api-access-pnqnk\") pod \"145e3162-ceeb-4cd5-a07c-c11b89834c26\" (UID: \"145e3162-ceeb-4cd5-a07c-c11b89834c26\") " May 21 16:20:11.306629 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:11.306463 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/145e3162-ceeb-4cd5-a07c-c11b89834c26-util\") pod \"145e3162-ceeb-4cd5-a07c-c11b89834c26\" (UID: \"145e3162-ceeb-4cd5-a07c-c11b89834c26\") " May 21 16:20:11.306629 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:11.306514 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/145e3162-ceeb-4cd5-a07c-c11b89834c26-bundle\") pod \"145e3162-ceeb-4cd5-a07c-c11b89834c26\" (UID: \"145e3162-ceeb-4cd5-a07c-c11b89834c26\") " May 21 16:20:11.307442 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:11.307414 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/145e3162-ceeb-4cd5-a07c-c11b89834c26-bundle" (OuterVolumeSpecName: "bundle") pod "145e3162-ceeb-4cd5-a07c-c11b89834c26" (UID: "145e3162-ceeb-4cd5-a07c-c11b89834c26"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:20:11.308617 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:11.308591 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/145e3162-ceeb-4cd5-a07c-c11b89834c26-kube-api-access-pnqnk" (OuterVolumeSpecName: "kube-api-access-pnqnk") pod "145e3162-ceeb-4cd5-a07c-c11b89834c26" (UID: "145e3162-ceeb-4cd5-a07c-c11b89834c26"). InnerVolumeSpecName "kube-api-access-pnqnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:20:11.311759 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:11.311738 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/145e3162-ceeb-4cd5-a07c-c11b89834c26-util" (OuterVolumeSpecName: "util") pod "145e3162-ceeb-4cd5-a07c-c11b89834c26" (UID: "145e3162-ceeb-4cd5-a07c-c11b89834c26"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:20:11.407355 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:11.407324 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnqnk\" (UniqueName: \"kubernetes.io/projected/145e3162-ceeb-4cd5-a07c-c11b89834c26-kube-api-access-pnqnk\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:20:11.407355 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:11.407352 2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/145e3162-ceeb-4cd5-a07c-c11b89834c26-util\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:20:11.407355 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:11.407362 2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/145e3162-ceeb-4cd5-a07c-c11b89834c26-bundle\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:20:12.069694 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:12.069663 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4" May 21 16:20:12.069900 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:12.069665 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nflr4" event={"ID":"145e3162-ceeb-4cd5-a07c-c11b89834c26","Type":"ContainerDied","Data":"1def56cb9a3b976b4b60603a1c56dfd275f739abeb69d11cfd6387e7f43143ab"} May 21 16:20:12.069900 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:12.069771 2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1def56cb9a3b976b4b60603a1c56dfd275f739abeb69d11cfd6387e7f43143ab" May 21 16:20:21.188591 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:21.188558 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8"] May 21 16:20:21.189056 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:21.188902 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="145e3162-ceeb-4cd5-a07c-c11b89834c26" containerName="util" May 21 16:20:21.189056 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:21.188914 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="145e3162-ceeb-4cd5-a07c-c11b89834c26" containerName="util" May 21 16:20:21.189056 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:21.188929 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="145e3162-ceeb-4cd5-a07c-c11b89834c26" containerName="extract" May 21 16:20:21.189056 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:21.188934 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="145e3162-ceeb-4cd5-a07c-c11b89834c26" containerName="extract" May 21 16:20:21.189056 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:21.188941 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="145e3162-ceeb-4cd5-a07c-c11b89834c26" containerName="pull" May 21 16:20:21.189056 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:21.188946 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="145e3162-ceeb-4cd5-a07c-c11b89834c26" containerName="pull" May 21 16:20:21.189056 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:21.189012 2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="145e3162-ceeb-4cd5-a07c-c11b89834c26" containerName="extract" May 21 16:20:21.193331 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:21.193315 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8" May 21 16:20:21.224025 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:21.223995 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 16:20:21.224173 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:21.224136 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2l7zb\"" May 21 16:20:21.224173 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:21.224147 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 16:20:21.230171 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:21.230145 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8"] May 21 16:20:21.293235 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:21.293198 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xjjr\" (UniqueName: \"kubernetes.io/projected/57ddcea5-b144-484f-bb0b-35e35b25b9a5-kube-api-access-2xjjr\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8\" (UID: \"57ddcea5-b144-484f-bb0b-35e35b25b9a5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8" May 21 16:20:21.293423 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:21.293259 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57ddcea5-b144-484f-bb0b-35e35b25b9a5-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8\" (UID: \"57ddcea5-b144-484f-bb0b-35e35b25b9a5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8" May 21 16:20:21.293423 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:21.293339 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57ddcea5-b144-484f-bb0b-35e35b25b9a5-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8\" (UID: \"57ddcea5-b144-484f-bb0b-35e35b25b9a5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8" May 21 16:20:21.393921 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:21.393884 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57ddcea5-b144-484f-bb0b-35e35b25b9a5-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8\" (UID: \"57ddcea5-b144-484f-bb0b-35e35b25b9a5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8" May 21 16:20:21.394120 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:21.393981 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57ddcea5-b144-484f-bb0b-35e35b25b9a5-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8\" (UID: \"57ddcea5-b144-484f-bb0b-35e35b25b9a5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8" May 21 16:20:21.394120 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:21.394040 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2xjjr\" (UniqueName: \"kubernetes.io/projected/57ddcea5-b144-484f-bb0b-35e35b25b9a5-kube-api-access-2xjjr\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8\" (UID: \"57ddcea5-b144-484f-bb0b-35e35b25b9a5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8" May 21 16:20:21.394288 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:21.394265 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57ddcea5-b144-484f-bb0b-35e35b25b9a5-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8\" (UID: \"57ddcea5-b144-484f-bb0b-35e35b25b9a5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8" May 21 16:20:21.394354 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:21.394305 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57ddcea5-b144-484f-bb0b-35e35b25b9a5-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8\" (UID: \"57ddcea5-b144-484f-bb0b-35e35b25b9a5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8" May 21 16:20:21.407055 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:21.407029 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xjjr\" (UniqueName: \"kubernetes.io/projected/57ddcea5-b144-484f-bb0b-35e35b25b9a5-kube-api-access-2xjjr\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8\" (UID: \"57ddcea5-b144-484f-bb0b-35e35b25b9a5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8" May 21 16:20:21.503160 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:21.503063 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8" May 21 16:20:21.646736 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:21.646708 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8"] May 21 16:20:21.649421 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:20:21.649386 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57ddcea5_b144_484f_bb0b_35e35b25b9a5.slice/crio-ea8ee0a310afe1b435d9f911ab64c1f5419fb9e681ad39499677eb463b1fded9 WatchSource:0}: Error finding container ea8ee0a310afe1b435d9f911ab64c1f5419fb9e681ad39499677eb463b1fded9: Status 404 returned error can't find the container with id ea8ee0a310afe1b435d9f911ab64c1f5419fb9e681ad39499677eb463b1fded9 May 21 16:20:22.105876 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:22.105828 2547 generic.go:358] "Generic (PLEG): container finished" podID="57ddcea5-b144-484f-bb0b-35e35b25b9a5" containerID="a9ce251cbd7694758d7b4a66cfd9610171b69a3829a9d75dd14e49dcea5fbf27" exitCode=0 May 21 16:20:22.106085 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:22.105910 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8" event={"ID":"57ddcea5-b144-484f-bb0b-35e35b25b9a5","Type":"ContainerDied","Data":"a9ce251cbd7694758d7b4a66cfd9610171b69a3829a9d75dd14e49dcea5fbf27"} May 21 16:20:22.106085 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:22.105949 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8" event={"ID":"57ddcea5-b144-484f-bb0b-35e35b25b9a5","Type":"ContainerStarted","Data":"ea8ee0a310afe1b435d9f911ab64c1f5419fb9e681ad39499677eb463b1fded9"} May 21 16:20:23.111746 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:23.111711 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8" event={"ID":"57ddcea5-b144-484f-bb0b-35e35b25b9a5","Type":"ContainerStarted","Data":"79f8110ef294d840d13ff006d2a031341a8df531eb6b1f09774830b255e30f42"} May 21 16:20:24.117519 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:24.117486 2547 generic.go:358] "Generic (PLEG): container finished" podID="57ddcea5-b144-484f-bb0b-35e35b25b9a5" containerID="79f8110ef294d840d13ff006d2a031341a8df531eb6b1f09774830b255e30f42" exitCode=0 May 21 16:20:24.117948 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:24.117554 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8" event={"ID":"57ddcea5-b144-484f-bb0b-35e35b25b9a5","Type":"ContainerDied","Data":"79f8110ef294d840d13ff006d2a031341a8df531eb6b1f09774830b255e30f42"} May 21 16:20:25.122638 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:25.122601 2547 generic.go:358] "Generic (PLEG): container finished" podID="57ddcea5-b144-484f-bb0b-35e35b25b9a5" containerID="3806e96ca71a5df9a70bdbfae5621639510125dfeb5ab3e44d1d241fab9e7ca4" exitCode=0 May 21 16:20:25.122638 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:25.122644 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8" event={"ID":"57ddcea5-b144-484f-bb0b-35e35b25b9a5","Type":"ContainerDied","Data":"3806e96ca71a5df9a70bdbfae5621639510125dfeb5ab3e44d1d241fab9e7ca4"} May 21 16:20:26.253868 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:26.253840 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8" May 21 16:20:26.338026 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:26.337986 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57ddcea5-b144-484f-bb0b-35e35b25b9a5-util\") pod \"57ddcea5-b144-484f-bb0b-35e35b25b9a5\" (UID: \"57ddcea5-b144-484f-bb0b-35e35b25b9a5\") " May 21 16:20:26.338201 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:26.338068 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57ddcea5-b144-484f-bb0b-35e35b25b9a5-bundle\") pod \"57ddcea5-b144-484f-bb0b-35e35b25b9a5\" (UID: \"57ddcea5-b144-484f-bb0b-35e35b25b9a5\") " May 21 16:20:26.338201 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:26.338097 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xjjr\" (UniqueName: \"kubernetes.io/projected/57ddcea5-b144-484f-bb0b-35e35b25b9a5-kube-api-access-2xjjr\") pod \"57ddcea5-b144-484f-bb0b-35e35b25b9a5\" (UID: \"57ddcea5-b144-484f-bb0b-35e35b25b9a5\") " May 21 16:20:26.338962 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:26.338936 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57ddcea5-b144-484f-bb0b-35e35b25b9a5-bundle" (OuterVolumeSpecName: "bundle") pod "57ddcea5-b144-484f-bb0b-35e35b25b9a5" (UID: "57ddcea5-b144-484f-bb0b-35e35b25b9a5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:20:26.340333 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:26.340300 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57ddcea5-b144-484f-bb0b-35e35b25b9a5-kube-api-access-2xjjr" (OuterVolumeSpecName: "kube-api-access-2xjjr") pod "57ddcea5-b144-484f-bb0b-35e35b25b9a5" (UID: "57ddcea5-b144-484f-bb0b-35e35b25b9a5"). InnerVolumeSpecName "kube-api-access-2xjjr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:20:26.343479 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:26.343447 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57ddcea5-b144-484f-bb0b-35e35b25b9a5-util" (OuterVolumeSpecName: "util") pod "57ddcea5-b144-484f-bb0b-35e35b25b9a5" (UID: "57ddcea5-b144-484f-bb0b-35e35b25b9a5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:20:26.438853 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:26.438751 2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57ddcea5-b144-484f-bb0b-35e35b25b9a5-bundle\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:20:26.438853 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:26.438784 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xjjr\" (UniqueName: \"kubernetes.io/projected/57ddcea5-b144-484f-bb0b-35e35b25b9a5-kube-api-access-2xjjr\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:20:26.438853 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:26.438798 2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57ddcea5-b144-484f-bb0b-35e35b25b9a5-util\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:20:27.130861 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:27.130827 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8" May 21 16:20:27.131033 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:27.130802 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqv5c8" event={"ID":"57ddcea5-b144-484f-bb0b-35e35b25b9a5","Type":"ContainerDied","Data":"ea8ee0a310afe1b435d9f911ab64c1f5419fb9e681ad39499677eb463b1fded9"} May 21 16:20:27.131033 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:27.130939 2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea8ee0a310afe1b435d9f911ab64c1f5419fb9e681ad39499677eb463b1fded9" May 21 16:20:33.138334 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.138300 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq"] May 21 16:20:33.139005 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.138979 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57ddcea5-b144-484f-bb0b-35e35b25b9a5" containerName="pull" May 21 16:20:33.139157 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.139144 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="57ddcea5-b144-484f-bb0b-35e35b25b9a5" containerName="pull" May 21 16:20:33.139291 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.139280 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57ddcea5-b144-484f-bb0b-35e35b25b9a5" containerName="util" May 21 16:20:33.139369 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.139360 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="57ddcea5-b144-484f-bb0b-35e35b25b9a5" containerName="util" May 21 16:20:33.139435 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.139427 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57ddcea5-b144-484f-bb0b-35e35b25b9a5" containerName="extract" May 21 16:20:33.139513 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.139505 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="57ddcea5-b144-484f-bb0b-35e35b25b9a5" containerName="extract" May 21 16:20:33.139869 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.139854 2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="57ddcea5-b144-484f-bb0b-35e35b25b9a5" containerName="extract" May 21 16:20:33.149236 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.149206 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.153146 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.153120 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 21 16:20:33.153429 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.153410 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-9xd6g\"" May 21 16:20:33.155529 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.155503 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq"] May 21 16:20:33.197342 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.197304 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d21c6555-1260-412a-9a12-532dbfd30bd0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.197529 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.197353 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d21c6555-1260-412a-9a12-532dbfd30bd0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.197529 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.197419 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d21c6555-1260-412a-9a12-532dbfd30bd0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.197529 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.197461 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d21c6555-1260-412a-9a12-532dbfd30bd0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.197529 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.197482 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d21c6555-1260-412a-9a12-532dbfd30bd0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.197529 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.197500 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d21c6555-1260-412a-9a12-532dbfd30bd0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.197529 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.197529 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d21c6555-1260-412a-9a12-532dbfd30bd0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.197865 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.197562 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgq4n\" (UniqueName: \"kubernetes.io/projected/d21c6555-1260-412a-9a12-532dbfd30bd0-kube-api-access-zgq4n\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.197865 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.197588 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d21c6555-1260-412a-9a12-532dbfd30bd0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.298571 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.298541 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d21c6555-1260-412a-9a12-532dbfd30bd0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.298757 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.298584 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d21c6555-1260-412a-9a12-532dbfd30bd0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.298757 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.298616 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d21c6555-1260-412a-9a12-532dbfd30bd0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.298757 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.298635 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d21c6555-1260-412a-9a12-532dbfd30bd0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.298757 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.298655 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d21c6555-1260-412a-9a12-532dbfd30bd0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.298757 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.298674 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d21c6555-1260-412a-9a12-532dbfd30bd0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.299048 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.298834 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zgq4n\" (UniqueName: \"kubernetes.io/projected/d21c6555-1260-412a-9a12-532dbfd30bd0-kube-api-access-zgq4n\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.299048 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.298906 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d21c6555-1260-412a-9a12-532dbfd30bd0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.299048 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.298982 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d21c6555-1260-412a-9a12-532dbfd30bd0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.299171 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.299065 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d21c6555-1260-412a-9a12-532dbfd30bd0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.299457 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.299434 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d21c6555-1260-412a-9a12-532dbfd30bd0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.299575 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.299441 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d21c6555-1260-412a-9a12-532dbfd30bd0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.299575 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.299546 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d21c6555-1260-412a-9a12-532dbfd30bd0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.299646 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.299550 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d21c6555-1260-412a-9a12-532dbfd30bd0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.301124 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.301102 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d21c6555-1260-412a-9a12-532dbfd30bd0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.301274 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.301256 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d21c6555-1260-412a-9a12-532dbfd30bd0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.306971 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.306947 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d21c6555-1260-412a-9a12-532dbfd30bd0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.307275 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.307254 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgq4n\" (UniqueName: \"kubernetes.io/projected/d21c6555-1260-412a-9a12-532dbfd30bd0-kube-api-access-zgq4n\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq\" (UID: \"d21c6555-1260-412a-9a12-532dbfd30bd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.462241 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.462158 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:33.596433 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:33.596405 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq"] May 21 16:20:33.598412 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:20:33.598382 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd21c6555_1260_412a_9a12_532dbfd30bd0.slice/crio-1bb4d300a2e0e09cf74839fd5cf7c372239fa398bb9e1a86589f9908f6904c69 WatchSource:0}: Error finding container 1bb4d300a2e0e09cf74839fd5cf7c372239fa398bb9e1a86589f9908f6904c69: Status 404 returned error can't find the container with id 1bb4d300a2e0e09cf74839fd5cf7c372239fa398bb9e1a86589f9908f6904c69 May 21 16:20:34.158895 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:34.158854 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" event={"ID":"d21c6555-1260-412a-9a12-532dbfd30bd0","Type":"ContainerStarted","Data":"1bb4d300a2e0e09cf74839fd5cf7c372239fa398bb9e1a86589f9908f6904c69"} May 21 16:20:35.223812 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:35.223784 2547 scope.go:117] "RemoveContainer" containerID="fe2ec41f5132e69541c0c71c93c271571dc861ce6b3e19976f6d10bf0db2d065" May 21 16:20:36.161179 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:36.161136 2547 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} May 21 16:20:36.161295 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:36.161218 2547 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} May 21 16:20:36.161295 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:36.161244 2547 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} May 21 16:20:37.173393 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:37.173352 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" event={"ID":"d21c6555-1260-412a-9a12-532dbfd30bd0","Type":"ContainerStarted","Data":"e8e4eada36cc77404868abdb482bca6c5c796ef0ebf21be49a133940e168d943"} May 21 16:20:37.210097 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:37.210009 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" podStartSLOduration=1.649886406 podStartE2EDuration="4.209989156s" podCreationTimestamp="2026-05-21 16:20:33 +0000 UTC" firstStartedPulling="2026-05-21 16:20:33.60075917 +0000 UTC m=+538.899480049" lastFinishedPulling="2026-05-21 16:20:36.160861905 +0000 UTC m=+541.459582799" observedRunningTime="2026-05-21 16:20:37.207438431 +0000 UTC m=+542.506159535" watchObservedRunningTime="2026-05-21 16:20:37.209989156 +0000 UTC m=+542.508710061" May 21 16:20:37.463133 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:37.463045 2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:37.467681 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:37.467654 2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:38.177111 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:38.177070 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:38.178029 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:38.178011 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq" May 21 16:20:46.074242 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:46.074200 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lvzkq"] May 21 16:20:46.079437 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:46.079413 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lvzkq" May 21 16:20:46.082365 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:46.082343 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-jj2wk\"" May 21 16:20:46.082979 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:46.082959 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 16:20:46.083706 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:46.083689 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 16:20:46.093646 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:46.093620 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lvzkq"] May 21 16:20:46.224113 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:46.224076 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br4pg\" (UniqueName: \"kubernetes.io/projected/f5139d7a-f8c9-4f35-8d3d-f0511839bdec-kube-api-access-br4pg\") pod \"kuadrant-operator-catalog-lvzkq\" (UID: \"f5139d7a-f8c9-4f35-8d3d-f0511839bdec\") " pod="kuadrant-system/kuadrant-operator-catalog-lvzkq" May 21 16:20:46.324654 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:46.324554 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-br4pg\" (UniqueName: \"kubernetes.io/projected/f5139d7a-f8c9-4f35-8d3d-f0511839bdec-kube-api-access-br4pg\") pod \"kuadrant-operator-catalog-lvzkq\" (UID: \"f5139d7a-f8c9-4f35-8d3d-f0511839bdec\") " pod="kuadrant-system/kuadrant-operator-catalog-lvzkq" May 21 16:20:46.334084 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:46.334055 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-br4pg\" (UniqueName: \"kubernetes.io/projected/f5139d7a-f8c9-4f35-8d3d-f0511839bdec-kube-api-access-br4pg\") pod \"kuadrant-operator-catalog-lvzkq\" (UID: \"f5139d7a-f8c9-4f35-8d3d-f0511839bdec\") " pod="kuadrant-system/kuadrant-operator-catalog-lvzkq" May 21 16:20:46.389097 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:46.389063 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lvzkq" May 21 16:20:46.416069 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:46.416038 2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lvzkq"] May 21 16:20:46.521095 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:46.521061 2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lvzkq"] May 21 16:20:46.523351 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:20:46.523315 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5139d7a_f8c9_4f35_8d3d_f0511839bdec.slice/crio-0ad48da7e32504326f4e0f1fb710b05337a90717f9a895c846ebc958048695db WatchSource:0}: Error finding container 0ad48da7e32504326f4e0f1fb710b05337a90717f9a895c846ebc958048695db: Status 404 returned error can't find the container with id 0ad48da7e32504326f4e0f1fb710b05337a90717f9a895c846ebc958048695db May 21 16:20:46.627207 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:46.627127 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qg6zl"] May 21 16:20:46.632096 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:46.632079 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qg6zl" May 21 16:20:46.640924 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:46.640897 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qg6zl"] May 21 16:20:46.727637 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:46.727594 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l58bp\" (UniqueName: \"kubernetes.io/projected/e25d7961-a2f5-4d4a-8384-7f8aeeaa4355-kube-api-access-l58bp\") pod \"kuadrant-operator-catalog-qg6zl\" (UID: \"e25d7961-a2f5-4d4a-8384-7f8aeeaa4355\") " pod="kuadrant-system/kuadrant-operator-catalog-qg6zl" May 21 16:20:46.828727 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:46.828681 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l58bp\" (UniqueName: \"kubernetes.io/projected/e25d7961-a2f5-4d4a-8384-7f8aeeaa4355-kube-api-access-l58bp\") pod \"kuadrant-operator-catalog-qg6zl\" (UID: \"e25d7961-a2f5-4d4a-8384-7f8aeeaa4355\") " pod="kuadrant-system/kuadrant-operator-catalog-qg6zl" May 21 16:20:46.836510 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:46.836483 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l58bp\" (UniqueName: \"kubernetes.io/projected/e25d7961-a2f5-4d4a-8384-7f8aeeaa4355-kube-api-access-l58bp\") pod \"kuadrant-operator-catalog-qg6zl\" (UID: \"e25d7961-a2f5-4d4a-8384-7f8aeeaa4355\") " pod="kuadrant-system/kuadrant-operator-catalog-qg6zl" May 21 16:20:46.941677 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:46.941586 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qg6zl" May 21 16:20:47.088278 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:47.088249 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qg6zl"] May 21 16:20:47.104633 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:20:47.104601 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode25d7961_a2f5_4d4a_8384_7f8aeeaa4355.slice/crio-e870ebce4260ecdefb172877e936150398a2b1d564630bce785f5e9e564c03c0 WatchSource:0}: Error finding container e870ebce4260ecdefb172877e936150398a2b1d564630bce785f5e9e564c03c0: Status 404 returned error can't find the container with id e870ebce4260ecdefb172877e936150398a2b1d564630bce785f5e9e564c03c0 May 21 16:20:47.213014 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:47.212934 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qg6zl" event={"ID":"e25d7961-a2f5-4d4a-8384-7f8aeeaa4355","Type":"ContainerStarted","Data":"e870ebce4260ecdefb172877e936150398a2b1d564630bce785f5e9e564c03c0"} May 21 16:20:47.214048 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:47.214021 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lvzkq" event={"ID":"f5139d7a-f8c9-4f35-8d3d-f0511839bdec","Type":"ContainerStarted","Data":"0ad48da7e32504326f4e0f1fb710b05337a90717f9a895c846ebc958048695db"} May 21 16:20:49.224564 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:49.224522 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lvzkq" event={"ID":"f5139d7a-f8c9-4f35-8d3d-f0511839bdec","Type":"ContainerStarted","Data":"a221a9385e233abc83af6afd2002db87d19e24595f277e2cd790e27d80fbd242"} May 21 16:20:49.225097 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:49.224582 2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-lvzkq" podUID="f5139d7a-f8c9-4f35-8d3d-f0511839bdec" containerName="registry-server" containerID="cri-o://a221a9385e233abc83af6afd2002db87d19e24595f277e2cd790e27d80fbd242" gracePeriod=2 May 21 16:20:49.225959 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:49.225934 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qg6zl" event={"ID":"e25d7961-a2f5-4d4a-8384-7f8aeeaa4355","Type":"ContainerStarted","Data":"fc0ce39f58518462b9c8c055ba5e41ad1ea75e9a25d3370aaa4bcf52704f2a0f"} May 21 16:20:49.240220 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:49.240168 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-lvzkq" podStartSLOduration=1.348141411 podStartE2EDuration="3.240152555s" podCreationTimestamp="2026-05-21 16:20:46 +0000 UTC" firstStartedPulling="2026-05-21 16:20:46.524733084 +0000 UTC m=+551.823453967" lastFinishedPulling="2026-05-21 16:20:48.416744233 +0000 UTC m=+553.715465111" observedRunningTime="2026-05-21 16:20:49.239328583 +0000 UTC m=+554.538049497" watchObservedRunningTime="2026-05-21 16:20:49.240152555 +0000 UTC m=+554.538873455" May 21 16:20:49.254160 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:49.254097 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qg6zl" podStartSLOduration=1.942158621 podStartE2EDuration="3.25407883s" podCreationTimestamp="2026-05-21 16:20:46 +0000 UTC" firstStartedPulling="2026-05-21 16:20:47.105966637 +0000 UTC m=+552.404687519" lastFinishedPulling="2026-05-21 16:20:48.417886846 +0000 UTC m=+553.716607728" observedRunningTime="2026-05-21 16:20:49.253615775 +0000 UTC m=+554.552336676" watchObservedRunningTime="2026-05-21 16:20:49.25407883 +0000 UTC m=+554.552799731" May 21 16:20:49.462974 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:49.462946 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lvzkq" May 21 16:20:49.553790 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:49.553695 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-br4pg\" (UniqueName: \"kubernetes.io/projected/f5139d7a-f8c9-4f35-8d3d-f0511839bdec-kube-api-access-br4pg\") pod \"f5139d7a-f8c9-4f35-8d3d-f0511839bdec\" (UID: \"f5139d7a-f8c9-4f35-8d3d-f0511839bdec\") " May 21 16:20:49.555982 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:49.555941 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5139d7a-f8c9-4f35-8d3d-f0511839bdec-kube-api-access-br4pg" (OuterVolumeSpecName: "kube-api-access-br4pg") pod "f5139d7a-f8c9-4f35-8d3d-f0511839bdec" (UID: "f5139d7a-f8c9-4f35-8d3d-f0511839bdec"). InnerVolumeSpecName "kube-api-access-br4pg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:20:49.654504 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:49.654469 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-br4pg\" (UniqueName: \"kubernetes.io/projected/f5139d7a-f8c9-4f35-8d3d-f0511839bdec-kube-api-access-br4pg\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:20:50.230286 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:50.230248 2547 generic.go:358] "Generic (PLEG): container finished" podID="f5139d7a-f8c9-4f35-8d3d-f0511839bdec" containerID="a221a9385e233abc83af6afd2002db87d19e24595f277e2cd790e27d80fbd242" exitCode=0 May 21 16:20:50.230681 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:50.230309 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lvzkq" May 21 16:20:50.230681 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:50.230328 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lvzkq" event={"ID":"f5139d7a-f8c9-4f35-8d3d-f0511839bdec","Type":"ContainerDied","Data":"a221a9385e233abc83af6afd2002db87d19e24595f277e2cd790e27d80fbd242"} May 21 16:20:50.230681 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:50.230367 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lvzkq" event={"ID":"f5139d7a-f8c9-4f35-8d3d-f0511839bdec","Type":"ContainerDied","Data":"0ad48da7e32504326f4e0f1fb710b05337a90717f9a895c846ebc958048695db"} May 21 16:20:50.230681 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:50.230383 2547 scope.go:117] "RemoveContainer" containerID="a221a9385e233abc83af6afd2002db87d19e24595f277e2cd790e27d80fbd242" May 21 16:20:50.240056 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:50.240037 2547 scope.go:117] "RemoveContainer" containerID="a221a9385e233abc83af6afd2002db87d19e24595f277e2cd790e27d80fbd242" May 21 16:20:50.240298 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:20:50.240276 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a221a9385e233abc83af6afd2002db87d19e24595f277e2cd790e27d80fbd242\": container with ID starting with a221a9385e233abc83af6afd2002db87d19e24595f277e2cd790e27d80fbd242 not found: ID does not exist" containerID="a221a9385e233abc83af6afd2002db87d19e24595f277e2cd790e27d80fbd242" May 21 16:20:50.240352 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:50.240313 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a221a9385e233abc83af6afd2002db87d19e24595f277e2cd790e27d80fbd242"} err="failed to get container status \"a221a9385e233abc83af6afd2002db87d19e24595f277e2cd790e27d80fbd242\": rpc error: code = NotFound desc = could not find container \"a221a9385e233abc83af6afd2002db87d19e24595f277e2cd790e27d80fbd242\": container with ID starting with a221a9385e233abc83af6afd2002db87d19e24595f277e2cd790e27d80fbd242 not found: ID does not exist" May 21 16:20:50.254005 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:50.253981 2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lvzkq"] May 21 16:20:50.260632 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:50.260609 2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lvzkq"] May 21 16:20:51.332686 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:51.332650 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5139d7a-f8c9-4f35-8d3d-f0511839bdec" path="/var/lib/kubelet/pods/f5139d7a-f8c9-4f35-8d3d-f0511839bdec/volumes" May 21 16:20:56.942639 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:56.942597 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-qg6zl" May 21 16:20:56.942639 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:56.942640 2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-qg6zl" May 21 16:20:56.964077 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:56.964046 2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-qg6zl" May 21 16:20:57.278680 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:20:57.278589 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-qg6zl" May 21 16:21:01.466888 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:01.466856 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh"] May 21 16:21:01.467339 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:01.467201 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5139d7a-f8c9-4f35-8d3d-f0511839bdec" containerName="registry-server" May 21 16:21:01.467339 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:01.467215 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5139d7a-f8c9-4f35-8d3d-f0511839bdec" containerName="registry-server" May 21 16:21:01.467339 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:01.467289 2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="f5139d7a-f8c9-4f35-8d3d-f0511839bdec" containerName="registry-server" May 21 16:21:01.470534 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:01.470513 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh" May 21 16:21:01.473812 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:01.473793 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7rvr8\"" May 21 16:21:01.480657 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:01.480632 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh"] May 21 16:21:01.562383 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:01.562344 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9afdd4e4-c7cd-4f56-965c-c8a606fe86a4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh\" (UID: \"9afdd4e4-c7cd-4f56-965c-c8a606fe86a4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh" May 21 16:21:01.562383 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:01.562385 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9afdd4e4-c7cd-4f56-965c-c8a606fe86a4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh\" (UID: \"9afdd4e4-c7cd-4f56-965c-c8a606fe86a4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh" May 21 16:21:01.562586 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:01.562467 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqkrn\" (UniqueName: \"kubernetes.io/projected/9afdd4e4-c7cd-4f56-965c-c8a606fe86a4-kube-api-access-lqkrn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh\" (UID: \"9afdd4e4-c7cd-4f56-965c-c8a606fe86a4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh" May 21 16:21:01.663386 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:01.663346 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9afdd4e4-c7cd-4f56-965c-c8a606fe86a4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh\" (UID: \"9afdd4e4-c7cd-4f56-965c-c8a606fe86a4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh" May 21 16:21:01.663570 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:01.663444 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lqkrn\" (UniqueName: \"kubernetes.io/projected/9afdd4e4-c7cd-4f56-965c-c8a606fe86a4-kube-api-access-lqkrn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh\" (UID: \"9afdd4e4-c7cd-4f56-965c-c8a606fe86a4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh" May 21 16:21:01.663570 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:01.663525 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9afdd4e4-c7cd-4f56-965c-c8a606fe86a4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh\" (UID: \"9afdd4e4-c7cd-4f56-965c-c8a606fe86a4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh" May 21 16:21:01.663873 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:01.663843 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9afdd4e4-c7cd-4f56-965c-c8a606fe86a4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh\" (UID: \"9afdd4e4-c7cd-4f56-965c-c8a606fe86a4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh" May 21 16:21:01.664007 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:01.663881 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9afdd4e4-c7cd-4f56-965c-c8a606fe86a4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh\" (UID: \"9afdd4e4-c7cd-4f56-965c-c8a606fe86a4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh" May 21 16:21:01.674444 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:01.674417 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqkrn\" (UniqueName: \"kubernetes.io/projected/9afdd4e4-c7cd-4f56-965c-c8a606fe86a4-kube-api-access-lqkrn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh\" (UID: \"9afdd4e4-c7cd-4f56-965c-c8a606fe86a4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh" May 21 16:21:01.780805 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:01.780710 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh" May 21 16:21:01.914873 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:01.914846 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh"] May 21 16:21:01.917076 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:21:01.917041 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9afdd4e4_c7cd_4f56_965c_c8a606fe86a4.slice/crio-0d5f90f4e094ecad25a402ddea7f1d3bd5165c9600b8fbb0e547ad9822b7a079 WatchSource:0}: Error finding container 0d5f90f4e094ecad25a402ddea7f1d3bd5165c9600b8fbb0e547ad9822b7a079: Status 404 returned error can't find the container with id 0d5f90f4e094ecad25a402ddea7f1d3bd5165c9600b8fbb0e547ad9822b7a079 May 21 16:21:02.063600 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.063518 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4"] May 21 16:21:02.067061 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.067041 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4" May 21 16:21:02.074173 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.074148 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4"] May 21 16:21:02.167632 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.167597 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4phf\" (UniqueName: \"kubernetes.io/projected/d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6-kube-api-access-z4phf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4\" (UID: \"d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4" May 21 16:21:02.167811 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.167677 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4\" (UID: \"d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4" May 21 16:21:02.167811 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.167704 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4\" (UID: \"d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4" May 21 16:21:02.269025 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.268971 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4\" (UID: \"d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4" May 21 16:21:02.269025 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.269033 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4\" (UID: \"d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4" May 21 16:21:02.269242 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.269086 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z4phf\" (UniqueName: \"kubernetes.io/projected/d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6-kube-api-access-z4phf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4\" (UID: \"d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4" May 21 16:21:02.269458 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.269438 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4\" (UID: \"d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4" May 21 16:21:02.269494 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.269440 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4\" (UID: \"d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4" May 21 16:21:02.275098 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.275069 2547 generic.go:358] "Generic (PLEG): container finished" podID="9afdd4e4-c7cd-4f56-965c-c8a606fe86a4" containerID="af9958ced359f6355ffcfd88c572b07e0f8049b0b34fc8c116047b324dcdd988" exitCode=0 May 21 16:21:02.275261 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.275132 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh" event={"ID":"9afdd4e4-c7cd-4f56-965c-c8a606fe86a4","Type":"ContainerDied","Data":"af9958ced359f6355ffcfd88c572b07e0f8049b0b34fc8c116047b324dcdd988"} May 21 16:21:02.275261 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.275153 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh" event={"ID":"9afdd4e4-c7cd-4f56-965c-c8a606fe86a4","Type":"ContainerStarted","Data":"0d5f90f4e094ecad25a402ddea7f1d3bd5165c9600b8fbb0e547ad9822b7a079"} May 21 16:21:02.279255 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.279228 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4phf\" (UniqueName: \"kubernetes.io/projected/d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6-kube-api-access-z4phf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4\" (UID: \"d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4" May 21 16:21:02.384185 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.384140 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4" May 21 16:21:02.483451 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.483418 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf"] May 21 16:21:02.488567 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.488542 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf" May 21 16:21:02.497436 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.497405 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf"] May 21 16:21:02.525885 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.525861 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4"] May 21 16:21:02.527915 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:21:02.527889 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3ff0193_4eee_4bb8_a0f6_ebeb744d80c6.slice/crio-41d7a04e91668f51f189c7bc2c25159880dae1858bff1e6c1f529a58591f300a WatchSource:0}: Error finding container 41d7a04e91668f51f189c7bc2c25159880dae1858bff1e6c1f529a58591f300a: Status 404 returned error can't find the container with id 41d7a04e91668f51f189c7bc2c25159880dae1858bff1e6c1f529a58591f300a May 21 16:21:02.672655 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.672618 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6p6p\" (UniqueName: \"kubernetes.io/projected/f46f1cfa-1eee-402c-a995-2352794e2e14-kube-api-access-k6p6p\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf\" (UID: \"f46f1cfa-1eee-402c-a995-2352794e2e14\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf" May 21 16:21:02.672860 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.672741 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f46f1cfa-1eee-402c-a995-2352794e2e14-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf\" (UID: \"f46f1cfa-1eee-402c-a995-2352794e2e14\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf" May 21 16:21:02.672917 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.672880 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f46f1cfa-1eee-402c-a995-2352794e2e14-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf\" (UID: \"f46f1cfa-1eee-402c-a995-2352794e2e14\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf" May 21 16:21:02.773544 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.773515 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f46f1cfa-1eee-402c-a995-2352794e2e14-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf\" (UID: \"f46f1cfa-1eee-402c-a995-2352794e2e14\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf" May 21 16:21:02.773646 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.773612 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k6p6p\" (UniqueName: \"kubernetes.io/projected/f46f1cfa-1eee-402c-a995-2352794e2e14-kube-api-access-k6p6p\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf\" (UID: \"f46f1cfa-1eee-402c-a995-2352794e2e14\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf" May 21 16:21:02.773707 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.773679 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f46f1cfa-1eee-402c-a995-2352794e2e14-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf\" (UID: \"f46f1cfa-1eee-402c-a995-2352794e2e14\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf" May 21 16:21:02.773894 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.773876 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f46f1cfa-1eee-402c-a995-2352794e2e14-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf\" (UID: \"f46f1cfa-1eee-402c-a995-2352794e2e14\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf" May 21 16:21:02.774093 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.774071 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f46f1cfa-1eee-402c-a995-2352794e2e14-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf\" (UID: \"f46f1cfa-1eee-402c-a995-2352794e2e14\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf" May 21 16:21:02.783339 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.783313 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6p6p\" (UniqueName: \"kubernetes.io/projected/f46f1cfa-1eee-402c-a995-2352794e2e14-kube-api-access-k6p6p\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf\" (UID: \"f46f1cfa-1eee-402c-a995-2352794e2e14\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf" May 21 16:21:02.799662 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.799639 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf" May 21 16:21:02.871370 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.871337 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd"] May 21 16:21:02.874889 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.874863 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd" May 21 16:21:02.882497 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.882472 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd"] May 21 16:21:02.939193 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.939169 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf"] May 21 16:21:02.940722 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:21:02.940698 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf46f1cfa_1eee_402c_a995_2352794e2e14.slice/crio-4717a62618db3034df71179000a5a8802a3f4ca674008e0df59bc5ef7c14955e WatchSource:0}: Error finding container 4717a62618db3034df71179000a5a8802a3f4ca674008e0df59bc5ef7c14955e: Status 404 returned error can't find the container with id 4717a62618db3034df71179000a5a8802a3f4ca674008e0df59bc5ef7c14955e May 21 16:21:02.974866 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.974841 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c36085a-4f67-4175-973d-f0c8ecf6997e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd\" (UID: \"5c36085a-4f67-4175-973d-f0c8ecf6997e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd" May 21 16:21:02.974983 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.974880 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5wmc\" (UniqueName: \"kubernetes.io/projected/5c36085a-4f67-4175-973d-f0c8ecf6997e-kube-api-access-l5wmc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd\" (UID: \"5c36085a-4f67-4175-973d-f0c8ecf6997e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd" May 21 16:21:02.974983 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:02.974958 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c36085a-4f67-4175-973d-f0c8ecf6997e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd\" (UID: \"5c36085a-4f67-4175-973d-f0c8ecf6997e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd" May 21 16:21:03.076353 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:03.076320 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c36085a-4f67-4175-973d-f0c8ecf6997e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd\" (UID: \"5c36085a-4f67-4175-973d-f0c8ecf6997e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd" May 21 16:21:03.076526 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:03.076367 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5wmc\" (UniqueName: \"kubernetes.io/projected/5c36085a-4f67-4175-973d-f0c8ecf6997e-kube-api-access-l5wmc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd\" (UID: \"5c36085a-4f67-4175-973d-f0c8ecf6997e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd" May 21 16:21:03.076526 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:03.076418 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c36085a-4f67-4175-973d-f0c8ecf6997e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd\" (UID: \"5c36085a-4f67-4175-973d-f0c8ecf6997e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd" May 21 16:21:03.076673 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:03.076652 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c36085a-4f67-4175-973d-f0c8ecf6997e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd\" (UID: \"5c36085a-4f67-4175-973d-f0c8ecf6997e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd" May 21 16:21:03.076725 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:03.076700 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c36085a-4f67-4175-973d-f0c8ecf6997e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd\" (UID: \"5c36085a-4f67-4175-973d-f0c8ecf6997e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd" May 21 16:21:03.085254 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:03.085233 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5wmc\" (UniqueName: \"kubernetes.io/projected/5c36085a-4f67-4175-973d-f0c8ecf6997e-kube-api-access-l5wmc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd\" (UID: \"5c36085a-4f67-4175-973d-f0c8ecf6997e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd" May 21 16:21:03.203474 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:03.203379 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd" May 21 16:21:03.281192 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:03.281157 2547 generic.go:358] "Generic (PLEG): container finished" podID="9afdd4e4-c7cd-4f56-965c-c8a606fe86a4" containerID="36b9f856d5d34a720045fc0dee7a74f37e61a6261454c1e20e74795fb0122433" exitCode=0 May 21 16:21:03.281371 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:03.281230 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh" event={"ID":"9afdd4e4-c7cd-4f56-965c-c8a606fe86a4","Type":"ContainerDied","Data":"36b9f856d5d34a720045fc0dee7a74f37e61a6261454c1e20e74795fb0122433"} May 21 16:21:03.282685 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:03.282663 2547 generic.go:358] "Generic (PLEG): container finished" podID="f46f1cfa-1eee-402c-a995-2352794e2e14" containerID="c18029b16150ed708f9b1b6bcc05c45236e7398d7377f889fdeab1b56f664d14" exitCode=0 May 21 16:21:03.282842 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:03.282742 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf" event={"ID":"f46f1cfa-1eee-402c-a995-2352794e2e14","Type":"ContainerDied","Data":"c18029b16150ed708f9b1b6bcc05c45236e7398d7377f889fdeab1b56f664d14"} May 21 16:21:03.282842 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:03.282768 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf" event={"ID":"f46f1cfa-1eee-402c-a995-2352794e2e14","Type":"ContainerStarted","Data":"4717a62618db3034df71179000a5a8802a3f4ca674008e0df59bc5ef7c14955e"} May 21 16:21:03.289603 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:03.289457 2547 generic.go:358] "Generic (PLEG): container finished" podID="d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6" containerID="251ee7c5720857762e99007b2c88c8c40d00dffebe00ee4f6d08cbef8f42660d" exitCode=0 May 21 16:21:03.289678 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:03.289598 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4" event={"ID":"d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6","Type":"ContainerDied","Data":"251ee7c5720857762e99007b2c88c8c40d00dffebe00ee4f6d08cbef8f42660d"} May 21 16:21:03.289678 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:03.289629 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4" event={"ID":"d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6","Type":"ContainerStarted","Data":"41d7a04e91668f51f189c7bc2c25159880dae1858bff1e6c1f529a58591f300a"} May 21 16:21:03.353959 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:03.353930 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd"] May 21 16:21:03.355417 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:21:03.355390 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c36085a_4f67_4175_973d_f0c8ecf6997e.slice/crio-51821b01b08797f3d88a270cef62053633e63004b1343e287704efa8e224fda3 WatchSource:0}: Error finding container 51821b01b08797f3d88a270cef62053633e63004b1343e287704efa8e224fda3: Status 404 returned error can't find the container with id 51821b01b08797f3d88a270cef62053633e63004b1343e287704efa8e224fda3 May 21 16:21:04.298917 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:04.298798 2547 generic.go:358] "Generic (PLEG): container finished" podID="9afdd4e4-c7cd-4f56-965c-c8a606fe86a4" containerID="c2e7c0459c82f7d68e143b59f9e4e184740d424021dc62e5637e257f9a73efc5" exitCode=0 May 21 16:21:04.299293 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:04.298936 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh" event={"ID":"9afdd4e4-c7cd-4f56-965c-c8a606fe86a4","Type":"ContainerDied","Data":"c2e7c0459c82f7d68e143b59f9e4e184740d424021dc62e5637e257f9a73efc5"} May 21 16:21:04.300868 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:04.300845 2547 generic.go:358] "Generic (PLEG): container finished" podID="f46f1cfa-1eee-402c-a995-2352794e2e14" containerID="eae6d95cc9a83feffcc61d820e72ebccb4b22fc203ef71d940a88b31db256b60" exitCode=0 May 21 16:21:04.301002 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:04.300921 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf" event={"ID":"f46f1cfa-1eee-402c-a995-2352794e2e14","Type":"ContainerDied","Data":"eae6d95cc9a83feffcc61d820e72ebccb4b22fc203ef71d940a88b31db256b60"} May 21 16:21:04.302744 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:04.302625 2547 generic.go:358] "Generic (PLEG): container finished" podID="d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6" containerID="15e83ff9fdc02b3fc9924e33cea1e4e74add652005effa240da77c3616f3b0d3" exitCode=0 May 21 16:21:04.302744 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:04.302706 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4" event={"ID":"d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6","Type":"ContainerDied","Data":"15e83ff9fdc02b3fc9924e33cea1e4e74add652005effa240da77c3616f3b0d3"} May 21 16:21:04.304220 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:04.304108 2547 generic.go:358] "Generic (PLEG): container finished" podID="5c36085a-4f67-4175-973d-f0c8ecf6997e" containerID="42c25dd745bea7bb090a558ec63062e1d0687e9aa830172f315a29fbcb91436c" exitCode=0 May 21 16:21:04.304220 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:04.304154 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd" event={"ID":"5c36085a-4f67-4175-973d-f0c8ecf6997e","Type":"ContainerDied","Data":"42c25dd745bea7bb090a558ec63062e1d0687e9aa830172f315a29fbcb91436c"} May 21 16:21:04.304220 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:04.304174 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd" event={"ID":"5c36085a-4f67-4175-973d-f0c8ecf6997e","Type":"ContainerStarted","Data":"51821b01b08797f3d88a270cef62053633e63004b1343e287704efa8e224fda3"} May 21 16:21:05.310213 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:05.310115 2547 generic.go:358] "Generic (PLEG): container finished" podID="f46f1cfa-1eee-402c-a995-2352794e2e14" containerID="7de8a5cd398d121fe019a7cf414ad279e606451b2e77de0e96fa02edd4d95dd1" exitCode=0 May 21 16:21:05.310213 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:05.310200 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf" event={"ID":"f46f1cfa-1eee-402c-a995-2352794e2e14","Type":"ContainerDied","Data":"7de8a5cd398d121fe019a7cf414ad279e606451b2e77de0e96fa02edd4d95dd1"} May 21 16:21:05.312001 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:05.311975 2547 generic.go:358] "Generic (PLEG): container finished" podID="d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6" containerID="877cea830a330f07bd11d674d4bec86990adfe300bb15e18d5fad597af00271d" exitCode=0 May 21 16:21:05.312132 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:05.312008 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4" event={"ID":"d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6","Type":"ContainerDied","Data":"877cea830a330f07bd11d674d4bec86990adfe300bb15e18d5fad597af00271d"} May 21 16:21:05.313566 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:05.313545 2547 generic.go:358] "Generic (PLEG): container finished" podID="5c36085a-4f67-4175-973d-f0c8ecf6997e" containerID="b456ebf9a5e978c6b1aab91e45ea28ce55b0a5c201717ba40812240e5a0b8ec4" exitCode=0 May 21 16:21:05.313683 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:05.313627 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd" event={"ID":"5c36085a-4f67-4175-973d-f0c8ecf6997e","Type":"ContainerDied","Data":"b456ebf9a5e978c6b1aab91e45ea28ce55b0a5c201717ba40812240e5a0b8ec4"} May 21 16:21:05.457568 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:05.457541 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh" May 21 16:21:05.506660 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:05.506628 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9afdd4e4-c7cd-4f56-965c-c8a606fe86a4-bundle\") pod \"9afdd4e4-c7cd-4f56-965c-c8a606fe86a4\" (UID: \"9afdd4e4-c7cd-4f56-965c-c8a606fe86a4\") " May 21 16:21:05.506869 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:05.506687 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqkrn\" (UniqueName: \"kubernetes.io/projected/9afdd4e4-c7cd-4f56-965c-c8a606fe86a4-kube-api-access-lqkrn\") pod \"9afdd4e4-c7cd-4f56-965c-c8a606fe86a4\" (UID: \"9afdd4e4-c7cd-4f56-965c-c8a606fe86a4\") " May 21 16:21:05.506869 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:05.506746 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9afdd4e4-c7cd-4f56-965c-c8a606fe86a4-util\") pod \"9afdd4e4-c7cd-4f56-965c-c8a606fe86a4\" (UID: \"9afdd4e4-c7cd-4f56-965c-c8a606fe86a4\") " May 21 16:21:05.507213 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:05.507185 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9afdd4e4-c7cd-4f56-965c-c8a606fe86a4-bundle" (OuterVolumeSpecName: "bundle") pod "9afdd4e4-c7cd-4f56-965c-c8a606fe86a4" (UID: "9afdd4e4-c7cd-4f56-965c-c8a606fe86a4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:21:05.508881 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:05.508852 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9afdd4e4-c7cd-4f56-965c-c8a606fe86a4-kube-api-access-lqkrn" (OuterVolumeSpecName: "kube-api-access-lqkrn") pod "9afdd4e4-c7cd-4f56-965c-c8a606fe86a4" (UID: "9afdd4e4-c7cd-4f56-965c-c8a606fe86a4"). InnerVolumeSpecName "kube-api-access-lqkrn". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:21:05.512264 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:05.512238 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9afdd4e4-c7cd-4f56-965c-c8a606fe86a4-util" (OuterVolumeSpecName: "util") pod "9afdd4e4-c7cd-4f56-965c-c8a606fe86a4" (UID: "9afdd4e4-c7cd-4f56-965c-c8a606fe86a4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:21:05.608251 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:05.608204 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqkrn\" (UniqueName: \"kubernetes.io/projected/9afdd4e4-c7cd-4f56-965c-c8a606fe86a4-kube-api-access-lqkrn\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:21:05.608251 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:05.608244 2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9afdd4e4-c7cd-4f56-965c-c8a606fe86a4-util\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:21:05.608251 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:05.608256 2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9afdd4e4-c7cd-4f56-965c-c8a606fe86a4-bundle\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:21:06.319480 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:06.319440 2547 generic.go:358] "Generic (PLEG): container finished" podID="5c36085a-4f67-4175-973d-f0c8ecf6997e" containerID="3c16d5347d9c6556215f57f8ac7f8e36b541e34bd9845aa015cb2e8c7efcdd23" exitCode=0 May 21 16:21:06.319914 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:06.319528 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd" event={"ID":"5c36085a-4f67-4175-973d-f0c8ecf6997e","Type":"ContainerDied","Data":"3c16d5347d9c6556215f57f8ac7f8e36b541e34bd9845aa015cb2e8c7efcdd23"} May 21 16:21:06.321175 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:06.321147 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh" event={"ID":"9afdd4e4-c7cd-4f56-965c-c8a606fe86a4","Type":"ContainerDied","Data":"0d5f90f4e094ecad25a402ddea7f1d3bd5165c9600b8fbb0e547ad9822b7a079"} May 21 16:21:06.321292 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:06.321179 2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d5f90f4e094ecad25a402ddea7f1d3bd5165c9600b8fbb0e547ad9822b7a079" May 21 16:21:06.321292 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:06.321209 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh" May 21 16:21:06.461267 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:06.461243 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4" May 21 16:21:06.479042 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:06.479021 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf" May 21 16:21:06.515662 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:06.515628 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4phf\" (UniqueName: \"kubernetes.io/projected/d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6-kube-api-access-z4phf\") pod \"d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6\" (UID: \"d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6\") " May 21 16:21:06.515961 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:06.515676 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f46f1cfa-1eee-402c-a995-2352794e2e14-util\") pod \"f46f1cfa-1eee-402c-a995-2352794e2e14\" (UID: \"f46f1cfa-1eee-402c-a995-2352794e2e14\") " May 21 16:21:06.515961 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:06.515741 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6-util\") pod \"d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6\" (UID: \"d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6\") " May 21 16:21:06.515961 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:06.515783 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f46f1cfa-1eee-402c-a995-2352794e2e14-bundle\") pod \"f46f1cfa-1eee-402c-a995-2352794e2e14\" (UID: \"f46f1cfa-1eee-402c-a995-2352794e2e14\") " May 21 16:21:06.515961 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:06.515811 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6-bundle\") pod \"d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6\" (UID: \"d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6\") " May 21 16:21:06.515961 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:06.515851 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6p6p\" (UniqueName: \"kubernetes.io/projected/f46f1cfa-1eee-402c-a995-2352794e2e14-kube-api-access-k6p6p\") pod \"f46f1cfa-1eee-402c-a995-2352794e2e14\" (UID: \"f46f1cfa-1eee-402c-a995-2352794e2e14\") " May 21 16:21:06.516431 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:06.516393 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f46f1cfa-1eee-402c-a995-2352794e2e14-bundle" (OuterVolumeSpecName: "bundle") pod "f46f1cfa-1eee-402c-a995-2352794e2e14" (UID: "f46f1cfa-1eee-402c-a995-2352794e2e14"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:21:06.516843 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:06.516799 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6-bundle" (OuterVolumeSpecName: "bundle") pod "d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6" (UID: "d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:21:06.518313 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:06.518284 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f46f1cfa-1eee-402c-a995-2352794e2e14-kube-api-access-k6p6p" (OuterVolumeSpecName: "kube-api-access-k6p6p") pod "f46f1cfa-1eee-402c-a995-2352794e2e14" (UID: "f46f1cfa-1eee-402c-a995-2352794e2e14"). InnerVolumeSpecName "kube-api-access-k6p6p". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:21:06.518740 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:06.518721 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6-kube-api-access-z4phf" (OuterVolumeSpecName: "kube-api-access-z4phf") pod "d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6" (UID: "d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6"). InnerVolumeSpecName "kube-api-access-z4phf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:21:06.522300 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:06.522257 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f46f1cfa-1eee-402c-a995-2352794e2e14-util" (OuterVolumeSpecName: "util") pod "f46f1cfa-1eee-402c-a995-2352794e2e14" (UID: "f46f1cfa-1eee-402c-a995-2352794e2e14"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:21:06.522369 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:06.522248 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6-util" (OuterVolumeSpecName: "util") pod "d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6" (UID: "d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:21:06.617381 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:06.617343 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4phf\" (UniqueName: \"kubernetes.io/projected/d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6-kube-api-access-z4phf\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:21:06.617381 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:06.617378 2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f46f1cfa-1eee-402c-a995-2352794e2e14-util\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:21:06.617588 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:06.617394 2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6-util\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:21:06.617588 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:06.617406 2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f46f1cfa-1eee-402c-a995-2352794e2e14-bundle\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:21:06.617588 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:06.617417 2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6-bundle\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:21:06.617588 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:06.617429 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6p6p\" (UniqueName: \"kubernetes.io/projected/f46f1cfa-1eee-402c-a995-2352794e2e14-kube-api-access-k6p6p\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:21:07.326909 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:07.326873 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf" event={"ID":"f46f1cfa-1eee-402c-a995-2352794e2e14","Type":"ContainerDied","Data":"4717a62618db3034df71179000a5a8802a3f4ca674008e0df59bc5ef7c14955e"} May 21 16:21:07.326909 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:07.326898 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf" May 21 16:21:07.326909 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:07.326910 2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4717a62618db3034df71179000a5a8802a3f4ca674008e0df59bc5ef7c14955e" May 21 16:21:07.328863 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:07.328841 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4" May 21 16:21:07.334015 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:07.333990 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4" event={"ID":"d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6","Type":"ContainerDied","Data":"41d7a04e91668f51f189c7bc2c25159880dae1858bff1e6c1f529a58591f300a"} May 21 16:21:07.334152 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:07.334020 2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41d7a04e91668f51f189c7bc2c25159880dae1858bff1e6c1f529a58591f300a" May 21 16:21:07.457588 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:07.457565 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd" May 21 16:21:07.524494 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:07.524458 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5wmc\" (UniqueName: \"kubernetes.io/projected/5c36085a-4f67-4175-973d-f0c8ecf6997e-kube-api-access-l5wmc\") pod \"5c36085a-4f67-4175-973d-f0c8ecf6997e\" (UID: \"5c36085a-4f67-4175-973d-f0c8ecf6997e\") " May 21 16:21:07.524636 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:07.524600 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c36085a-4f67-4175-973d-f0c8ecf6997e-util\") pod \"5c36085a-4f67-4175-973d-f0c8ecf6997e\" (UID: \"5c36085a-4f67-4175-973d-f0c8ecf6997e\") " May 21 16:21:07.524712 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:07.524631 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c36085a-4f67-4175-973d-f0c8ecf6997e-bundle\") pod \"5c36085a-4f67-4175-973d-f0c8ecf6997e\" (UID: \"5c36085a-4f67-4175-973d-f0c8ecf6997e\") " May 21 16:21:07.525223 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:07.525188 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c36085a-4f67-4175-973d-f0c8ecf6997e-bundle" (OuterVolumeSpecName: "bundle") pod "5c36085a-4f67-4175-973d-f0c8ecf6997e" (UID: "5c36085a-4f67-4175-973d-f0c8ecf6997e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:21:07.526616 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:07.526585 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c36085a-4f67-4175-973d-f0c8ecf6997e-kube-api-access-l5wmc" (OuterVolumeSpecName: "kube-api-access-l5wmc") pod "5c36085a-4f67-4175-973d-f0c8ecf6997e" (UID: "5c36085a-4f67-4175-973d-f0c8ecf6997e"). InnerVolumeSpecName "kube-api-access-l5wmc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:21:07.529876 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:07.529841 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c36085a-4f67-4175-973d-f0c8ecf6997e-util" (OuterVolumeSpecName: "util") pod "5c36085a-4f67-4175-973d-f0c8ecf6997e" (UID: "5c36085a-4f67-4175-973d-f0c8ecf6997e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 16:21:07.625626 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:07.625531 2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c36085a-4f67-4175-973d-f0c8ecf6997e-util\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:21:07.625626 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:07.625572 2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c36085a-4f67-4175-973d-f0c8ecf6997e-bundle\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:21:07.625626 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:07.625584 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5wmc\" (UniqueName: \"kubernetes.io/projected/5c36085a-4f67-4175-973d-f0c8ecf6997e-kube-api-access-l5wmc\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:21:08.340694 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:08.340665 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd" May 21 16:21:08.341095 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:08.340665 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd" event={"ID":"5c36085a-4f67-4175-973d-f0c8ecf6997e","Type":"ContainerDied","Data":"51821b01b08797f3d88a270cef62053633e63004b1343e287704efa8e224fda3"} May 21 16:21:08.341095 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:08.340782 2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51821b01b08797f3d88a270cef62053633e63004b1343e287704efa8e224fda3" May 21 16:21:17.291948 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.291914 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7kn9"] May 21 16:21:17.292393 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292289 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9afdd4e4-c7cd-4f56-965c-c8a606fe86a4" containerName="util" May 21 16:21:17.292393 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292310 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="9afdd4e4-c7cd-4f56-965c-c8a606fe86a4" containerName="util" May 21 16:21:17.292393 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292328 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9afdd4e4-c7cd-4f56-965c-c8a606fe86a4" containerName="pull" May 21 16:21:17.292393 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292333 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="9afdd4e4-c7cd-4f56-965c-c8a606fe86a4" containerName="pull" May 21 16:21:17.292393 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292340 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6" containerName="pull" May 21 16:21:17.292393 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292345 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6" containerName="pull" May 21 16:21:17.292393 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292354 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6" containerName="util" May 21 16:21:17.292393 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292359 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6" containerName="util" May 21 16:21:17.292393 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292366 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c36085a-4f67-4175-973d-f0c8ecf6997e" containerName="pull" May 21 16:21:17.292393 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292370 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c36085a-4f67-4175-973d-f0c8ecf6997e" containerName="pull" May 21 16:21:17.292393 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292378 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c36085a-4f67-4175-973d-f0c8ecf6997e" containerName="util" May 21 16:21:17.292393 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292383 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c36085a-4f67-4175-973d-f0c8ecf6997e" containerName="util" May 21 16:21:17.292393 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292389 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f46f1cfa-1eee-402c-a995-2352794e2e14" containerName="pull" May 21 16:21:17.292393 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292393 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="f46f1cfa-1eee-402c-a995-2352794e2e14" containerName="pull" May 21 16:21:17.292393 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292402 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6" containerName="extract" May 21 16:21:17.292905 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292406 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6" containerName="extract" May 21 16:21:17.292905 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292412 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c36085a-4f67-4175-973d-f0c8ecf6997e" containerName="extract" May 21 16:21:17.292905 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292417 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c36085a-4f67-4175-973d-f0c8ecf6997e" containerName="extract" May 21 16:21:17.292905 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292425 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9afdd4e4-c7cd-4f56-965c-c8a606fe86a4" containerName="extract" May 21 16:21:17.292905 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292430 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="9afdd4e4-c7cd-4f56-965c-c8a606fe86a4" containerName="extract" May 21 16:21:17.292905 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292437 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f46f1cfa-1eee-402c-a995-2352794e2e14" containerName="extract" May 21 16:21:17.292905 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292442 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="f46f1cfa-1eee-402c-a995-2352794e2e14" containerName="extract" May 21 16:21:17.292905 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292450 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f46f1cfa-1eee-402c-a995-2352794e2e14" containerName="util" May 21 16:21:17.292905 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292455 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="f46f1cfa-1eee-402c-a995-2352794e2e14" containerName="util" May 21 16:21:17.292905 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292520 2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="5c36085a-4f67-4175-973d-f0c8ecf6997e" containerName="extract" May 21 16:21:17.292905 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292528 2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6" containerName="extract" May 21 16:21:17.292905 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292536 2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="9afdd4e4-c7cd-4f56-965c-c8a606fe86a4" containerName="extract" May 21 16:21:17.292905 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.292542 2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="f46f1cfa-1eee-402c-a995-2352794e2e14" containerName="extract" May 21 16:21:17.299897 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.299878 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7kn9" May 21 16:21:17.304465 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.304442 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 21 16:21:17.304594 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.304504 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-8klxq\"" May 21 16:21:17.309199 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.309168 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7kn9"] May 21 16:21:17.406964 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.406930 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkc6s\" (UniqueName: \"kubernetes.io/projected/5d0ec449-c0f9-446c-971f-1e8be70f614b-kube-api-access-xkc6s\") pod \"dns-operator-controller-manager-648d5c98bc-l7kn9\" (UID: \"5d0ec449-c0f9-446c-971f-1e8be70f614b\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7kn9" May 21 16:21:17.508457 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.508405 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xkc6s\" (UniqueName: \"kubernetes.io/projected/5d0ec449-c0f9-446c-971f-1e8be70f614b-kube-api-access-xkc6s\") pod \"dns-operator-controller-manager-648d5c98bc-l7kn9\" (UID: \"5d0ec449-c0f9-446c-971f-1e8be70f614b\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7kn9" May 21 16:21:17.523790 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.523766 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkc6s\" (UniqueName: \"kubernetes.io/projected/5d0ec449-c0f9-446c-971f-1e8be70f614b-kube-api-access-xkc6s\") pod \"dns-operator-controller-manager-648d5c98bc-l7kn9\" (UID: \"5d0ec449-c0f9-446c-971f-1e8be70f614b\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7kn9" May 21 16:21:17.611260 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.611227 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7kn9" May 21 16:21:17.750665 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:17.750639 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7kn9"] May 21 16:21:17.751935 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:21:17.751910 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d0ec449_c0f9_446c_971f_1e8be70f614b.slice/crio-549e69575d07955b66998243606787b011b271976b8a97d7f479385debcad97b WatchSource:0}: Error finding container 549e69575d07955b66998243606787b011b271976b8a97d7f479385debcad97b: Status 404 returned error can't find the container with id 549e69575d07955b66998243606787b011b271976b8a97d7f479385debcad97b May 21 16:21:18.385128 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:18.385082 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7kn9" event={"ID":"5d0ec449-c0f9-446c-971f-1e8be70f614b","Type":"ContainerStarted","Data":"549e69575d07955b66998243606787b011b271976b8a97d7f479385debcad97b"} May 21 16:21:20.393225 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:20.393188 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7kn9" event={"ID":"5d0ec449-c0f9-446c-971f-1e8be70f614b","Type":"ContainerStarted","Data":"793ae940c1b476d09788413828df137a3a9d6a8f56199ffa2249aa79ef129f7f"} May 21 16:21:20.393600 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:20.393293 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7kn9" May 21 16:21:20.416943 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:20.416878 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7kn9" podStartSLOduration=1.810418866 podStartE2EDuration="3.41685882s" podCreationTimestamp="2026-05-21 16:21:17 +0000 UTC" firstStartedPulling="2026-05-21 16:21:17.753759138 +0000 UTC m=+583.052480016" lastFinishedPulling="2026-05-21 16:21:19.360199077 +0000 UTC m=+584.658919970" observedRunningTime="2026-05-21 16:21:20.414922969 +0000 UTC m=+585.713643882" watchObservedRunningTime="2026-05-21 16:21:20.41685882 +0000 UTC m=+585.715579721" May 21 16:21:22.505972 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:22.505940 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-md6bw"] May 21 16:21:22.510484 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:22.510464 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-md6bw" May 21 16:21:22.514135 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:22.514113 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-bvjf9\"" May 21 16:21:22.526717 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:22.526693 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-md6bw"] May 21 16:21:22.556950 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:22.556919 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2sjf\" (UniqueName: \"kubernetes.io/projected/12c5e9b7-37e4-4117-a05b-edf68ab073e5-kube-api-access-q2sjf\") pod \"authorino-operator-657f44b778-md6bw\" (UID: \"12c5e9b7-37e4-4117-a05b-edf68ab073e5\") " pod="kuadrant-system/authorino-operator-657f44b778-md6bw" May 21 16:21:22.658066 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:22.658031 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q2sjf\" (UniqueName: \"kubernetes.io/projected/12c5e9b7-37e4-4117-a05b-edf68ab073e5-kube-api-access-q2sjf\") pod \"authorino-operator-657f44b778-md6bw\" (UID: \"12c5e9b7-37e4-4117-a05b-edf68ab073e5\") " pod="kuadrant-system/authorino-operator-657f44b778-md6bw" May 21 16:21:22.684957 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:22.684927 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2sjf\" (UniqueName: \"kubernetes.io/projected/12c5e9b7-37e4-4117-a05b-edf68ab073e5-kube-api-access-q2sjf\") pod \"authorino-operator-657f44b778-md6bw\" (UID: \"12c5e9b7-37e4-4117-a05b-edf68ab073e5\") " pod="kuadrant-system/authorino-operator-657f44b778-md6bw" May 21 16:21:22.820865 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:22.820733 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-md6bw" May 21 16:21:22.955702 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:22.955676 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-md6bw"] May 21 16:21:22.957609 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:21:22.957571 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12c5e9b7_37e4_4117_a05b_edf68ab073e5.slice/crio-1af1f63b946616604691fca670a726f4be20d544adb7f9c65cbb27c84354e6d0 WatchSource:0}: Error finding container 1af1f63b946616604691fca670a726f4be20d544adb7f9c65cbb27c84354e6d0: Status 404 returned error can't find the container with id 1af1f63b946616604691fca670a726f4be20d544adb7f9c65cbb27c84354e6d0 May 21 16:21:23.407968 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:23.407926 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-md6bw" event={"ID":"12c5e9b7-37e4-4117-a05b-edf68ab073e5","Type":"ContainerStarted","Data":"1af1f63b946616604691fca670a726f4be20d544adb7f9c65cbb27c84354e6d0"} May 21 16:21:25.417673 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:25.417636 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-md6bw" event={"ID":"12c5e9b7-37e4-4117-a05b-edf68ab073e5","Type":"ContainerStarted","Data":"ea6069fe71771cb70648bf9f7b23f0557f3c0ac1694d80c93d9c7602cfaa5a73"} May 21 16:21:25.418100 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:25.417685 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-md6bw" May 21 16:21:25.438752 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:25.438692 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-md6bw" podStartSLOduration=1.435381365 podStartE2EDuration="3.438675188s" podCreationTimestamp="2026-05-21 16:21:22 +0000 UTC" firstStartedPulling="2026-05-21 16:21:22.959674275 +0000 UTC m=+588.258395156" lastFinishedPulling="2026-05-21 16:21:24.962968101 +0000 UTC m=+590.261688979" observedRunningTime="2026-05-21 16:21:25.438637668 +0000 UTC m=+590.737358568" watchObservedRunningTime="2026-05-21 16:21:25.438675188 +0000 UTC m=+590.737396088" May 21 16:21:31.401574 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:31.401541 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7kn9" May 21 16:21:32.490252 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:32.490221 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg9mg"] May 21 16:21:32.493800 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:32.493782 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg9mg" May 21 16:21:32.497661 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:32.497638 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-vrhmd\"" May 21 16:21:32.510354 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:32.510330 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg9mg"] May 21 16:21:32.662097 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:32.662062 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r898h\" (UniqueName: \"kubernetes.io/projected/1cb65d73-f4e9-4f5a-97a9-8628c8866914-kube-api-access-r898h\") pod \"limitador-operator-controller-manager-85c4996f8c-hg9mg\" (UID: \"1cb65d73-f4e9-4f5a-97a9-8628c8866914\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg9mg" May 21 16:21:32.762886 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:32.762753 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r898h\" (UniqueName: \"kubernetes.io/projected/1cb65d73-f4e9-4f5a-97a9-8628c8866914-kube-api-access-r898h\") pod \"limitador-operator-controller-manager-85c4996f8c-hg9mg\" (UID: \"1cb65d73-f4e9-4f5a-97a9-8628c8866914\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg9mg" May 21 16:21:32.773986 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:32.773954 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r898h\" (UniqueName: \"kubernetes.io/projected/1cb65d73-f4e9-4f5a-97a9-8628c8866914-kube-api-access-r898h\") pod \"limitador-operator-controller-manager-85c4996f8c-hg9mg\" (UID: \"1cb65d73-f4e9-4f5a-97a9-8628c8866914\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg9mg" May 21 16:21:32.803666 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:32.803634 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg9mg" May 21 16:21:32.939570 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:32.939543 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg9mg"] May 21 16:21:32.941868 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:21:32.941836 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cb65d73_f4e9_4f5a_97a9_8628c8866914.slice/crio-172f4a21aed040e7fa6ff7414112e073d9074fc1b598e8d632ee6523be04fb5d WatchSource:0}: Error finding container 172f4a21aed040e7fa6ff7414112e073d9074fc1b598e8d632ee6523be04fb5d: Status 404 returned error can't find the container with id 172f4a21aed040e7fa6ff7414112e073d9074fc1b598e8d632ee6523be04fb5d May 21 16:21:33.448035 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:33.447986 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg9mg" event={"ID":"1cb65d73-f4e9-4f5a-97a9-8628c8866914","Type":"ContainerStarted","Data":"172f4a21aed040e7fa6ff7414112e073d9074fc1b598e8d632ee6523be04fb5d"} May 21 16:21:34.453633 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:34.453601 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg9mg" event={"ID":"1cb65d73-f4e9-4f5a-97a9-8628c8866914","Type":"ContainerStarted","Data":"175176c68701ed0dfe29b7cb7d28cbbe9859056a2070b2b2f17a51010f15c493"} May 21 16:21:34.454032 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:34.453657 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg9mg" May 21 16:21:34.470875 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:34.470809 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg9mg" podStartSLOduration=1.100033986 podStartE2EDuration="2.470794857s" podCreationTimestamp="2026-05-21 16:21:32 +0000 UTC" firstStartedPulling="2026-05-21 16:21:32.943663774 +0000 UTC m=+598.242384656" lastFinishedPulling="2026-05-21 16:21:34.314424645 +0000 UTC m=+599.613145527" observedRunningTime="2026-05-21 16:21:34.469582628 +0000 UTC m=+599.768303526" watchObservedRunningTime="2026-05-21 16:21:34.470794857 +0000 UTC m=+599.769515828" May 21 16:21:35.245057 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:35.245030 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/ovn-acl-logging/0.log" May 21 16:21:35.248109 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:35.248086 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/ovn-acl-logging/0.log" May 21 16:21:36.423998 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:36.423905 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-md6bw" May 21 16:21:45.459435 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:45.459407 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg9mg" May 21 16:21:46.738411 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:46.738373 2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg9mg"] May 21 16:21:46.738771 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:46.738620 2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg9mg" podUID="1cb65d73-f4e9-4f5a-97a9-8628c8866914" containerName="manager" containerID="cri-o://175176c68701ed0dfe29b7cb7d28cbbe9859056a2070b2b2f17a51010f15c493" gracePeriod=2 May 21 16:21:46.752220 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:46.751332 2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg9mg"] May 21 16:21:46.764475 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:46.764449 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f8frp"] May 21 16:21:46.764870 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:46.764851 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cb65d73-f4e9-4f5a-97a9-8628c8866914" containerName="manager" May 21 16:21:46.764917 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:46.764870 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cb65d73-f4e9-4f5a-97a9-8628c8866914" containerName="manager" May 21 16:21:46.764956 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:46.764949 2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="1cb65d73-f4e9-4f5a-97a9-8628c8866914" containerName="manager" May 21 16:21:46.768068 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:46.768049 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f8frp" May 21 16:21:46.771156 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:46.771123 2547 status_manager.go:895] "Failed to get status for pod" podUID="1cb65d73-f4e9-4f5a-97a9-8628c8866914" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg9mg" err="pods \"limitador-operator-controller-manager-85c4996f8c-hg9mg\" is forbidden: User \"system:node:ip-10-0-139-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-146.ec2.internal' and this object" May 21 16:21:46.782358 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:46.782330 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f8frp"] May 21 16:21:46.791671 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:46.791644 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfvgg\" (UniqueName: \"kubernetes.io/projected/afd9c194-a4ec-406a-8b68-8b9a58727817-kube-api-access-mfvgg\") pod \"limitador-operator-controller-manager-85c4996f8c-f8frp\" (UID: \"afd9c194-a4ec-406a-8b68-8b9a58727817\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f8frp" May 21 16:21:46.892780 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:46.892731 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mfvgg\" (UniqueName: \"kubernetes.io/projected/afd9c194-a4ec-406a-8b68-8b9a58727817-kube-api-access-mfvgg\") pod \"limitador-operator-controller-manager-85c4996f8c-f8frp\" (UID: \"afd9c194-a4ec-406a-8b68-8b9a58727817\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f8frp" May 21 16:21:46.904761 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:46.904732 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfvgg\" (UniqueName: \"kubernetes.io/projected/afd9c194-a4ec-406a-8b68-8b9a58727817-kube-api-access-mfvgg\") pod \"limitador-operator-controller-manager-85c4996f8c-f8frp\" (UID: \"afd9c194-a4ec-406a-8b68-8b9a58727817\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f8frp" May 21 16:21:46.996444 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:46.996377 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg9mg" May 21 16:21:46.999354 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:46.999320 2547 status_manager.go:895] "Failed to get status for pod" podUID="1cb65d73-f4e9-4f5a-97a9-8628c8866914" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg9mg" err="pods \"limitador-operator-controller-manager-85c4996f8c-hg9mg\" is forbidden: User \"system:node:ip-10-0-139-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-146.ec2.internal' and this object" May 21 16:21:47.094669 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:47.094638 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r898h\" (UniqueName: \"kubernetes.io/projected/1cb65d73-f4e9-4f5a-97a9-8628c8866914-kube-api-access-r898h\") pod \"1cb65d73-f4e9-4f5a-97a9-8628c8866914\" (UID: \"1cb65d73-f4e9-4f5a-97a9-8628c8866914\") " May 21 16:21:47.096719 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:47.096693 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cb65d73-f4e9-4f5a-97a9-8628c8866914-kube-api-access-r898h" (OuterVolumeSpecName: "kube-api-access-r898h") pod "1cb65d73-f4e9-4f5a-97a9-8628c8866914" (UID: "1cb65d73-f4e9-4f5a-97a9-8628c8866914"). InnerVolumeSpecName "kube-api-access-r898h". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:21:47.106871 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:47.106849 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f8frp" May 21 16:21:47.195583 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:47.195542 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r898h\" (UniqueName: \"kubernetes.io/projected/1cb65d73-f4e9-4f5a-97a9-8628c8866914-kube-api-access-r898h\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:21:47.251676 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:47.251648 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f8frp"] May 21 16:21:47.253761 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:21:47.253736 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafd9c194_a4ec_406a_8b68_8b9a58727817.slice/crio-4becb28b759278b1b76f95671f9127524e72e76038fe027175ecefc6d13830ff WatchSource:0}: Error finding container 4becb28b759278b1b76f95671f9127524e72e76038fe027175ecefc6d13830ff: Status 404 returned error can't find the container with id 4becb28b759278b1b76f95671f9127524e72e76038fe027175ecefc6d13830ff May 21 16:21:47.333254 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:47.333225 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cb65d73-f4e9-4f5a-97a9-8628c8866914" path="/var/lib/kubelet/pods/1cb65d73-f4e9-4f5a-97a9-8628c8866914/volumes" May 21 16:21:47.502304 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:47.502201 2547 generic.go:358] "Generic (PLEG): container finished" podID="1cb65d73-f4e9-4f5a-97a9-8628c8866914" containerID="175176c68701ed0dfe29b7cb7d28cbbe9859056a2070b2b2f17a51010f15c493" exitCode=0 May 21 16:21:47.502304 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:47.502268 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg9mg" May 21 16:21:47.502525 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:47.502304 2547 scope.go:117] "RemoveContainer" containerID="175176c68701ed0dfe29b7cb7d28cbbe9859056a2070b2b2f17a51010f15c493" May 21 16:21:47.504067 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:47.504039 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f8frp" event={"ID":"afd9c194-a4ec-406a-8b68-8b9a58727817","Type":"ContainerStarted","Data":"88e4c18890c411bb5731460fe67758a8f3da0817390729be2631fefe2337d692"} May 21 16:21:47.504193 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:47.504075 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f8frp" event={"ID":"afd9c194-a4ec-406a-8b68-8b9a58727817","Type":"ContainerStarted","Data":"4becb28b759278b1b76f95671f9127524e72e76038fe027175ecefc6d13830ff"} May 21 16:21:47.504193 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:47.504101 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f8frp" May 21 16:21:47.511447 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:47.511430 2547 scope.go:117] "RemoveContainer" containerID="175176c68701ed0dfe29b7cb7d28cbbe9859056a2070b2b2f17a51010f15c493" May 21 16:21:47.511723 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:21:47.511704 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"175176c68701ed0dfe29b7cb7d28cbbe9859056a2070b2b2f17a51010f15c493\": container with ID starting with 175176c68701ed0dfe29b7cb7d28cbbe9859056a2070b2b2f17a51010f15c493 not found: ID does not exist" containerID="175176c68701ed0dfe29b7cb7d28cbbe9859056a2070b2b2f17a51010f15c493" May 21 16:21:47.511772 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:47.511732 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"175176c68701ed0dfe29b7cb7d28cbbe9859056a2070b2b2f17a51010f15c493"} err="failed to get container status \"175176c68701ed0dfe29b7cb7d28cbbe9859056a2070b2b2f17a51010f15c493\": rpc error: code = NotFound desc = could not find container \"175176c68701ed0dfe29b7cb7d28cbbe9859056a2070b2b2f17a51010f15c493\": container with ID starting with 175176c68701ed0dfe29b7cb7d28cbbe9859056a2070b2b2f17a51010f15c493 not found: ID does not exist" May 21 16:21:47.539407 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:47.539361 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f8frp" podStartSLOduration=1.5393510209999999 podStartE2EDuration="1.539351021s" podCreationTimestamp="2026-05-21 16:21:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:21:47.537030138 +0000 UTC m=+612.835751040" watchObservedRunningTime="2026-05-21 16:21:47.539351021 +0000 UTC m=+612.838071921" May 21 16:21:58.511221 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:21:58.511124 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f8frp" May 21 16:22:15.312063 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.312029 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw"] May 21 16:22:15.315477 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.315458 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.318623 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.318600 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-njxsf\"" May 21 16:22:15.334105 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.334069 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw"] May 21 16:22:15.440747 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.440707 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36052856-a412-44ac-8978-f617d5d19cb5-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.440969 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.440757 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36052856-a412-44ac-8978-f617d5d19cb5-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.440969 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.440909 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36052856-a412-44ac-8978-f617d5d19cb5-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.441092 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.440985 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36052856-a412-44ac-8978-f617d5d19cb5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.441092 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.441013 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjht4\" (UniqueName: \"kubernetes.io/projected/36052856-a412-44ac-8978-f617d5d19cb5-kube-api-access-hjht4\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.441173 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.441148 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36052856-a412-44ac-8978-f617d5d19cb5-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.441226 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.441182 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36052856-a412-44ac-8978-f617d5d19cb5-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.441290 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.441234 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36052856-a412-44ac-8978-f617d5d19cb5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.441344 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.441318 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36052856-a412-44ac-8978-f617d5d19cb5-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.542600 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.542560 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36052856-a412-44ac-8978-f617d5d19cb5-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.542849 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.542625 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36052856-a412-44ac-8978-f617d5d19cb5-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.542849 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.542640 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36052856-a412-44ac-8978-f617d5d19cb5-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.542849 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.542658 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36052856-a412-44ac-8978-f617d5d19cb5-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.542849 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.542684 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36052856-a412-44ac-8978-f617d5d19cb5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.542849 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.542700 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hjht4\" (UniqueName: \"kubernetes.io/projected/36052856-a412-44ac-8978-f617d5d19cb5-kube-api-access-hjht4\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.542849 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.542748 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36052856-a412-44ac-8978-f617d5d19cb5-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.542849 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.542771 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36052856-a412-44ac-8978-f617d5d19cb5-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.542849 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.542802 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36052856-a412-44ac-8978-f617d5d19cb5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.543247 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.543064 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36052856-a412-44ac-8978-f617d5d19cb5-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.543319 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.543299 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36052856-a412-44ac-8978-f617d5d19cb5-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.543382 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.543331 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36052856-a412-44ac-8978-f617d5d19cb5-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.543459 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.543437 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36052856-a412-44ac-8978-f617d5d19cb5-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.543562 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.543542 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36052856-a412-44ac-8978-f617d5d19cb5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.545157 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.545132 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36052856-a412-44ac-8978-f617d5d19cb5-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.545313 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.545298 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36052856-a412-44ac-8978-f617d5d19cb5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.551335 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.551314 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36052856-a412-44ac-8978-f617d5d19cb5-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.551443 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.551359 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjht4\" (UniqueName: \"kubernetes.io/projected/36052856-a412-44ac-8978-f617d5d19cb5-kube-api-access-hjht4\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-hv8pw\" (UID: \"36052856-a412-44ac-8978-f617d5d19cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.628296 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.628259 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:15.767476 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.767437 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw"] May 21 16:22:15.770786 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:22:15.770742 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36052856_a412_44ac_8978_f617d5d19cb5.slice/crio-9a49201b10c1fa0f31afa434520c0a0617917bfb6b758ea9cf9655a62266a5e6 WatchSource:0}: Error finding container 9a49201b10c1fa0f31afa434520c0a0617917bfb6b758ea9cf9655a62266a5e6: Status 404 returned error can't find the container with id 9a49201b10c1fa0f31afa434520c0a0617917bfb6b758ea9cf9655a62266a5e6 May 21 16:22:15.772968 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.772931 2547 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} May 21 16:22:15.773049 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.772999 2547 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} May 21 16:22:15.773049 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:15.773028 2547 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} May 21 16:22:16.621024 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:16.620976 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" event={"ID":"36052856-a412-44ac-8978-f617d5d19cb5","Type":"ContainerStarted","Data":"ae7a793c99de28a38cb7b5c661acff3c42a477ef550bd27a197186369e00d6c1"} May 21 16:22:16.621024 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:16.621025 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" event={"ID":"36052856-a412-44ac-8978-f617d5d19cb5","Type":"ContainerStarted","Data":"9a49201b10c1fa0f31afa434520c0a0617917bfb6b758ea9cf9655a62266a5e6"} May 21 16:22:16.629141 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:16.629111 2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:16.634179 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:16.634153 2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:16.643905 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:16.643860 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" podStartSLOduration=1.643846963 podStartE2EDuration="1.643846963s" podCreationTimestamp="2026-05-21 16:22:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:22:16.642511554 +0000 UTC m=+641.941232455" watchObservedRunningTime="2026-05-21 16:22:16.643846963 +0000 UTC m=+641.942567887" May 21 16:22:17.625453 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:17.625421 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:17.626531 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:17.626513 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-hv8pw" May 21 16:22:28.814930 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:28.814882 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-d7hzl"] May 21 16:22:28.818533 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:28.818509 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-d7hzl" May 21 16:22:28.821226 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:28.821204 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hl8fd\"" May 21 16:22:28.828633 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:28.828611 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-d7hzl"] May 21 16:22:28.967331 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:28.967299 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4x6r\" (UniqueName: \"kubernetes.io/projected/a6fc1c16-b8c8-4136-882d-cb9038a23837-kube-api-access-g4x6r\") pod \"authorino-f99f4b5cd-d7hzl\" (UID: \"a6fc1c16-b8c8-4136-882d-cb9038a23837\") " pod="kuadrant-system/authorino-f99f4b5cd-d7hzl" May 21 16:22:28.990588 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:28.990549 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-zvhl5"] May 21 16:22:28.994125 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:28.994107 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-zvhl5" May 21 16:22:28.999919 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:28.999889 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-zvhl5"] May 21 16:22:29.068932 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:29.068848 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g4x6r\" (UniqueName: \"kubernetes.io/projected/a6fc1c16-b8c8-4136-882d-cb9038a23837-kube-api-access-g4x6r\") pod \"authorino-f99f4b5cd-d7hzl\" (UID: \"a6fc1c16-b8c8-4136-882d-cb9038a23837\") " pod="kuadrant-system/authorino-f99f4b5cd-d7hzl" May 21 16:22:29.077433 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:29.077394 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4x6r\" (UniqueName: \"kubernetes.io/projected/a6fc1c16-b8c8-4136-882d-cb9038a23837-kube-api-access-g4x6r\") pod \"authorino-f99f4b5cd-d7hzl\" (UID: \"a6fc1c16-b8c8-4136-882d-cb9038a23837\") " pod="kuadrant-system/authorino-f99f4b5cd-d7hzl" May 21 16:22:29.129298 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:29.129253 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-d7hzl" May 21 16:22:29.170164 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:29.170129 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgdxp\" (UniqueName: \"kubernetes.io/projected/fa3a9ad9-561f-4e50-a1fd-e1f1f9fc1c94-kube-api-access-kgdxp\") pod \"authorino-7498df8756-zvhl5\" (UID: \"fa3a9ad9-561f-4e50-a1fd-e1f1f9fc1c94\") " pod="kuadrant-system/authorino-7498df8756-zvhl5" May 21 16:22:29.261785 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:29.261750 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-d7hzl"] May 21 16:22:29.263347 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:22:29.263314 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6fc1c16_b8c8_4136_882d_cb9038a23837.slice/crio-b336f61218ac7f89154ba837e80ed36660a79cb4a3cf49d94b22e96d411846c5 WatchSource:0}: Error finding container b336f61218ac7f89154ba837e80ed36660a79cb4a3cf49d94b22e96d411846c5: Status 404 returned error can't find the container with id b336f61218ac7f89154ba837e80ed36660a79cb4a3cf49d94b22e96d411846c5 May 21 16:22:29.270689 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:29.270668 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kgdxp\" (UniqueName: \"kubernetes.io/projected/fa3a9ad9-561f-4e50-a1fd-e1f1f9fc1c94-kube-api-access-kgdxp\") pod \"authorino-7498df8756-zvhl5\" (UID: \"fa3a9ad9-561f-4e50-a1fd-e1f1f9fc1c94\") " pod="kuadrant-system/authorino-7498df8756-zvhl5" May 21 16:22:29.278213 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:29.278185 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgdxp\" (UniqueName: \"kubernetes.io/projected/fa3a9ad9-561f-4e50-a1fd-e1f1f9fc1c94-kube-api-access-kgdxp\") pod \"authorino-7498df8756-zvhl5\" (UID: \"fa3a9ad9-561f-4e50-a1fd-e1f1f9fc1c94\") " pod="kuadrant-system/authorino-7498df8756-zvhl5" May 21 16:22:29.304985 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:29.304946 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-zvhl5" May 21 16:22:29.437325 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:29.437297 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-zvhl5"] May 21 16:22:29.439330 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:22:29.439307 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa3a9ad9_561f_4e50_a1fd_e1f1f9fc1c94.slice/crio-cce9a6f23ca77d7db6f7b3ef0ba471fb0e6eec1b85fa29c2b027615b4834c3f5 WatchSource:0}: Error finding container cce9a6f23ca77d7db6f7b3ef0ba471fb0e6eec1b85fa29c2b027615b4834c3f5: Status 404 returned error can't find the container with id cce9a6f23ca77d7db6f7b3ef0ba471fb0e6eec1b85fa29c2b027615b4834c3f5 May 21 16:22:29.679226 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:29.679119 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-d7hzl" event={"ID":"a6fc1c16-b8c8-4136-882d-cb9038a23837","Type":"ContainerStarted","Data":"b336f61218ac7f89154ba837e80ed36660a79cb4a3cf49d94b22e96d411846c5"} May 21 16:22:29.680472 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:29.680441 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-zvhl5" event={"ID":"fa3a9ad9-561f-4e50-a1fd-e1f1f9fc1c94","Type":"ContainerStarted","Data":"cce9a6f23ca77d7db6f7b3ef0ba471fb0e6eec1b85fa29c2b027615b4834c3f5"} May 21 16:22:32.696683 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:32.696640 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-zvhl5" event={"ID":"fa3a9ad9-561f-4e50-a1fd-e1f1f9fc1c94","Type":"ContainerStarted","Data":"c195d5424d928ed711f45cf15dd982020abca3984daaf33f0b59db12a032d937"} May 21 16:22:32.698328 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:32.698298 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-d7hzl" event={"ID":"a6fc1c16-b8c8-4136-882d-cb9038a23837","Type":"ContainerStarted","Data":"e0d7a909d439aaf62c689a8c16a3db1c3582071cf9680c3218c57d79e37ecfdf"} May 21 16:22:32.713352 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:32.713304 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-zvhl5" podStartSLOduration=1.644372145 podStartE2EDuration="4.713289797s" podCreationTimestamp="2026-05-21 16:22:28 +0000 UTC" firstStartedPulling="2026-05-21 16:22:29.440707466 +0000 UTC m=+654.739428348" lastFinishedPulling="2026-05-21 16:22:32.509625122 +0000 UTC m=+657.808346000" observedRunningTime="2026-05-21 16:22:32.712340232 +0000 UTC m=+658.011061129" watchObservedRunningTime="2026-05-21 16:22:32.713289797 +0000 UTC m=+658.012010697" May 21 16:22:32.728247 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:32.728192 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-d7hzl" podStartSLOduration=1.494910319 podStartE2EDuration="4.728175087s" podCreationTimestamp="2026-05-21 16:22:28 +0000 UTC" firstStartedPulling="2026-05-21 16:22:29.264573086 +0000 UTC m=+654.563293967" lastFinishedPulling="2026-05-21 16:22:32.497837847 +0000 UTC m=+657.796558735" observedRunningTime="2026-05-21 16:22:32.726889365 +0000 UTC m=+658.025610266" watchObservedRunningTime="2026-05-21 16:22:32.728175087 +0000 UTC m=+658.026895987" May 21 16:22:32.750191 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:32.750103 2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-d7hzl"] May 21 16:22:34.705489 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:34.705450 2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-d7hzl" podUID="a6fc1c16-b8c8-4136-882d-cb9038a23837" containerName="authorino" containerID="cri-o://e0d7a909d439aaf62c689a8c16a3db1c3582071cf9680c3218c57d79e37ecfdf" gracePeriod=30 May 21 16:22:34.950970 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:34.950943 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-d7hzl" May 21 16:22:35.030107 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:35.030004 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4x6r\" (UniqueName: \"kubernetes.io/projected/a6fc1c16-b8c8-4136-882d-cb9038a23837-kube-api-access-g4x6r\") pod \"a6fc1c16-b8c8-4136-882d-cb9038a23837\" (UID: \"a6fc1c16-b8c8-4136-882d-cb9038a23837\") " May 21 16:22:35.032099 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:35.032066 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6fc1c16-b8c8-4136-882d-cb9038a23837-kube-api-access-g4x6r" (OuterVolumeSpecName: "kube-api-access-g4x6r") pod "a6fc1c16-b8c8-4136-882d-cb9038a23837" (UID: "a6fc1c16-b8c8-4136-882d-cb9038a23837"). InnerVolumeSpecName "kube-api-access-g4x6r". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:22:35.130867 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:35.130790 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4x6r\" (UniqueName: \"kubernetes.io/projected/a6fc1c16-b8c8-4136-882d-cb9038a23837-kube-api-access-g4x6r\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:22:35.710229 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:35.710135 2547 generic.go:358] "Generic (PLEG): container finished" podID="a6fc1c16-b8c8-4136-882d-cb9038a23837" containerID="e0d7a909d439aaf62c689a8c16a3db1c3582071cf9680c3218c57d79e37ecfdf" exitCode=0 May 21 16:22:35.710229 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:35.710195 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-d7hzl" May 21 16:22:35.710706 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:35.710222 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-d7hzl" event={"ID":"a6fc1c16-b8c8-4136-882d-cb9038a23837","Type":"ContainerDied","Data":"e0d7a909d439aaf62c689a8c16a3db1c3582071cf9680c3218c57d79e37ecfdf"} May 21 16:22:35.710706 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:35.710261 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-d7hzl" event={"ID":"a6fc1c16-b8c8-4136-882d-cb9038a23837","Type":"ContainerDied","Data":"b336f61218ac7f89154ba837e80ed36660a79cb4a3cf49d94b22e96d411846c5"} May 21 16:22:35.710706 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:35.710280 2547 scope.go:117] "RemoveContainer" containerID="e0d7a909d439aaf62c689a8c16a3db1c3582071cf9680c3218c57d79e37ecfdf" May 21 16:22:35.718810 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:35.718792 2547 scope.go:117] "RemoveContainer" containerID="e0d7a909d439aaf62c689a8c16a3db1c3582071cf9680c3218c57d79e37ecfdf" May 21 16:22:35.719113 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:22:35.719091 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0d7a909d439aaf62c689a8c16a3db1c3582071cf9680c3218c57d79e37ecfdf\": container with ID starting with e0d7a909d439aaf62c689a8c16a3db1c3582071cf9680c3218c57d79e37ecfdf not found: ID does not exist" containerID="e0d7a909d439aaf62c689a8c16a3db1c3582071cf9680c3218c57d79e37ecfdf" May 21 16:22:35.719186 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:35.719124 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0d7a909d439aaf62c689a8c16a3db1c3582071cf9680c3218c57d79e37ecfdf"} err="failed to get container status \"e0d7a909d439aaf62c689a8c16a3db1c3582071cf9680c3218c57d79e37ecfdf\": rpc error: code = NotFound desc = could not find container \"e0d7a909d439aaf62c689a8c16a3db1c3582071cf9680c3218c57d79e37ecfdf\": container with ID starting with e0d7a909d439aaf62c689a8c16a3db1c3582071cf9680c3218c57d79e37ecfdf not found: ID does not exist" May 21 16:22:35.729645 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:35.729605 2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-d7hzl"] May 21 16:22:35.732694 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:35.732672 2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-d7hzl"] May 21 16:22:37.333434 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:37.333397 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6fc1c16-b8c8-4136-882d-cb9038a23837" path="/var/lib/kubelet/pods/a6fc1c16-b8c8-4136-882d-cb9038a23837/volumes" May 21 16:22:58.867079 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:58.867041 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-lq2zt"] May 21 16:22:58.867543 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:58.867439 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6fc1c16-b8c8-4136-882d-cb9038a23837" containerName="authorino" May 21 16:22:58.867543 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:58.867455 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6fc1c16-b8c8-4136-882d-cb9038a23837" containerName="authorino" May 21 16:22:58.867543 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:58.867521 2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6fc1c16-b8c8-4136-882d-cb9038a23837" containerName="authorino" May 21 16:22:58.870583 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:58.870567 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-lq2zt" May 21 16:22:58.884296 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:58.884261 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-lq2zt"] May 21 16:22:58.950297 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:58.950261 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzfrp\" (UniqueName: \"kubernetes.io/projected/1e2104aa-9a15-46ca-ab71-07b9a1f879f3-kube-api-access-tzfrp\") pod \"authorino-8b475cf9f-lq2zt\" (UID: \"1e2104aa-9a15-46ca-ab71-07b9a1f879f3\") " pod="kuadrant-system/authorino-8b475cf9f-lq2zt" May 21 16:22:59.050952 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.050914 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzfrp\" (UniqueName: \"kubernetes.io/projected/1e2104aa-9a15-46ca-ab71-07b9a1f879f3-kube-api-access-tzfrp\") pod \"authorino-8b475cf9f-lq2zt\" (UID: \"1e2104aa-9a15-46ca-ab71-07b9a1f879f3\") " pod="kuadrant-system/authorino-8b475cf9f-lq2zt" May 21 16:22:59.060738 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.060711 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzfrp\" (UniqueName: \"kubernetes.io/projected/1e2104aa-9a15-46ca-ab71-07b9a1f879f3-kube-api-access-tzfrp\") pod \"authorino-8b475cf9f-lq2zt\" (UID: \"1e2104aa-9a15-46ca-ab71-07b9a1f879f3\") " pod="kuadrant-system/authorino-8b475cf9f-lq2zt" May 21 16:22:59.101205 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.101160 2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-lq2zt"] May 21 16:22:59.101487 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.101470 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-lq2zt" May 21 16:22:59.134364 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.134289 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-798fb9bbd9-rpw4n"] May 21 16:22:59.138908 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.138884 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-798fb9bbd9-rpw4n" May 21 16:22:59.151362 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.151333 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-798fb9bbd9-rpw4n"] May 21 16:22:59.247538 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.247510 2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-lq2zt"] May 21 16:22:59.249255 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:22:59.249221 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e2104aa_9a15_46ca_ab71_07b9a1f879f3.slice/crio-c74af75a1463e1829a5c0a4fbc2d3b67ffffc6d3ee9c9afe3a8e0ba791b01639 WatchSource:0}: Error finding container c74af75a1463e1829a5c0a4fbc2d3b67ffffc6d3ee9c9afe3a8e0ba791b01639: Status 404 returned error can't find the container with id c74af75a1463e1829a5c0a4fbc2d3b67ffffc6d3ee9c9afe3a8e0ba791b01639 May 21 16:22:59.250676 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.250657 2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 16:22:59.252673 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.252647 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs84s\" (UniqueName: \"kubernetes.io/projected/a9c64371-a586-4ccd-9ea3-0db294b923ac-kube-api-access-cs84s\") pod \"authorino-798fb9bbd9-rpw4n\" (UID: \"a9c64371-a586-4ccd-9ea3-0db294b923ac\") " pod="kuadrant-system/authorino-798fb9bbd9-rpw4n" May 21 16:22:59.318453 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.318416 2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-798fb9bbd9-rpw4n"] May 21 16:22:59.318721 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:22:59.318702 2547 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-cs84s], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-798fb9bbd9-rpw4n" podUID="a9c64371-a586-4ccd-9ea3-0db294b923ac" May 21 16:22:59.352857 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.352805 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5bf5db78d5-hq5z9"] May 21 16:22:59.353222 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.353199 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cs84s\" (UniqueName: \"kubernetes.io/projected/a9c64371-a586-4ccd-9ea3-0db294b923ac-kube-api-access-cs84s\") pod \"authorino-798fb9bbd9-rpw4n\" (UID: \"a9c64371-a586-4ccd-9ea3-0db294b923ac\") " pod="kuadrant-system/authorino-798fb9bbd9-rpw4n" May 21 16:22:59.356339 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.356323 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bf5db78d5-hq5z9" May 21 16:22:59.359312 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.359286 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 21 16:22:59.366240 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.366217 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bf5db78d5-hq5z9"] May 21 16:22:59.367713 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.367690 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs84s\" (UniqueName: \"kubernetes.io/projected/a9c64371-a586-4ccd-9ea3-0db294b923ac-kube-api-access-cs84s\") pod \"authorino-798fb9bbd9-rpw4n\" (UID: \"a9c64371-a586-4ccd-9ea3-0db294b923ac\") " pod="kuadrant-system/authorino-798fb9bbd9-rpw4n" May 21 16:22:59.453984 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.453894 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/031921ae-36d2-421b-951e-6e91fe146803-tls-cert\") pod \"authorino-5bf5db78d5-hq5z9\" (UID: \"031921ae-36d2-421b-951e-6e91fe146803\") " pod="kuadrant-system/authorino-5bf5db78d5-hq5z9" May 21 16:22:59.454148 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.454017 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xbb9\" (UniqueName: \"kubernetes.io/projected/031921ae-36d2-421b-951e-6e91fe146803-kube-api-access-2xbb9\") pod \"authorino-5bf5db78d5-hq5z9\" (UID: \"031921ae-36d2-421b-951e-6e91fe146803\") " pod="kuadrant-system/authorino-5bf5db78d5-hq5z9" May 21 16:22:59.554811 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.554785 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2xbb9\" (UniqueName: \"kubernetes.io/projected/031921ae-36d2-421b-951e-6e91fe146803-kube-api-access-2xbb9\") pod \"authorino-5bf5db78d5-hq5z9\" (UID: \"031921ae-36d2-421b-951e-6e91fe146803\") " pod="kuadrant-system/authorino-5bf5db78d5-hq5z9" May 21 16:22:59.554930 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.554918 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/031921ae-36d2-421b-951e-6e91fe146803-tls-cert\") pod \"authorino-5bf5db78d5-hq5z9\" (UID: \"031921ae-36d2-421b-951e-6e91fe146803\") " pod="kuadrant-system/authorino-5bf5db78d5-hq5z9" May 21 16:22:59.557340 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.557320 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/031921ae-36d2-421b-951e-6e91fe146803-tls-cert\") pod \"authorino-5bf5db78d5-hq5z9\" (UID: \"031921ae-36d2-421b-951e-6e91fe146803\") " pod="kuadrant-system/authorino-5bf5db78d5-hq5z9" May 21 16:22:59.565581 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.565558 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xbb9\" (UniqueName: \"kubernetes.io/projected/031921ae-36d2-421b-951e-6e91fe146803-kube-api-access-2xbb9\") pod \"authorino-5bf5db78d5-hq5z9\" (UID: \"031921ae-36d2-421b-951e-6e91fe146803\") " pod="kuadrant-system/authorino-5bf5db78d5-hq5z9" May 21 16:22:59.667134 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.667096 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bf5db78d5-hq5z9" May 21 16:22:59.805112 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.805080 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-798fb9bbd9-rpw4n" May 21 16:22:59.805112 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.805091 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-lq2zt" event={"ID":"1e2104aa-9a15-46ca-ab71-07b9a1f879f3","Type":"ContainerStarted","Data":"a91eb3bc5691680ae1d6e950b12c55fa14b67b2d65f829f39537e8d311992918"} May 21 16:22:59.805347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.805122 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-lq2zt" event={"ID":"1e2104aa-9a15-46ca-ab71-07b9a1f879f3","Type":"ContainerStarted","Data":"c74af75a1463e1829a5c0a4fbc2d3b67ffffc6d3ee9c9afe3a8e0ba791b01639"} May 21 16:22:59.805347 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.805147 2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-lq2zt" podUID="1e2104aa-9a15-46ca-ab71-07b9a1f879f3" containerName="authorino" containerID="cri-o://a91eb3bc5691680ae1d6e950b12c55fa14b67b2d65f829f39537e8d311992918" gracePeriod=30 May 21 16:22:59.810406 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.810387 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-798fb9bbd9-rpw4n" May 21 16:22:59.822874 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.822846 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bf5db78d5-hq5z9"] May 21 16:22:59.846077 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.846019 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-lq2zt" podStartSLOduration=1.542397649 podStartE2EDuration="1.846002734s" podCreationTimestamp="2026-05-21 16:22:58 +0000 UTC" firstStartedPulling="2026-05-21 16:22:59.250858202 +0000 UTC m=+684.549579095" lastFinishedPulling="2026-05-21 16:22:59.554463303 +0000 UTC m=+684.853184180" observedRunningTime="2026-05-21 16:22:59.844201168 +0000 UTC m=+685.142922069" watchObservedRunningTime="2026-05-21 16:22:59.846002734 +0000 UTC m=+685.144723631" May 21 16:22:59.871777 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:22:59.871741 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod031921ae_36d2_421b_951e_6e91fe146803.slice/crio-7a92bf418caaec9e9c21718a35bd30ee22a5095326601ba7491d2e8c79a8a597 WatchSource:0}: Error finding container 7a92bf418caaec9e9c21718a35bd30ee22a5095326601ba7491d2e8c79a8a597: Status 404 returned error can't find the container with id 7a92bf418caaec9e9c21718a35bd30ee22a5095326601ba7491d2e8c79a8a597 May 21 16:22:59.959532 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.959497 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs84s\" (UniqueName: \"kubernetes.io/projected/a9c64371-a586-4ccd-9ea3-0db294b923ac-kube-api-access-cs84s\") pod \"a9c64371-a586-4ccd-9ea3-0db294b923ac\" (UID: \"a9c64371-a586-4ccd-9ea3-0db294b923ac\") " May 21 16:22:59.961781 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:22:59.961742 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9c64371-a586-4ccd-9ea3-0db294b923ac-kube-api-access-cs84s" (OuterVolumeSpecName: "kube-api-access-cs84s") pod "a9c64371-a586-4ccd-9ea3-0db294b923ac" (UID: "a9c64371-a586-4ccd-9ea3-0db294b923ac"). InnerVolumeSpecName "kube-api-access-cs84s". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:23:00.037651 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:00.037628 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-lq2zt" May 21 16:23:00.060332 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:00.060305 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs84s\" (UniqueName: \"kubernetes.io/projected/a9c64371-a586-4ccd-9ea3-0db294b923ac-kube-api-access-cs84s\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:23:00.160636 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:00.160599 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzfrp\" (UniqueName: \"kubernetes.io/projected/1e2104aa-9a15-46ca-ab71-07b9a1f879f3-kube-api-access-tzfrp\") pod \"1e2104aa-9a15-46ca-ab71-07b9a1f879f3\" (UID: \"1e2104aa-9a15-46ca-ab71-07b9a1f879f3\") " May 21 16:23:00.162709 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:00.162670 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e2104aa-9a15-46ca-ab71-07b9a1f879f3-kube-api-access-tzfrp" (OuterVolumeSpecName: "kube-api-access-tzfrp") pod "1e2104aa-9a15-46ca-ab71-07b9a1f879f3" (UID: "1e2104aa-9a15-46ca-ab71-07b9a1f879f3"). InnerVolumeSpecName "kube-api-access-tzfrp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:23:00.262413 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:00.262324 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzfrp\" (UniqueName: \"kubernetes.io/projected/1e2104aa-9a15-46ca-ab71-07b9a1f879f3-kube-api-access-tzfrp\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:23:00.809951 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:00.809915 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bf5db78d5-hq5z9" event={"ID":"031921ae-36d2-421b-951e-6e91fe146803","Type":"ContainerStarted","Data":"e5956467ed97c6b7fc9dc83ede4afb0736f54c1feb2cac22fd2888938dc57392"} May 21 16:23:00.809951 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:00.809954 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bf5db78d5-hq5z9" event={"ID":"031921ae-36d2-421b-951e-6e91fe146803","Type":"ContainerStarted","Data":"7a92bf418caaec9e9c21718a35bd30ee22a5095326601ba7491d2e8c79a8a597"} May 21 16:23:00.811199 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:00.811169 2547 generic.go:358] "Generic (PLEG): container finished" podID="1e2104aa-9a15-46ca-ab71-07b9a1f879f3" containerID="a91eb3bc5691680ae1d6e950b12c55fa14b67b2d65f829f39537e8d311992918" exitCode=0 May 21 16:23:00.811321 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:00.811207 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-lq2zt" May 21 16:23:00.811321 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:00.811241 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-lq2zt" event={"ID":"1e2104aa-9a15-46ca-ab71-07b9a1f879f3","Type":"ContainerDied","Data":"a91eb3bc5691680ae1d6e950b12c55fa14b67b2d65f829f39537e8d311992918"} May 21 16:23:00.811321 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:00.811272 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-lq2zt" event={"ID":"1e2104aa-9a15-46ca-ab71-07b9a1f879f3","Type":"ContainerDied","Data":"c74af75a1463e1829a5c0a4fbc2d3b67ffffc6d3ee9c9afe3a8e0ba791b01639"} May 21 16:23:00.811321 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:00.811287 2547 scope.go:117] "RemoveContainer" containerID="a91eb3bc5691680ae1d6e950b12c55fa14b67b2d65f829f39537e8d311992918" May 21 16:23:00.811606 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:00.811380 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-798fb9bbd9-rpw4n" May 21 16:23:00.821174 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:00.821089 2547 scope.go:117] "RemoveContainer" containerID="a91eb3bc5691680ae1d6e950b12c55fa14b67b2d65f829f39537e8d311992918" May 21 16:23:00.821424 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:23:00.821385 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a91eb3bc5691680ae1d6e950b12c55fa14b67b2d65f829f39537e8d311992918\": container with ID starting with a91eb3bc5691680ae1d6e950b12c55fa14b67b2d65f829f39537e8d311992918 not found: ID does not exist" containerID="a91eb3bc5691680ae1d6e950b12c55fa14b67b2d65f829f39537e8d311992918" May 21 16:23:00.821521 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:00.821423 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91eb3bc5691680ae1d6e950b12c55fa14b67b2d65f829f39537e8d311992918"} err="failed to get container status \"a91eb3bc5691680ae1d6e950b12c55fa14b67b2d65f829f39537e8d311992918\": rpc error: code = NotFound desc = could not find container \"a91eb3bc5691680ae1d6e950b12c55fa14b67b2d65f829f39537e8d311992918\": container with ID starting with a91eb3bc5691680ae1d6e950b12c55fa14b67b2d65f829f39537e8d311992918 not found: ID does not exist" May 21 16:23:00.829024 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:00.828980 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5bf5db78d5-hq5z9" podStartSLOduration=1.387367158 podStartE2EDuration="1.828967626s" podCreationTimestamp="2026-05-21 16:22:59 +0000 UTC" firstStartedPulling="2026-05-21 16:22:59.910159163 +0000 UTC m=+685.208880057" lastFinishedPulling="2026-05-21 16:23:00.351759629 +0000 UTC m=+685.650480525" observedRunningTime="2026-05-21 16:23:00.827739069 +0000 UTC m=+686.126459970" watchObservedRunningTime="2026-05-21 16:23:00.828967626 +0000 UTC m=+686.127688526" May 21 16:23:00.847014 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:00.846981 2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-lq2zt"] May 21 16:23:00.850954 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:00.850926 2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-lq2zt"] May 21 16:23:00.860412 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:00.860385 2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-zvhl5"] May 21 16:23:00.860578 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:00.860559 2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-zvhl5" podUID="fa3a9ad9-561f-4e50-a1fd-e1f1f9fc1c94" containerName="authorino" containerID="cri-o://c195d5424d928ed711f45cf15dd982020abca3984daaf33f0b59db12a032d937" gracePeriod=30 May 21 16:23:00.884667 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:00.884636 2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-798fb9bbd9-rpw4n"] May 21 16:23:00.891515 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:00.891491 2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-798fb9bbd9-rpw4n"] May 21 16:23:01.120909 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:01.120882 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-zvhl5" May 21 16:23:01.273558 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:01.273521 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgdxp\" (UniqueName: \"kubernetes.io/projected/fa3a9ad9-561f-4e50-a1fd-e1f1f9fc1c94-kube-api-access-kgdxp\") pod \"fa3a9ad9-561f-4e50-a1fd-e1f1f9fc1c94\" (UID: \"fa3a9ad9-561f-4e50-a1fd-e1f1f9fc1c94\") " May 21 16:23:01.275587 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:01.275566 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa3a9ad9-561f-4e50-a1fd-e1f1f9fc1c94-kube-api-access-kgdxp" (OuterVolumeSpecName: "kube-api-access-kgdxp") pod "fa3a9ad9-561f-4e50-a1fd-e1f1f9fc1c94" (UID: "fa3a9ad9-561f-4e50-a1fd-e1f1f9fc1c94"). InnerVolumeSpecName "kube-api-access-kgdxp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:23:01.332593 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:01.332557 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e2104aa-9a15-46ca-ab71-07b9a1f879f3" path="/var/lib/kubelet/pods/1e2104aa-9a15-46ca-ab71-07b9a1f879f3/volumes" May 21 16:23:01.332928 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:01.332914 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9c64371-a586-4ccd-9ea3-0db294b923ac" path="/var/lib/kubelet/pods/a9c64371-a586-4ccd-9ea3-0db294b923ac/volumes" May 21 16:23:01.375310 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:01.375277 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgdxp\" (UniqueName: \"kubernetes.io/projected/fa3a9ad9-561f-4e50-a1fd-e1f1f9fc1c94-kube-api-access-kgdxp\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:23:01.817772 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:01.817679 2547 generic.go:358] "Generic (PLEG): container finished" podID="fa3a9ad9-561f-4e50-a1fd-e1f1f9fc1c94" containerID="c195d5424d928ed711f45cf15dd982020abca3984daaf33f0b59db12a032d937" exitCode=0 May 21 16:23:01.817772 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:01.817742 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-zvhl5" May 21 16:23:01.817986 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:01.817772 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-zvhl5" event={"ID":"fa3a9ad9-561f-4e50-a1fd-e1f1f9fc1c94","Type":"ContainerDied","Data":"c195d5424d928ed711f45cf15dd982020abca3984daaf33f0b59db12a032d937"} May 21 16:23:01.817986 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:01.817808 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-zvhl5" event={"ID":"fa3a9ad9-561f-4e50-a1fd-e1f1f9fc1c94","Type":"ContainerDied","Data":"cce9a6f23ca77d7db6f7b3ef0ba471fb0e6eec1b85fa29c2b027615b4834c3f5"} May 21 16:23:01.817986 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:01.817841 2547 scope.go:117] "RemoveContainer" containerID="c195d5424d928ed711f45cf15dd982020abca3984daaf33f0b59db12a032d937" May 21 16:23:01.827721 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:01.827704 2547 scope.go:117] "RemoveContainer" containerID="c195d5424d928ed711f45cf15dd982020abca3984daaf33f0b59db12a032d937" May 21 16:23:01.827988 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:23:01.827965 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c195d5424d928ed711f45cf15dd982020abca3984daaf33f0b59db12a032d937\": container with ID starting with c195d5424d928ed711f45cf15dd982020abca3984daaf33f0b59db12a032d937 not found: ID does not exist" containerID="c195d5424d928ed711f45cf15dd982020abca3984daaf33f0b59db12a032d937" May 21 16:23:01.828066 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:01.827999 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c195d5424d928ed711f45cf15dd982020abca3984daaf33f0b59db12a032d937"} err="failed to get container status \"c195d5424d928ed711f45cf15dd982020abca3984daaf33f0b59db12a032d937\": rpc error: code = NotFound desc = could not find container \"c195d5424d928ed711f45cf15dd982020abca3984daaf33f0b59db12a032d937\": container with ID starting with c195d5424d928ed711f45cf15dd982020abca3984daaf33f0b59db12a032d937 not found: ID does not exist" May 21 16:23:01.855829 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:01.855794 2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-zvhl5"] May 21 16:23:01.864497 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:01.864473 2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-zvhl5"] May 21 16:23:03.332291 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:23:03.332252 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa3a9ad9-561f-4e50-a1fd-e1f1f9fc1c94" path="/var/lib/kubelet/pods/fa3a9ad9-561f-4e50-a1fd-e1f1f9fc1c94/volumes" May 21 16:24:12.264190 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.264157 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq"] May 21 16:24:12.264761 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.264740 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa3a9ad9-561f-4e50-a1fd-e1f1f9fc1c94" containerName="authorino" May 21 16:24:12.264867 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.264764 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa3a9ad9-561f-4e50-a1fd-e1f1f9fc1c94" containerName="authorino" May 21 16:24:12.264867 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.264775 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e2104aa-9a15-46ca-ab71-07b9a1f879f3" containerName="authorino" May 21 16:24:12.264867 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.264783 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e2104aa-9a15-46ca-ab71-07b9a1f879f3" containerName="authorino" May 21 16:24:12.265051 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.264882 2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="fa3a9ad9-561f-4e50-a1fd-e1f1f9fc1c94" containerName="authorino" May 21 16:24:12.265051 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.264898 2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="1e2104aa-9a15-46ca-ab71-07b9a1f879f3" containerName="authorino" May 21 16:24:12.268399 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.268379 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" May 21 16:24:12.271550 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.271530 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 16:24:12.271664 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.271588 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 16:24:12.272719 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.272698 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 21 16:24:12.272801 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.272749 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-h7krh\"" May 21 16:24:12.281165 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.281143 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq"] May 21 16:24:12.325039 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.325010 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f062dc9-50fb-43c8-a084-6e87bd6465ec-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwcq\" (UID: \"2f062dc9-50fb-43c8-a084-6e87bd6465ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" May 21 16:24:12.325212 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.325061 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2f062dc9-50fb-43c8-a084-6e87bd6465ec-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwcq\" (UID: \"2f062dc9-50fb-43c8-a084-6e87bd6465ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" May 21 16:24:12.325212 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.325148 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f062dc9-50fb-43c8-a084-6e87bd6465ec-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwcq\" (UID: \"2f062dc9-50fb-43c8-a084-6e87bd6465ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" May 21 16:24:12.325212 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.325184 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggb2q\" (UniqueName: \"kubernetes.io/projected/2f062dc9-50fb-43c8-a084-6e87bd6465ec-kube-api-access-ggb2q\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwcq\" (UID: \"2f062dc9-50fb-43c8-a084-6e87bd6465ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" May 21 16:24:12.325342 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.325214 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f062dc9-50fb-43c8-a084-6e87bd6465ec-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwcq\" (UID: \"2f062dc9-50fb-43c8-a084-6e87bd6465ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" May 21 16:24:12.325342 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.325279 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f062dc9-50fb-43c8-a084-6e87bd6465ec-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwcq\" (UID: \"2f062dc9-50fb-43c8-a084-6e87bd6465ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" May 21 16:24:12.426662 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.426629 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f062dc9-50fb-43c8-a084-6e87bd6465ec-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwcq\" (UID: \"2f062dc9-50fb-43c8-a084-6e87bd6465ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" May 21 16:24:12.426936 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.426670 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2f062dc9-50fb-43c8-a084-6e87bd6465ec-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwcq\" (UID: \"2f062dc9-50fb-43c8-a084-6e87bd6465ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" May 21 16:24:12.426936 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.426695 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f062dc9-50fb-43c8-a084-6e87bd6465ec-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwcq\" (UID: \"2f062dc9-50fb-43c8-a084-6e87bd6465ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" May 21 16:24:12.426936 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.426811 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggb2q\" (UniqueName: \"kubernetes.io/projected/2f062dc9-50fb-43c8-a084-6e87bd6465ec-kube-api-access-ggb2q\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwcq\" (UID: \"2f062dc9-50fb-43c8-a084-6e87bd6465ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" May 21 16:24:12.426936 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.426892 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f062dc9-50fb-43c8-a084-6e87bd6465ec-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwcq\" (UID: \"2f062dc9-50fb-43c8-a084-6e87bd6465ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" May 21 16:24:12.427179 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.426947 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f062dc9-50fb-43c8-a084-6e87bd6465ec-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwcq\" (UID: \"2f062dc9-50fb-43c8-a084-6e87bd6465ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" May 21 16:24:12.427265 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.427171 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2f062dc9-50fb-43c8-a084-6e87bd6465ec-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwcq\" (UID: \"2f062dc9-50fb-43c8-a084-6e87bd6465ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" May 21 16:24:12.427265 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.427235 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f062dc9-50fb-43c8-a084-6e87bd6465ec-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwcq\" (UID: \"2f062dc9-50fb-43c8-a084-6e87bd6465ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" May 21 16:24:12.427381 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.427318 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f062dc9-50fb-43c8-a084-6e87bd6465ec-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwcq\" (UID: \"2f062dc9-50fb-43c8-a084-6e87bd6465ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" May 21 16:24:12.429061 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.429040 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f062dc9-50fb-43c8-a084-6e87bd6465ec-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwcq\" (UID: \"2f062dc9-50fb-43c8-a084-6e87bd6465ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" May 21 16:24:12.429446 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.429423 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f062dc9-50fb-43c8-a084-6e87bd6465ec-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwcq\" (UID: \"2f062dc9-50fb-43c8-a084-6e87bd6465ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" May 21 16:24:12.438622 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.438591 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggb2q\" (UniqueName: \"kubernetes.io/projected/2f062dc9-50fb-43c8-a084-6e87bd6465ec-kube-api-access-ggb2q\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pkwcq\" (UID: \"2f062dc9-50fb-43c8-a084-6e87bd6465ec\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" May 21 16:24:12.579628 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.579594 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" May 21 16:24:12.727098 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:12.727070 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq"] May 21 16:24:12.728972 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:24:12.728938 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f062dc9_50fb_43c8_a084_6e87bd6465ec.slice/crio-02e951daba6f728b48df4498508e7e6f7ff1d54a3d2c34f2d28e2c37ca997b45 WatchSource:0}: Error finding container 02e951daba6f728b48df4498508e7e6f7ff1d54a3d2c34f2d28e2c37ca997b45: Status 404 returned error can't find the container with id 02e951daba6f728b48df4498508e7e6f7ff1d54a3d2c34f2d28e2c37ca997b45 May 21 16:24:13.102480 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:13.102446 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" event={"ID":"2f062dc9-50fb-43c8-a084-6e87bd6465ec","Type":"ContainerStarted","Data":"02e951daba6f728b48df4498508e7e6f7ff1d54a3d2c34f2d28e2c37ca997b45"} May 21 16:24:18.125038 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:18.125001 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" event={"ID":"2f062dc9-50fb-43c8-a084-6e87bd6465ec","Type":"ContainerStarted","Data":"80e4822130d4160aab398822606816662663543cc0f589957d2a8fa9e0b4f36f"} May 21 16:24:24.153312 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:24.153276 2547 generic.go:358] "Generic (PLEG): container finished" podID="2f062dc9-50fb-43c8-a084-6e87bd6465ec" containerID="80e4822130d4160aab398822606816662663543cc0f589957d2a8fa9e0b4f36f" exitCode=0 May 21 16:24:24.153736 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:24.153350 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" event={"ID":"2f062dc9-50fb-43c8-a084-6e87bd6465ec","Type":"ContainerDied","Data":"80e4822130d4160aab398822606816662663543cc0f589957d2a8fa9e0b4f36f"} May 21 16:24:26.164647 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:26.164608 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" event={"ID":"2f062dc9-50fb-43c8-a084-6e87bd6465ec","Type":"ContainerStarted","Data":"b80f1c991e5f11ccc8c66d7738afa767ffbb649c852d79374aa5c0c758fdbc76"} May 21 16:24:26.165119 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:26.164868 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" May 21 16:24:26.187092 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:26.187048 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" podStartSLOduration=1.5640979270000002 podStartE2EDuration="14.187031569s" podCreationTimestamp="2026-05-21 16:24:12 +0000 UTC" firstStartedPulling="2026-05-21 16:24:12.730771243 +0000 UTC m=+758.029492121" lastFinishedPulling="2026-05-21 16:24:25.353704881 +0000 UTC m=+770.652425763" observedRunningTime="2026-05-21 16:24:26.184246977 +0000 UTC m=+771.482967879" watchObservedRunningTime="2026-05-21 16:24:26.187031569 +0000 UTC m=+771.485752469" May 21 16:24:37.181630 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:37.181595 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pkwcq" May 21 16:24:51.830972 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:51.830939 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-678bc76b7b-6vvs2"] May 21 16:24:51.853018 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:51.852989 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-678bc76b7b-6vvs2"] May 21 16:24:51.853183 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:51.853100 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-678bc76b7b-6vvs2" May 21 16:24:51.889402 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:51.889374 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8897e6e5-584c-469c-8a64-0dd6ea7ca942-tls-cert\") pod \"authorino-678bc76b7b-6vvs2\" (UID: \"8897e6e5-584c-469c-8a64-0dd6ea7ca942\") " pod="kuadrant-system/authorino-678bc76b7b-6vvs2" May 21 16:24:51.889549 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:51.889423 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6cv4\" (UniqueName: \"kubernetes.io/projected/8897e6e5-584c-469c-8a64-0dd6ea7ca942-kube-api-access-v6cv4\") pod \"authorino-678bc76b7b-6vvs2\" (UID: \"8897e6e5-584c-469c-8a64-0dd6ea7ca942\") " pod="kuadrant-system/authorino-678bc76b7b-6vvs2" May 21 16:24:51.990087 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:51.990053 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8897e6e5-584c-469c-8a64-0dd6ea7ca942-tls-cert\") pod \"authorino-678bc76b7b-6vvs2\" (UID: \"8897e6e5-584c-469c-8a64-0dd6ea7ca942\") " pod="kuadrant-system/authorino-678bc76b7b-6vvs2" May 21 16:24:51.990248 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:51.990133 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v6cv4\" (UniqueName: \"kubernetes.io/projected/8897e6e5-584c-469c-8a64-0dd6ea7ca942-kube-api-access-v6cv4\") pod \"authorino-678bc76b7b-6vvs2\" (UID: \"8897e6e5-584c-469c-8a64-0dd6ea7ca942\") " pod="kuadrant-system/authorino-678bc76b7b-6vvs2" May 21 16:24:51.992610 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:51.992589 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8897e6e5-584c-469c-8a64-0dd6ea7ca942-tls-cert\") pod \"authorino-678bc76b7b-6vvs2\" (UID: \"8897e6e5-584c-469c-8a64-0dd6ea7ca942\") " pod="kuadrant-system/authorino-678bc76b7b-6vvs2" May 21 16:24:51.998510 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:51.998485 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6cv4\" (UniqueName: \"kubernetes.io/projected/8897e6e5-584c-469c-8a64-0dd6ea7ca942-kube-api-access-v6cv4\") pod \"authorino-678bc76b7b-6vvs2\" (UID: \"8897e6e5-584c-469c-8a64-0dd6ea7ca942\") " pod="kuadrant-system/authorino-678bc76b7b-6vvs2" May 21 16:24:52.164137 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:52.164030 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-678bc76b7b-6vvs2" May 21 16:24:52.298709 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:52.298654 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-678bc76b7b-6vvs2"] May 21 16:24:52.301143 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:24:52.301100 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8897e6e5_584c_469c_8a64_0dd6ea7ca942.slice/crio-3e8f0db21d19f5315bd0f105699f4f8a51bba329fbee44a010f30111c9933375 WatchSource:0}: Error finding container 3e8f0db21d19f5315bd0f105699f4f8a51bba329fbee44a010f30111c9933375: Status 404 returned error can't find the container with id 3e8f0db21d19f5315bd0f105699f4f8a51bba329fbee44a010f30111c9933375 May 21 16:24:53.270108 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:53.270063 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-678bc76b7b-6vvs2" event={"ID":"8897e6e5-584c-469c-8a64-0dd6ea7ca942","Type":"ContainerStarted","Data":"51a85ed427c71e774e8f5a2400ce5fb7b0b0bc3ea928892547ef5575eb8e842f"} May 21 16:24:53.270507 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:53.270114 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-678bc76b7b-6vvs2" event={"ID":"8897e6e5-584c-469c-8a64-0dd6ea7ca942","Type":"ContainerStarted","Data":"3e8f0db21d19f5315bd0f105699f4f8a51bba329fbee44a010f30111c9933375"} May 21 16:24:53.291656 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:53.291599 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-678bc76b7b-6vvs2" podStartSLOduration=2.023857887 podStartE2EDuration="2.291579401s" podCreationTimestamp="2026-05-21 16:24:51 +0000 UTC" firstStartedPulling="2026-05-21 16:24:52.302456673 +0000 UTC m=+797.601177554" lastFinishedPulling="2026-05-21 16:24:52.570178189 +0000 UTC m=+797.868899068" observedRunningTime="2026-05-21 16:24:53.28800743 +0000 UTC m=+798.586728330" watchObservedRunningTime="2026-05-21 16:24:53.291579401 +0000 UTC m=+798.590300300" May 21 16:24:53.334767 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:53.334675 2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bf5db78d5-hq5z9"] May 21 16:24:53.347638 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:53.347231 2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-5bf5db78d5-hq5z9" podUID="031921ae-36d2-421b-951e-6e91fe146803" containerName="authorino" containerID="cri-o://e5956467ed97c6b7fc9dc83ede4afb0736f54c1feb2cac22fd2888938dc57392" gracePeriod=30 May 21 16:24:53.598502 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:53.598472 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bf5db78d5-hq5z9" May 21 16:24:53.705878 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:53.705809 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xbb9\" (UniqueName: \"kubernetes.io/projected/031921ae-36d2-421b-951e-6e91fe146803-kube-api-access-2xbb9\") pod \"031921ae-36d2-421b-951e-6e91fe146803\" (UID: \"031921ae-36d2-421b-951e-6e91fe146803\") " May 21 16:24:53.706067 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:53.705889 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/031921ae-36d2-421b-951e-6e91fe146803-tls-cert\") pod \"031921ae-36d2-421b-951e-6e91fe146803\" (UID: \"031921ae-36d2-421b-951e-6e91fe146803\") " May 21 16:24:53.708177 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:53.708139 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/031921ae-36d2-421b-951e-6e91fe146803-kube-api-access-2xbb9" (OuterVolumeSpecName: "kube-api-access-2xbb9") pod "031921ae-36d2-421b-951e-6e91fe146803" (UID: "031921ae-36d2-421b-951e-6e91fe146803"). InnerVolumeSpecName "kube-api-access-2xbb9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:24:53.716853 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:53.716789 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/031921ae-36d2-421b-951e-6e91fe146803-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "031921ae-36d2-421b-951e-6e91fe146803" (UID: "031921ae-36d2-421b-951e-6e91fe146803"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 16:24:53.807261 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:53.807218 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xbb9\" (UniqueName: \"kubernetes.io/projected/031921ae-36d2-421b-951e-6e91fe146803-kube-api-access-2xbb9\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:24:53.807261 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:53.807253 2547 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/031921ae-36d2-421b-951e-6e91fe146803-tls-cert\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:24:54.275291 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:54.275199 2547 generic.go:358] "Generic (PLEG): container finished" podID="031921ae-36d2-421b-951e-6e91fe146803" containerID="e5956467ed97c6b7fc9dc83ede4afb0736f54c1feb2cac22fd2888938dc57392" exitCode=0 May 21 16:24:54.275291 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:54.275267 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bf5db78d5-hq5z9" May 21 16:24:54.275728 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:54.275285 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bf5db78d5-hq5z9" event={"ID":"031921ae-36d2-421b-951e-6e91fe146803","Type":"ContainerDied","Data":"e5956467ed97c6b7fc9dc83ede4afb0736f54c1feb2cac22fd2888938dc57392"} May 21 16:24:54.275728 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:54.275327 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bf5db78d5-hq5z9" event={"ID":"031921ae-36d2-421b-951e-6e91fe146803","Type":"ContainerDied","Data":"7a92bf418caaec9e9c21718a35bd30ee22a5095326601ba7491d2e8c79a8a597"} May 21 16:24:54.275728 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:54.275343 2547 scope.go:117] "RemoveContainer" containerID="e5956467ed97c6b7fc9dc83ede4afb0736f54c1feb2cac22fd2888938dc57392" May 21 16:24:54.288031 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:54.287979 2547 scope.go:117] "RemoveContainer" containerID="e5956467ed97c6b7fc9dc83ede4afb0736f54c1feb2cac22fd2888938dc57392" May 21 16:24:54.288351 ip-10-0-139-146 kubenswrapper[2547]: E0521 16:24:54.288325 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5956467ed97c6b7fc9dc83ede4afb0736f54c1feb2cac22fd2888938dc57392\": container with ID starting with e5956467ed97c6b7fc9dc83ede4afb0736f54c1feb2cac22fd2888938dc57392 not found: ID does not exist" containerID="e5956467ed97c6b7fc9dc83ede4afb0736f54c1feb2cac22fd2888938dc57392" May 21 16:24:54.288456 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:54.288357 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5956467ed97c6b7fc9dc83ede4afb0736f54c1feb2cac22fd2888938dc57392"} err="failed to get container status \"e5956467ed97c6b7fc9dc83ede4afb0736f54c1feb2cac22fd2888938dc57392\": rpc error: code = NotFound desc = could not find container \"e5956467ed97c6b7fc9dc83ede4afb0736f54c1feb2cac22fd2888938dc57392\": container with ID starting with e5956467ed97c6b7fc9dc83ede4afb0736f54c1feb2cac22fd2888938dc57392 not found: ID does not exist" May 21 16:24:54.299617 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:54.299582 2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bf5db78d5-hq5z9"] May 21 16:24:54.306013 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:54.305986 2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5bf5db78d5-hq5z9"] May 21 16:24:55.332370 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:24:55.332336 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="031921ae-36d2-421b-951e-6e91fe146803" path="/var/lib/kubelet/pods/031921ae-36d2-421b-951e-6e91fe146803/volumes" May 21 16:26:35.280573 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:26:35.280491 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/ovn-acl-logging/0.log" May 21 16:26:35.285318 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:26:35.285297 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/ovn-acl-logging/0.log" May 21 16:30:00.137140 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:30:00.137099 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29656350-f5gcq"] May 21 16:30:00.137649 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:30:00.137494 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="031921ae-36d2-421b-951e-6e91fe146803" containerName="authorino" May 21 16:30:00.137649 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:30:00.137505 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="031921ae-36d2-421b-951e-6e91fe146803" containerName="authorino" May 21 16:30:00.137649 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:30:00.137563 2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="031921ae-36d2-421b-951e-6e91fe146803" containerName="authorino" May 21 16:30:00.140776 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:30:00.140758 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656350-f5gcq" May 21 16:30:00.143625 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:30:00.143601 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-4kq2g\"" May 21 16:30:00.154895 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:30:00.154870 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656350-f5gcq"] May 21 16:30:00.156596 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:30:00.156567 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nfq2\" (UniqueName: \"kubernetes.io/projected/2a80d0bf-3986-4897-875e-5515c51e696d-kube-api-access-4nfq2\") pod \"maas-api-key-cleanup-29656350-f5gcq\" (UID: \"2a80d0bf-3986-4897-875e-5515c51e696d\") " pod="opendatahub/maas-api-key-cleanup-29656350-f5gcq" May 21 16:30:00.257291 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:30:00.257254 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4nfq2\" (UniqueName: \"kubernetes.io/projected/2a80d0bf-3986-4897-875e-5515c51e696d-kube-api-access-4nfq2\") pod \"maas-api-key-cleanup-29656350-f5gcq\" (UID: \"2a80d0bf-3986-4897-875e-5515c51e696d\") " pod="opendatahub/maas-api-key-cleanup-29656350-f5gcq" May 21 16:30:00.265703 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:30:00.265674 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nfq2\" (UniqueName: \"kubernetes.io/projected/2a80d0bf-3986-4897-875e-5515c51e696d-kube-api-access-4nfq2\") pod \"maas-api-key-cleanup-29656350-f5gcq\" (UID: \"2a80d0bf-3986-4897-875e-5515c51e696d\") " pod="opendatahub/maas-api-key-cleanup-29656350-f5gcq" May 21 16:30:00.451242 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:30:00.451151 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656350-f5gcq" May 21 16:30:00.792680 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:30:00.792653 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656350-f5gcq"] May 21 16:30:00.795046 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:30:00.795013 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a80d0bf_3986_4897_875e_5515c51e696d.slice/crio-c7c9a33161958546e9f45c3b8c3940a6bdcd033304cc74354aa1250a488707ac WatchSource:0}: Error finding container c7c9a33161958546e9f45c3b8c3940a6bdcd033304cc74354aa1250a488707ac: Status 404 returned error can't find the container with id c7c9a33161958546e9f45c3b8c3940a6bdcd033304cc74354aa1250a488707ac May 21 16:30:00.800749 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:30:00.800723 2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 16:30:01.510169 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:30:01.510133 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656350-f5gcq" event={"ID":"2a80d0bf-3986-4897-875e-5515c51e696d","Type":"ContainerStarted","Data":"c7c9a33161958546e9f45c3b8c3940a6bdcd033304cc74354aa1250a488707ac"} May 21 16:30:04.523931 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:30:04.523903 2547 generic.go:358] "Generic (PLEG): container finished" podID="2a80d0bf-3986-4897-875e-5515c51e696d" containerID="fd936a0468062f5e88cd76eb0af9452201c0c8f1a3e42ff601665be5ce5bf6d8" exitCode=0 May 21 16:30:04.524256 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:30:04.523984 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656350-f5gcq" event={"ID":"2a80d0bf-3986-4897-875e-5515c51e696d","Type":"ContainerDied","Data":"fd936a0468062f5e88cd76eb0af9452201c0c8f1a3e42ff601665be5ce5bf6d8"} May 21 16:30:05.662294 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:30:05.662271 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656350-f5gcq" May 21 16:30:05.708156 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:30:05.708117 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nfq2\" (UniqueName: \"kubernetes.io/projected/2a80d0bf-3986-4897-875e-5515c51e696d-kube-api-access-4nfq2\") pod \"2a80d0bf-3986-4897-875e-5515c51e696d\" (UID: \"2a80d0bf-3986-4897-875e-5515c51e696d\") " May 21 16:30:05.710448 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:30:05.710418 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a80d0bf-3986-4897-875e-5515c51e696d-kube-api-access-4nfq2" (OuterVolumeSpecName: "kube-api-access-4nfq2") pod "2a80d0bf-3986-4897-875e-5515c51e696d" (UID: "2a80d0bf-3986-4897-875e-5515c51e696d"). InnerVolumeSpecName "kube-api-access-4nfq2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:30:05.808935 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:30:05.808846 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nfq2\" (UniqueName: \"kubernetes.io/projected/2a80d0bf-3986-4897-875e-5515c51e696d-kube-api-access-4nfq2\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:30:06.533868 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:30:06.533802 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656350-f5gcq" event={"ID":"2a80d0bf-3986-4897-875e-5515c51e696d","Type":"ContainerDied","Data":"c7c9a33161958546e9f45c3b8c3940a6bdcd033304cc74354aa1250a488707ac"} May 21 16:30:06.533868 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:30:06.533868 2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7c9a33161958546e9f45c3b8c3940a6bdcd033304cc74354aa1250a488707ac" May 21 16:30:06.533868 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:30:06.533842 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656350-f5gcq" May 21 16:31:35.315292 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:31:35.315258 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/ovn-acl-logging/0.log" May 21 16:31:35.320811 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:31:35.320792 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/ovn-acl-logging/0.log" May 21 16:36:35.353119 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:36:35.353092 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/ovn-acl-logging/0.log" May 21 16:36:35.359469 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:36:35.359449 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/ovn-acl-logging/0.log" May 21 16:41:35.387702 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:41:35.387671 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/ovn-acl-logging/0.log" May 21 16:41:35.398434 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:41:35.398410 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/ovn-acl-logging/0.log" May 21 16:45:00.148410 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:45:00.148372 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29656365-gqcj4"] May 21 16:45:00.148958 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:45:00.148770 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a80d0bf-3986-4897-875e-5515c51e696d" containerName="cleanup" May 21 16:45:00.148958 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:45:00.148781 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a80d0bf-3986-4897-875e-5515c51e696d" containerName="cleanup" May 21 16:45:00.148958 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:45:00.148879 2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="2a80d0bf-3986-4897-875e-5515c51e696d" containerName="cleanup" May 21 16:45:00.152055 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:45:00.152038 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656365-gqcj4" May 21 16:45:00.155024 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:45:00.154997 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-4kq2g\"" May 21 16:45:00.172200 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:45:00.172169 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656365-gqcj4"] May 21 16:45:00.206928 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:45:00.206891 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h762b\" (UniqueName: \"kubernetes.io/projected/487d09f9-cf28-4a9b-8c39-abacaf610332-kube-api-access-h762b\") pod \"maas-api-key-cleanup-29656365-gqcj4\" (UID: \"487d09f9-cf28-4a9b-8c39-abacaf610332\") " pod="opendatahub/maas-api-key-cleanup-29656365-gqcj4" May 21 16:45:00.307587 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:45:00.307542 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h762b\" (UniqueName: \"kubernetes.io/projected/487d09f9-cf28-4a9b-8c39-abacaf610332-kube-api-access-h762b\") pod \"maas-api-key-cleanup-29656365-gqcj4\" (UID: \"487d09f9-cf28-4a9b-8c39-abacaf610332\") " pod="opendatahub/maas-api-key-cleanup-29656365-gqcj4" May 21 16:45:00.321530 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:45:00.321506 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h762b\" (UniqueName: \"kubernetes.io/projected/487d09f9-cf28-4a9b-8c39-abacaf610332-kube-api-access-h762b\") pod \"maas-api-key-cleanup-29656365-gqcj4\" (UID: \"487d09f9-cf28-4a9b-8c39-abacaf610332\") " pod="opendatahub/maas-api-key-cleanup-29656365-gqcj4" May 21 16:45:00.462657 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:45:00.462558 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656365-gqcj4" May 21 16:45:00.605433 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:45:00.605401 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656365-gqcj4"] May 21 16:45:00.606641 ip-10-0-139-146 kubenswrapper[2547]: W0521 16:45:00.606610 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod487d09f9_cf28_4a9b_8c39_abacaf610332.slice/crio-5dd07718d8621d9aa0980758dd1e95b91190ecdd2e68d4677ab2836fcc3e7ef0 WatchSource:0}: Error finding container 5dd07718d8621d9aa0980758dd1e95b91190ecdd2e68d4677ab2836fcc3e7ef0: Status 404 returned error can't find the container with id 5dd07718d8621d9aa0980758dd1e95b91190ecdd2e68d4677ab2836fcc3e7ef0 May 21 16:45:00.608378 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:45:00.608361 2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 16:45:01.145570 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:45:01.145524 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656365-gqcj4" event={"ID":"487d09f9-cf28-4a9b-8c39-abacaf610332","Type":"ContainerStarted","Data":"00a1ef49929ba12daacbe02c630f17747c0683266fbb09984ea1d6cafdeaa0e5"} May 21 16:45:01.145570 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:45:01.145568 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656365-gqcj4" event={"ID":"487d09f9-cf28-4a9b-8c39-abacaf610332","Type":"ContainerStarted","Data":"5dd07718d8621d9aa0980758dd1e95b91190ecdd2e68d4677ab2836fcc3e7ef0"} May 21 16:45:02.151207 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:45:02.151171 2547 generic.go:358] "Generic (PLEG): container finished" podID="487d09f9-cf28-4a9b-8c39-abacaf610332" containerID="00a1ef49929ba12daacbe02c630f17747c0683266fbb09984ea1d6cafdeaa0e5" exitCode=0 May 21 16:45:02.151594 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:45:02.151235 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656365-gqcj4" event={"ID":"487d09f9-cf28-4a9b-8c39-abacaf610332","Type":"ContainerDied","Data":"00a1ef49929ba12daacbe02c630f17747c0683266fbb09984ea1d6cafdeaa0e5"} May 21 16:45:03.286405 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:45:03.286379 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656365-gqcj4" May 21 16:45:03.337642 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:45:03.337608 2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h762b\" (UniqueName: \"kubernetes.io/projected/487d09f9-cf28-4a9b-8c39-abacaf610332-kube-api-access-h762b\") pod \"487d09f9-cf28-4a9b-8c39-abacaf610332\" (UID: \"487d09f9-cf28-4a9b-8c39-abacaf610332\") " May 21 16:45:03.339610 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:45:03.339578 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/487d09f9-cf28-4a9b-8c39-abacaf610332-kube-api-access-h762b" (OuterVolumeSpecName: "kube-api-access-h762b") pod "487d09f9-cf28-4a9b-8c39-abacaf610332" (UID: "487d09f9-cf28-4a9b-8c39-abacaf610332"). InnerVolumeSpecName "kube-api-access-h762b". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 16:45:03.438739 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:45:03.438647 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h762b\" (UniqueName: \"kubernetes.io/projected/487d09f9-cf28-4a9b-8c39-abacaf610332-kube-api-access-h762b\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" May 21 16:45:04.160741 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:45:04.160699 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656365-gqcj4" event={"ID":"487d09f9-cf28-4a9b-8c39-abacaf610332","Type":"ContainerDied","Data":"5dd07718d8621d9aa0980758dd1e95b91190ecdd2e68d4677ab2836fcc3e7ef0"} May 21 16:45:04.160741 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:45:04.160738 2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5dd07718d8621d9aa0980758dd1e95b91190ecdd2e68d4677ab2836fcc3e7ef0" May 21 16:45:04.160965 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:45:04.160750 2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656365-gqcj4" May 21 16:46:35.425739 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:46:35.425708 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/ovn-acl-logging/0.log" May 21 16:46:35.435277 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:46:35.435257 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/ovn-acl-logging/0.log" May 21 16:47:31.398757 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:31.398671 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-678bc76b7b-6vvs2_8897e6e5-584c-469c-8a64-0dd6ea7ca942/authorino/0.log" May 21 16:47:36.221173 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:36.221144 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656350-f5gcq_2a80d0bf-3986-4897-875e-5515c51e696d/cleanup/0.log" May 21 16:47:36.339248 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:36.339219 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656365-gqcj4_487d09f9-cf28-4a9b-8c39-abacaf610332/cleanup/0.log" May 21 16:47:36.696435 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:36.696409 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77666b9699-62v4j_e432296a-5307-4053-b42d-b34b56a4e3ff/manager/0.log" May 21 16:47:37.891837 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:37.891791 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd_5c36085a-4f67-4175-973d-f0c8ecf6997e/pull/0.log" May 21 16:47:37.899663 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:37.899639 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd_5c36085a-4f67-4175-973d-f0c8ecf6997e/extract/0.log" May 21 16:47:37.907506 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:37.907488 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd_5c36085a-4f67-4175-973d-f0c8ecf6997e/util/0.log" May 21 16:47:38.034345 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:38.034318 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf_f46f1cfa-1eee-402c-a995-2352794e2e14/util/0.log" May 21 16:47:38.042114 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:38.042078 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf_f46f1cfa-1eee-402c-a995-2352794e2e14/pull/0.log" May 21 16:47:38.050892 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:38.050873 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf_f46f1cfa-1eee-402c-a995-2352794e2e14/extract/0.log" May 21 16:47:38.161595 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:38.161516 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh_9afdd4e4-c7cd-4f56-965c-c8a606fe86a4/util/0.log" May 21 16:47:38.170123 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:38.170094 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh_9afdd4e4-c7cd-4f56-965c-c8a606fe86a4/pull/0.log" May 21 16:47:38.177307 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:38.177284 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh_9afdd4e4-c7cd-4f56-965c-c8a606fe86a4/extract/0.log" May 21 16:47:38.295670 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:38.295636 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4_d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6/util/0.log" May 21 16:47:38.303176 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:38.303156 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4_d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6/pull/0.log" May 21 16:47:38.309910 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:38.309871 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4_d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6/extract/0.log" May 21 16:47:38.429396 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:38.429310 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-678bc76b7b-6vvs2_8897e6e5-584c-469c-8a64-0dd6ea7ca942/authorino/0.log" May 21 16:47:38.554328 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:38.554292 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-md6bw_12c5e9b7-37e4-4117-a05b-edf68ab073e5/manager/0.log" May 21 16:47:38.668405 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:38.668375 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-l7kn9_5d0ec449-c0f9-446c-971f-1e8be70f614b/manager/0.log" May 21 16:47:38.896492 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:38.896465 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qg6zl_e25d7961-a2f5-4d4a-8384-7f8aeeaa4355/registry-server/0.log" May 21 16:47:39.270572 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:39.270473 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-f8frp_afd9c194-a4ec-406a-8b68-8b9a58727817/manager/0.log" May 21 16:47:39.639459 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:39.639428 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq_d21c6555-1260-412a-9a12-532dbfd30bd0/istio-proxy/0.log" May 21 16:47:40.149737 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:40.149706 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-hv8pw_36052856-a412-44ac-8978-f617d5d19cb5/istio-proxy/0.log" May 21 16:47:40.407121 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:40.407041 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f5959664-vpn5f_7438a0cb-f85b-4259-8030-9c9840e39fb9/router/0.log" May 21 16:47:41.029595 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:41.029561 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-pkwcq_2f062dc9-50fb-43c8-a084-6e87bd6465ec/storage-initializer/0.log" May 21 16:47:41.036687 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:41.036662 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-pkwcq_2f062dc9-50fb-43c8-a084-6e87bd6465ec/main/0.log" May 21 16:47:45.981161 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:45.981129 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-r6pf4/must-gather-6fdwn"] May 21 16:47:45.981537 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:45.981513 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="487d09f9-cf28-4a9b-8c39-abacaf610332" containerName="cleanup" May 21 16:47:45.981537 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:45.981523 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="487d09f9-cf28-4a9b-8c39-abacaf610332" containerName="cleanup" May 21 16:47:45.981610 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:45.981596 2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="487d09f9-cf28-4a9b-8c39-abacaf610332" containerName="cleanup" May 21 16:47:45.984344 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:45.984328 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r6pf4/must-gather-6fdwn" May 21 16:47:45.987236 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:45.987214 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r6pf4\"/\"openshift-service-ca.crt\"" May 21 16:47:45.988430 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:45.988410 2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-r6pf4\"/\"default-dockercfg-f74fq\"" May 21 16:47:45.988545 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:45.988410 2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r6pf4\"/\"kube-root-ca.crt\"" May 21 16:47:46.003705 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:46.003680 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r6pf4/must-gather-6fdwn"] May 21 16:47:46.055929 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:46.055892 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b65d8f92-eef6-4150-983c-d991bb064675-must-gather-output\") pod \"must-gather-6fdwn\" (UID: \"b65d8f92-eef6-4150-983c-d991bb064675\") " pod="openshift-must-gather-r6pf4/must-gather-6fdwn" May 21 16:47:46.056105 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:46.056034 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wkwd\" (UniqueName: \"kubernetes.io/projected/b65d8f92-eef6-4150-983c-d991bb064675-kube-api-access-5wkwd\") pod \"must-gather-6fdwn\" (UID: \"b65d8f92-eef6-4150-983c-d991bb064675\") " pod="openshift-must-gather-r6pf4/must-gather-6fdwn" May 21 16:47:46.157582 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:46.157543 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wkwd\" (UniqueName: \"kubernetes.io/projected/b65d8f92-eef6-4150-983c-d991bb064675-kube-api-access-5wkwd\") pod \"must-gather-6fdwn\" (UID: \"b65d8f92-eef6-4150-983c-d991bb064675\") " pod="openshift-must-gather-r6pf4/must-gather-6fdwn" May 21 16:47:46.157755 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:46.157635 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b65d8f92-eef6-4150-983c-d991bb064675-must-gather-output\") pod \"must-gather-6fdwn\" (UID: \"b65d8f92-eef6-4150-983c-d991bb064675\") " pod="openshift-must-gather-r6pf4/must-gather-6fdwn" May 21 16:47:46.158054 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:46.158036 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b65d8f92-eef6-4150-983c-d991bb064675-must-gather-output\") pod \"must-gather-6fdwn\" (UID: \"b65d8f92-eef6-4150-983c-d991bb064675\") " pod="openshift-must-gather-r6pf4/must-gather-6fdwn" May 21 16:47:46.166154 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:46.166123 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wkwd\" (UniqueName: \"kubernetes.io/projected/b65d8f92-eef6-4150-983c-d991bb064675-kube-api-access-5wkwd\") pod \"must-gather-6fdwn\" (UID: \"b65d8f92-eef6-4150-983c-d991bb064675\") " pod="openshift-must-gather-r6pf4/must-gather-6fdwn" May 21 16:47:46.294383 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:46.294285 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r6pf4/must-gather-6fdwn" May 21 16:47:46.430579 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:46.430549 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r6pf4/must-gather-6fdwn"] May 21 16:47:46.810650 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:46.810613 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r6pf4/must-gather-6fdwn" event={"ID":"b65d8f92-eef6-4150-983c-d991bb064675","Type":"ContainerStarted","Data":"9ede8d16dd7b153629252b286bdbeb3b4b129a85630b4b12e9d95b8053617fd8"} May 21 16:47:47.817863 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:47.817801 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r6pf4/must-gather-6fdwn" event={"ID":"b65d8f92-eef6-4150-983c-d991bb064675","Type":"ContainerStarted","Data":"79f64ef6138ba36c87de7c4aa9f6cbe0090e182e6be161ffb2b12f971edd378c"} May 21 16:47:47.818322 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:47.817873 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r6pf4/must-gather-6fdwn" event={"ID":"b65d8f92-eef6-4150-983c-d991bb064675","Type":"ContainerStarted","Data":"63d8560b0cfa5a1f4fb8719923a729172261e4e87d4a205c7f5be29bf10eccd0"} May 21 16:47:47.838306 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:47.838239 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-r6pf4/must-gather-6fdwn" podStartSLOduration=2.148154697 podStartE2EDuration="2.838217195s" podCreationTimestamp="2026-05-21 16:47:45 +0000 UTC" firstStartedPulling="2026-05-21 16:47:46.436840677 +0000 UTC m=+2171.735561568" lastFinishedPulling="2026-05-21 16:47:47.126903174 +0000 UTC m=+2172.425624066" observedRunningTime="2026-05-21 16:47:47.833295316 +0000 UTC m=+2173.132016241" watchObservedRunningTime="2026-05-21 16:47:47.838217195 +0000 UTC m=+2173.136938096" May 21 16:47:48.854323 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:48.854288 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xgz2p_1048ec11-779f-4384-8207-1fb5593c5fbb/global-pull-secret-syncer/0.log" May 21 16:47:48.959666 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:48.959623 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t7qlr_0e63341a-de28-4eac-a9bf-7cbc317aac29/konnectivity-agent/0.log" May 21 16:47:49.002969 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:49.002941 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-146.ec2.internal_b349e1c779f1a186fb69a81f163bcb5d/haproxy/0.log" May 21 16:47:52.291827 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:52.291778 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd_5c36085a-4f67-4175-973d-f0c8ecf6997e/extract/0.log" May 21 16:47:52.331279 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:52.331243 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd_5c36085a-4f67-4175-973d-f0c8ecf6997e/util/0.log" May 21 16:47:52.361065 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:52.361033 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p4kbd_5c36085a-4f67-4175-973d-f0c8ecf6997e/pull/0.log" May 21 16:47:52.388209 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:52.388147 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf_f46f1cfa-1eee-402c-a995-2352794e2e14/extract/0.log" May 21 16:47:52.429137 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:52.429107 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf_f46f1cfa-1eee-402c-a995-2352794e2e14/util/0.log" May 21 16:47:52.453687 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:52.453651 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z4xzf_f46f1cfa-1eee-402c-a995-2352794e2e14/pull/0.log" May 21 16:47:52.503383 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:52.503356 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh_9afdd4e4-c7cd-4f56-965c-c8a606fe86a4/extract/0.log" May 21 16:47:52.520984 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:52.520952 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh_9afdd4e4-c7cd-4f56-965c-c8a606fe86a4/util/0.log" May 21 16:47:52.549686 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:52.549549 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7395rfh_9afdd4e4-c7cd-4f56-965c-c8a606fe86a4/pull/0.log" May 21 16:47:52.593839 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:52.585385 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4_d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6/extract/0.log" May 21 16:47:52.616868 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:52.616836 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4_d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6/util/0.log" May 21 16:47:52.655615 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:52.655579 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xn6w4_d3ff0193-4eee-4bb8-a0f6-ebeb744d80c6/pull/0.log" May 21 16:47:52.939075 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:52.938922 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-678bc76b7b-6vvs2_8897e6e5-584c-469c-8a64-0dd6ea7ca942/authorino/0.log" May 21 16:47:52.967149 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:52.967054 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-md6bw_12c5e9b7-37e4-4117-a05b-edf68ab073e5/manager/0.log" May 21 16:47:52.999376 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:52.999343 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-l7kn9_5d0ec449-c0f9-446c-971f-1e8be70f614b/manager/0.log" May 21 16:47:53.070769 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:53.070731 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qg6zl_e25d7961-a2f5-4d4a-8384-7f8aeeaa4355/registry-server/0.log" May 21 16:47:53.230899 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:53.230682 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-f8frp_afd9c194-a4ec-406a-8b68-8b9a58727817/manager/0.log" May 21 16:47:54.487418 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:54.487385 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32c9a691-3b1c-4ccd-9b91-0434f8e4562f/alertmanager/0.log" May 21 16:47:54.519156 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:54.519123 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32c9a691-3b1c-4ccd-9b91-0434f8e4562f/config-reloader/0.log" May 21 16:47:54.544550 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:54.544517 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32c9a691-3b1c-4ccd-9b91-0434f8e4562f/kube-rbac-proxy-web/0.log" May 21 16:47:54.567517 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:54.567484 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32c9a691-3b1c-4ccd-9b91-0434f8e4562f/kube-rbac-proxy/0.log" May 21 16:47:54.597185 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:54.597152 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32c9a691-3b1c-4ccd-9b91-0434f8e4562f/kube-rbac-proxy-metric/0.log" May 21 16:47:54.626807 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:54.626774 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32c9a691-3b1c-4ccd-9b91-0434f8e4562f/prom-label-proxy/0.log" May 21 16:47:54.683989 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:54.683958 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32c9a691-3b1c-4ccd-9b91-0434f8e4562f/init-config-reloader/0.log" May 21 16:47:54.728641 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:54.728604 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-cmnmf_a3e6e1c3-5727-4f92-aea9-075fa5ca85bb/cluster-monitoring-operator/0.log" May 21 16:47:54.764035 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:54.763954 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-bv2z6_f978a1e0-aaef-4dc6-b7ec-44a113855270/kube-state-metrics/0.log" May 21 16:47:54.783128 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:54.783096 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-bv2z6_f978a1e0-aaef-4dc6-b7ec-44a113855270/kube-rbac-proxy-main/0.log" May 21 16:47:54.808195 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:54.808066 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-bv2z6_f978a1e0-aaef-4dc6-b7ec-44a113855270/kube-rbac-proxy-self/0.log" May 21 16:47:54.843112 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:54.843081 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-544cd688cb-cx9hx_05cf32c8-b9ab-492e-8e5c-25d573f0d733/metrics-server/0.log" May 21 16:47:54.995112 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:54.995066 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9kt6p_96433128-be1c-4ab9-8609-aa7a48c33406/node-exporter/0.log" May 21 16:47:55.020163 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:55.020077 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9kt6p_96433128-be1c-4ab9-8609-aa7a48c33406/kube-rbac-proxy/0.log" May 21 16:47:55.045004 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:55.044970 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9kt6p_96433128-be1c-4ab9-8609-aa7a48c33406/init-textfile/0.log" May 21 16:47:55.479377 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:55.479341 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-69jqn_bce6e240-6d76-484d-b93e-4a642417906f/prometheus-operator-admission-webhook/0.log" May 21 16:47:55.508880 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:55.508846 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-858d679499-gz4sh_3e7a3435-a6ba-4822-8bb7-d7383d301538/telemeter-client/0.log" May 21 16:47:55.537944 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:55.537915 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-858d679499-gz4sh_3e7a3435-a6ba-4822-8bb7-d7383d301538/reload/0.log" May 21 16:47:55.563413 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:55.563343 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-858d679499-gz4sh_3e7a3435-a6ba-4822-8bb7-d7383d301538/kube-rbac-proxy/0.log" May 21 16:47:57.842158 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:57.842122 2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-r6pf4/perf-node-gather-daemonset-z95pq"] May 21 16:47:57.850018 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:57.849987 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-z95pq" May 21 16:47:57.853785 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:57.853757 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r6pf4/perf-node-gather-daemonset-z95pq"] May 21 16:47:57.895397 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:57.895358 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fb3a50e-2204-48e7-9a7f-c0addc1c7178-sys\") pod \"perf-node-gather-daemonset-z95pq\" (UID: \"2fb3a50e-2204-48e7-9a7f-c0addc1c7178\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-z95pq" May 21 16:47:57.895706 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:57.895682 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fb3a50e-2204-48e7-9a7f-c0addc1c7178-lib-modules\") pod \"perf-node-gather-daemonset-z95pq\" (UID: \"2fb3a50e-2204-48e7-9a7f-c0addc1c7178\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-z95pq" May 21 16:47:57.895902 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:57.895886 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2fb3a50e-2204-48e7-9a7f-c0addc1c7178-proc\") pod \"perf-node-gather-daemonset-z95pq\" (UID: \"2fb3a50e-2204-48e7-9a7f-c0addc1c7178\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-z95pq" May 21 16:47:57.896098 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:57.896083 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzj6x\" (UniqueName: \"kubernetes.io/projected/2fb3a50e-2204-48e7-9a7f-c0addc1c7178-kube-api-access-hzj6x\") pod \"perf-node-gather-daemonset-z95pq\" (UID: \"2fb3a50e-2204-48e7-9a7f-c0addc1c7178\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-z95pq" May 21 16:47:57.896264 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:57.896250 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2fb3a50e-2204-48e7-9a7f-c0addc1c7178-podres\") pod \"perf-node-gather-daemonset-z95pq\" (UID: \"2fb3a50e-2204-48e7-9a7f-c0addc1c7178\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-z95pq" May 21 16:47:57.997691 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:57.997651 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hzj6x\" (UniqueName: \"kubernetes.io/projected/2fb3a50e-2204-48e7-9a7f-c0addc1c7178-kube-api-access-hzj6x\") pod \"perf-node-gather-daemonset-z95pq\" (UID: \"2fb3a50e-2204-48e7-9a7f-c0addc1c7178\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-z95pq" May 21 16:47:57.997884 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:57.997704 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2fb3a50e-2204-48e7-9a7f-c0addc1c7178-podres\") pod \"perf-node-gather-daemonset-z95pq\" (UID: \"2fb3a50e-2204-48e7-9a7f-c0addc1c7178\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-z95pq" May 21 16:47:57.997884 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:57.997757 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fb3a50e-2204-48e7-9a7f-c0addc1c7178-sys\") pod \"perf-node-gather-daemonset-z95pq\" (UID: \"2fb3a50e-2204-48e7-9a7f-c0addc1c7178\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-z95pq" May 21 16:47:57.997884 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:57.997776 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fb3a50e-2204-48e7-9a7f-c0addc1c7178-lib-modules\") pod \"perf-node-gather-daemonset-z95pq\" (UID: \"2fb3a50e-2204-48e7-9a7f-c0addc1c7178\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-z95pq" May 21 16:47:57.997884 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:57.997828 2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2fb3a50e-2204-48e7-9a7f-c0addc1c7178-proc\") pod \"perf-node-gather-daemonset-z95pq\" (UID: \"2fb3a50e-2204-48e7-9a7f-c0addc1c7178\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-z95pq" May 21 16:47:57.998063 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:57.997894 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fb3a50e-2204-48e7-9a7f-c0addc1c7178-sys\") pod \"perf-node-gather-daemonset-z95pq\" (UID: \"2fb3a50e-2204-48e7-9a7f-c0addc1c7178\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-z95pq" May 21 16:47:57.998063 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:57.997930 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2fb3a50e-2204-48e7-9a7f-c0addc1c7178-proc\") pod \"perf-node-gather-daemonset-z95pq\" (UID: \"2fb3a50e-2204-48e7-9a7f-c0addc1c7178\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-z95pq" May 21 16:47:57.998063 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:57.997947 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2fb3a50e-2204-48e7-9a7f-c0addc1c7178-podres\") pod \"perf-node-gather-daemonset-z95pq\" (UID: \"2fb3a50e-2204-48e7-9a7f-c0addc1c7178\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-z95pq" May 21 16:47:57.998063 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:57.997951 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fb3a50e-2204-48e7-9a7f-c0addc1c7178-lib-modules\") pod \"perf-node-gather-daemonset-z95pq\" (UID: \"2fb3a50e-2204-48e7-9a7f-c0addc1c7178\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-z95pq" May 21 16:47:58.006214 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:58.006184 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzj6x\" (UniqueName: \"kubernetes.io/projected/2fb3a50e-2204-48e7-9a7f-c0addc1c7178-kube-api-access-hzj6x\") pod \"perf-node-gather-daemonset-z95pq\" (UID: \"2fb3a50e-2204-48e7-9a7f-c0addc1c7178\") " pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-z95pq" May 21 16:47:58.165427 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:58.165339 2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-z95pq" May 21 16:47:58.329650 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:58.329621 2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r6pf4/perf-node-gather-daemonset-z95pq"] May 21 16:47:58.557541 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:58.557503 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-8jpcn_037c5e61-8bb7-474e-b47b-8e98725d9e6f/volume-data-source-validator/0.log" May 21 16:47:58.893681 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:58.893637 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-z95pq" event={"ID":"2fb3a50e-2204-48e7-9a7f-c0addc1c7178","Type":"ContainerStarted","Data":"5657df748890338b81f4227be2666070699bcb6ecf7750b2700743766a8de267"} May 21 16:47:58.893681 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:58.893686 2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-z95pq" event={"ID":"2fb3a50e-2204-48e7-9a7f-c0addc1c7178","Type":"ContainerStarted","Data":"1439dcf465d5badb4d7e6ee2b14197762b3021b3e08035a6f73b53e6c897639d"} May 21 16:47:58.894620 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:58.894597 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-z95pq" May 21 16:47:58.915379 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:58.915311 2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-z95pq" podStartSLOduration=1.9152902809999999 podStartE2EDuration="1.915290281s" podCreationTimestamp="2026-05-21 16:47:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:47:58.913338913 +0000 UTC m=+2184.212059814" watchObservedRunningTime="2026-05-21 16:47:58.915290281 +0000 UTC m=+2184.214011210" May 21 16:47:59.485416 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:59.485385 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-984s7_44ebd433-29f6-4471-8518-b23a3b13be79/dns/0.log" May 21 16:47:59.506021 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:59.505996 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-984s7_44ebd433-29f6-4471-8518-b23a3b13be79/kube-rbac-proxy/0.log" May 21 16:47:59.576669 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:47:59.576641 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vbmn8_7b9dc463-4392-4994-9467-5979208be3e2/dns-node-resolver/0.log" May 21 16:48:00.034477 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:00.034448 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-89949c9b6-2ll9b_1aab8dfd-75ed-419d-8ea2-38c42d1d6d86/registry/0.log" May 21 16:48:00.054606 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:00.054577 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-44tws_93d8872f-0f1e-49b5-9204-eb976993ff33/node-ca/0.log" May 21 16:48:00.987178 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:00.987150 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bb5cpq_d21c6555-1260-412a-9a12-532dbfd30bd0/istio-proxy/0.log" May 21 16:48:01.189879 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:01.189844 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-hv8pw_36052856-a412-44ac-8978-f617d5d19cb5/istio-proxy/0.log" May 21 16:48:01.273610 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:01.273526 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f5959664-vpn5f_7438a0cb-f85b-4259-8030-9c9840e39fb9/router/0.log" May 21 16:48:01.833586 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:01.833561 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-82shb_0593535c-9146-4f09-8845-dc1bd5e79c6b/serve-healthcheck-canary/0.log" May 21 16:48:02.297184 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:02.297097 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-n5c9z_192b3e8b-5e9a-4390-bbe2-a481491eca79/insights-operator/0.log" May 21 16:48:02.298068 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:02.298044 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-n5c9z_192b3e8b-5e9a-4390-bbe2-a481491eca79/insights-operator/1.log" May 21 16:48:02.385645 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:02.385612 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m47fb_e5de7e62-600e-4904-895d-9d255fdb97e4/kube-rbac-proxy/0.log" May 21 16:48:02.405805 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:02.405774 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m47fb_e5de7e62-600e-4904-895d-9d255fdb97e4/exporter/0.log" May 21 16:48:02.428126 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:02.428097 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m47fb_e5de7e62-600e-4904-895d-9d255fdb97e4/extractor/0.log" May 21 16:48:04.484837 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:04.484797 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656350-f5gcq_2a80d0bf-3986-4897-875e-5515c51e696d/cleanup/0.log" May 21 16:48:04.512288 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:04.512262 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656365-gqcj4_487d09f9-cf28-4a9b-8c39-abacaf610332/cleanup/0.log" May 21 16:48:04.663021 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:04.662992 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77666b9699-62v4j_e432296a-5307-4053-b42d-b34b56a4e3ff/manager/0.log" May 21 16:48:05.916761 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:05.916726 2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-r6pf4/perf-node-gather-daemonset-z95pq" May 21 16:48:05.993997 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:05.993972 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d586fd4bc-z7nd6_36f1c08b-1fd8-4e2d-a27a-4de787882db3/manager/0.log" May 21 16:48:06.018851 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:06.018802 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-bs7kp_be60e7c3-5de4-427c-bc5f-e10eb39323c0/openshift-lws-operator/0.log" May 21 16:48:11.575588 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:11.575547 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-z6wwz_066361a8-80f2-4d49-9f40-23277e538536/kube-storage-version-migrator-operator/1.log" May 21 16:48:11.576498 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:11.576478 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-z6wwz_066361a8-80f2-4d49-9f40-23277e538536/kube-storage-version-migrator-operator/0.log" May 21 16:48:12.778717 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:12.778687 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8crv6_5780fafa-5b6a-4f8b-8259-5fa685f0277f/kube-multus/0.log" May 21 16:48:13.124137 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:13.124107 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g8kpd_57b0c522-cbfe-4c72-9396-646d4d893a0a/kube-multus-additional-cni-plugins/0.log" May 21 16:48:13.147268 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:13.147244 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g8kpd_57b0c522-cbfe-4c72-9396-646d4d893a0a/egress-router-binary-copy/0.log" May 21 16:48:13.183942 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:13.183914 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g8kpd_57b0c522-cbfe-4c72-9396-646d4d893a0a/cni-plugins/0.log" May 21 16:48:13.207075 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:13.207050 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g8kpd_57b0c522-cbfe-4c72-9396-646d4d893a0a/bond-cni-plugin/0.log" May 21 16:48:13.229167 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:13.229143 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g8kpd_57b0c522-cbfe-4c72-9396-646d4d893a0a/routeoverride-cni/0.log" May 21 16:48:13.300180 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:13.300147 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g8kpd_57b0c522-cbfe-4c72-9396-646d4d893a0a/whereabouts-cni-bincopy/0.log" May 21 16:48:13.324783 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:13.324746 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g8kpd_57b0c522-cbfe-4c72-9396-646d4d893a0a/whereabouts-cni/0.log" May 21 16:48:13.381091 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:13.381004 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-49jxl_44a88f02-4431-4214-9629-d63db994abfe/network-metrics-daemon/0.log" May 21 16:48:13.401652 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:13.401618 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-49jxl_44a88f02-4431-4214-9629-d63db994abfe/kube-rbac-proxy/0.log" May 21 16:48:14.861755 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:14.861727 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/ovn-controller/0.log" May 21 16:48:14.885270 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:14.885233 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/ovn-acl-logging/0.log" May 21 16:48:14.896328 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:14.896301 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/ovn-acl-logging/1.log" May 21 16:48:14.918095 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:14.918059 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/kube-rbac-proxy-node/0.log" May 21 16:48:14.944063 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:14.944041 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/kube-rbac-proxy-ovn-metrics/0.log" May 21 16:48:14.963700 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:14.963664 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/northd/0.log" May 21 16:48:14.990088 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:14.990063 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/nbdb/0.log" May 21 16:48:15.010844 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:15.010793 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/sbdb/0.log" May 21 16:48:15.142676 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:15.142604 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsq2k_e219263f-6a61-44ab-ab60-b90f74c6de79/ovnkube-controller/0.log" May 21 16:48:16.276364 ip-10-0-139-146 kubenswrapper[2547]: I0521 16:48:16.276308 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-lmq6k_f4204967-d20e-4283-935c-a6e32ad1aba9/network-check-target-container/0.log"