Jun 02 05:43:21.634460 ip-10-0-134-52 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 02 05:43:21.634474 ip-10-0-134-52 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 02 05:43:21.634483 ip-10-0-134-52 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 02 05:43:21.634799 ip-10-0-134-52 systemd[1]: Failed to start Kubernetes Kubelet. Jun 02 05:43:31.744330 ip-10-0-134-52 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 02 05:43:31.744347 ip-10-0-134-52 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9a3e7b14d13b4ff5825ad70ee6533a90 -- Jun 02 05:46:01.771000 ip-10-0-134-52 systemd[1]: Starting Kubernetes Kubelet... Jun 02 05:46:02.119980 ip-10-0-134-52 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 05:46:02.119980 ip-10-0-134-52 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 05:46:02.119980 ip-10-0-134-52 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 05:46:02.119980 ip-10-0-134-52 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 05:46:02.119980 ip-10-0-134-52 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 05:46:02.121966 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.121835 2575 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 05:46:02.125361 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125345 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 05:46:02.125361 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125361 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 05:46:02.125426 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125365 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 05:46:02.125426 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125368 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 05:46:02.125426 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125371 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 05:46:02.125426 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125374 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 05:46:02.125426 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125377 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 05:46:02.125426 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125379 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 05:46:02.125426 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125382 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 05:46:02.125426 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125384 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 05:46:02.125426 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125387 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 05:46:02.125426 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125389 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 05:46:02.125426 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125393 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 05:46:02.125426 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125396 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 05:46:02.125426 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125398 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 05:46:02.125426 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125401 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 05:46:02.125426 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125404 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 05:46:02.125426 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125406 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 05:46:02.125426 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125409 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 05:46:02.125426 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125412 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 05:46:02.125426 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125414 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 05:46:02.125426 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125429 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 05:46:02.125922 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125432 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 05:46:02.125922 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125435 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 05:46:02.125922 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125438 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 05:46:02.125922 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125440 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 05:46:02.125922 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125443 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 05:46:02.125922 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125445 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 05:46:02.125922 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125448 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 05:46:02.125922 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125450 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 05:46:02.125922 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125452 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 05:46:02.125922 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125455 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 05:46:02.125922 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125457 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 05:46:02.125922 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125460 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 05:46:02.125922 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125462 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 05:46:02.125922 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125465 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 05:46:02.125922 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125468 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 05:46:02.125922 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125470 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 05:46:02.125922 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125473 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 02 05:46:02.125922 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125477 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 05:46:02.125922 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125481 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 05:46:02.126379 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125484 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 05:46:02.126379 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125487 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 05:46:02.126379 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125490 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 05:46:02.126379 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125493 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 05:46:02.126379 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125497 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 05:46:02.126379 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125499 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 05:46:02.126379 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125502 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 05:46:02.126379 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125505 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 05:46:02.126379 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125508 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 05:46:02.126379 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125510 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 05:46:02.126379 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125513 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 05:46:02.126379 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125516 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 05:46:02.126379 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125519 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 05:46:02.126379 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125527 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 05:46:02.126379 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125531 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 05:46:02.126379 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125533 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 05:46:02.126379 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125536 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 05:46:02.126379 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125539 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 05:46:02.126379 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125541 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 05:46:02.126379 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125544 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 05:46:02.126965 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125548 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 05:46:02.126965 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125550 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 05:46:02.126965 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125553 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 05:46:02.126965 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125555 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 05:46:02.126965 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125559 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 05:46:02.126965 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125562 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 05:46:02.126965 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125565 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 05:46:02.126965 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125567 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 05:46:02.126965 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125570 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 05:46:02.126965 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125573 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 05:46:02.126965 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125576 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 05:46:02.126965 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125578 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 05:46:02.126965 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125581 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 05:46:02.126965 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125584 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 05:46:02.126965 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125586 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 05:46:02.126965 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125589 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 05:46:02.126965 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125592 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 05:46:02.126965 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125594 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 05:46:02.126965 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125598 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 05:46:02.127428 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125601 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 05:46:02.127428 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125605 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 05:46:02.127428 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125608 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 05:46:02.127428 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125610 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 05:46:02.127428 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125613 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 05:46:02.127428 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.125615 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 05:46:02.127428 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126754 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 05:46:02.127428 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126763 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 05:46:02.127428 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126766 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 05:46:02.127428 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126769 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 05:46:02.127428 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126772 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 05:46:02.127428 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126775 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 05:46:02.127428 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126778 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 05:46:02.127428 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126780 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 05:46:02.127428 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126783 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 05:46:02.127428 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126787 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 05:46:02.127428 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126791 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 05:46:02.127428 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126794 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 05:46:02.127428 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126796 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 05:46:02.127428 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126799 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 05:46:02.127930 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126801 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 05:46:02.127930 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126804 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 05:46:02.127930 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126807 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 05:46:02.127930 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126810 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 05:46:02.127930 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126813 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 05:46:02.127930 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126817 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 05:46:02.127930 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126820 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 05:46:02.127930 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126823 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 05:46:02.127930 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126826 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 05:46:02.127930 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126830 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 05:46:02.127930 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126832 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 05:46:02.127930 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126835 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 05:46:02.127930 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126838 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 05:46:02.127930 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126840 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 05:46:02.127930 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126843 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 05:46:02.127930 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126846 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 05:46:02.127930 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126848 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 05:46:02.127930 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126850 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 05:46:02.127930 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126853 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 05:46:02.128401 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126857 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 05:46:02.128401 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126860 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 05:46:02.128401 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126862 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 05:46:02.128401 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126865 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 05:46:02.128401 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126868 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 05:46:02.128401 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126870 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 05:46:02.128401 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126873 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 05:46:02.128401 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126875 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 05:46:02.128401 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126878 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 05:46:02.128401 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126881 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 05:46:02.128401 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126883 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 05:46:02.128401 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126886 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 05:46:02.128401 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126888 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 05:46:02.128401 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126891 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 05:46:02.128401 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126894 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 05:46:02.128401 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126897 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 05:46:02.128401 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126900 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 05:46:02.128401 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126902 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 05:46:02.128401 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126905 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 05:46:02.128401 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126908 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 05:46:02.128908 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126911 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 05:46:02.128908 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126913 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 05:46:02.128908 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126916 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 05:46:02.128908 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126918 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 02 05:46:02.128908 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126921 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 05:46:02.128908 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126924 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 05:46:02.128908 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126927 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 05:46:02.128908 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126929 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 05:46:02.128908 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126932 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 05:46:02.128908 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126934 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 05:46:02.128908 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126937 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 05:46:02.128908 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126939 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 05:46:02.128908 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126942 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 05:46:02.128908 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126945 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 05:46:02.128908 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126947 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 05:46:02.128908 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126954 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 05:46:02.128908 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126957 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 05:46:02.128908 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126959 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 05:46:02.128908 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126961 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 05:46:02.128908 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126964 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 05:46:02.129394 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126966 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 05:46:02.129394 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126969 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 05:46:02.129394 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126972 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 05:46:02.129394 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126974 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 05:46:02.129394 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126977 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 05:46:02.129394 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126979 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 05:46:02.129394 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126982 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 05:46:02.129394 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126985 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 05:46:02.129394 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126988 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 05:46:02.129394 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126990 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 05:46:02.129394 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126993 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 05:46:02.129394 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126996 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 05:46:02.129394 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.126998 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 05:46:02.129394 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128217 2575 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 05:46:02.129394 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128228 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 05:46:02.129394 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128235 2575 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 05:46:02.129394 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128240 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 05:46:02.129394 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128245 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 05:46:02.129394 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128249 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 05:46:02.129394 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128253 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 05:46:02.129394 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128257 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 05:46:02.129920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128261 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 05:46:02.129920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128264 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 05:46:02.129920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128268 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 05:46:02.129920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128271 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 05:46:02.129920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128274 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 05:46:02.129920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128279 2575 flags.go:64] FLAG: --cgroup-root="" Jun 02 05:46:02.129920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128282 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 05:46:02.129920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128285 2575 flags.go:64] FLAG: --client-ca-file="" Jun 02 05:46:02.129920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128288 2575 flags.go:64] FLAG: --cloud-config="" Jun 02 05:46:02.129920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128291 2575 flags.go:64] FLAG: --cloud-provider="external" Jun 02 05:46:02.129920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128294 2575 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 05:46:02.129920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128298 2575 flags.go:64] FLAG: --cluster-domain="" Jun 02 05:46:02.129920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128301 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 05:46:02.129920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128304 2575 flags.go:64] FLAG: --config-dir="" Jun 02 05:46:02.129920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128307 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 05:46:02.129920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128310 2575 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 05:46:02.129920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128314 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 05:46:02.129920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128318 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 05:46:02.129920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128321 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 05:46:02.129920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128327 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 05:46:02.129920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128330 2575 flags.go:64] FLAG: --contention-profiling="false" Jun 02 05:46:02.129920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128333 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 05:46:02.129920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128336 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 05:46:02.129920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128340 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 05:46:02.129920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128343 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 05:46:02.130543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128347 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 05:46:02.130543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128350 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 05:46:02.130543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128353 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 05:46:02.130543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128356 2575 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 05:46:02.130543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128359 2575 flags.go:64] FLAG: --enable-server="true" Jun 02 05:46:02.130543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128362 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 05:46:02.130543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128367 2575 flags.go:64] FLAG: --event-burst="100" Jun 02 05:46:02.130543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128370 2575 flags.go:64] FLAG: --event-qps="50" Jun 02 05:46:02.130543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128373 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 05:46:02.130543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128376 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 05:46:02.130543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128379 2575 flags.go:64] FLAG: --eviction-hard="" Jun 02 05:46:02.130543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128383 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 05:46:02.130543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128386 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 05:46:02.130543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128389 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 05:46:02.130543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128392 2575 flags.go:64] FLAG: --eviction-soft="" Jun 02 05:46:02.130543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128396 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 05:46:02.130543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128398 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 05:46:02.130543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128401 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 05:46:02.130543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128405 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 05:46:02.130543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128408 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 05:46:02.130543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128411 2575 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 05:46:02.130543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128414 2575 flags.go:64] FLAG: --feature-gates="" Jun 02 05:46:02.130543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128418 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 05:46:02.130543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128421 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 05:46:02.130543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128424 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 05:46:02.131172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128428 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 05:46:02.131172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128432 2575 flags.go:64] FLAG: --healthz-port="10248" Jun 02 05:46:02.131172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128435 2575 flags.go:64] FLAG: --help="false" Jun 02 05:46:02.131172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128438 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-134-52.ec2.internal" Jun 02 05:46:02.131172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128441 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 05:46:02.131172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128444 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 05:46:02.131172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128447 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 05:46:02.131172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128451 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 05:46:02.131172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128454 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 05:46:02.131172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128457 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 05:46:02.131172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128459 2575 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 05:46:02.131172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128462 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 05:46:02.131172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128465 2575 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 05:46:02.131172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128468 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 05:46:02.131172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128471 2575 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 05:46:02.131172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128473 2575 flags.go:64] FLAG: --kube-reserved="" Jun 02 05:46:02.131172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128476 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 05:46:02.131172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128479 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 05:46:02.131172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128482 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 05:46:02.131172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128489 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 05:46:02.131172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128492 2575 flags.go:64] FLAG: --lock-file="" Jun 02 05:46:02.131172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128495 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 05:46:02.131172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128498 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 05:46:02.131172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128501 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 05:46:02.131759 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128507 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 05:46:02.131759 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128509 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 05:46:02.131759 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128512 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 05:46:02.131759 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128515 2575 flags.go:64] FLAG: --logging-format="text" Jun 02 05:46:02.131759 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128518 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 05:46:02.131759 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128521 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 05:46:02.131759 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128524 2575 flags.go:64] FLAG: --manifest-url="" Jun 02 05:46:02.131759 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128527 2575 flags.go:64] FLAG: --manifest-url-header="" Jun 02 05:46:02.131759 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128531 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 05:46:02.131759 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128536 2575 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 05:46:02.131759 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128540 2575 flags.go:64] FLAG: --max-pods="110" Jun 02 05:46:02.131759 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128543 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 05:46:02.131759 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128546 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 05:46:02.131759 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128549 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 05:46:02.131759 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128552 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 05:46:02.131759 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128556 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 05:46:02.131759 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128559 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 05:46:02.131759 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128562 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 05:46:02.131759 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128569 2575 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 05:46:02.131759 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128572 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 05:46:02.131759 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128576 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 05:46:02.131759 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128579 2575 flags.go:64] FLAG: --pod-cidr="" Jun 02 05:46:02.131759 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128582 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128587 2575 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128590 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128593 2575 flags.go:64] FLAG: --pods-per-core="0" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128596 2575 flags.go:64] FLAG: --port="10250" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128599 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128604 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c2512f86bfd421aa" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128607 2575 flags.go:64] FLAG: --qos-reserved="" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128610 2575 flags.go:64] FLAG: --read-only-port="10255" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128614 2575 flags.go:64] FLAG: --register-node="true" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128616 2575 flags.go:64] FLAG: --register-schedulable="true" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128619 2575 flags.go:64] FLAG: --register-with-taints="" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128623 2575 flags.go:64] FLAG: --registry-burst="10" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128626 2575 flags.go:64] FLAG: --registry-qps="5" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128628 2575 flags.go:64] FLAG: --reserved-cpus="" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128631 2575 flags.go:64] FLAG: --reserved-memory="" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128635 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128637 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128641 2575 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128646 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128649 2575 flags.go:64] FLAG: --runonce="false" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128652 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128655 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128658 2575 flags.go:64] FLAG: --seccomp-default="false" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128661 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128664 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 05:46:02.132340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128667 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 05:46:02.132976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128670 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 05:46:02.132976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128673 2575 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 05:46:02.132976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128676 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 05:46:02.132976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128679 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 05:46:02.132976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128681 2575 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 05:46:02.132976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128684 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 05:46:02.132976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128687 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 05:46:02.132976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128690 2575 flags.go:64] FLAG: --system-cgroups="" Jun 02 05:46:02.132976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128693 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 05:46:02.132976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128698 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 05:46:02.132976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128701 2575 flags.go:64] FLAG: --tls-cert-file="" Jun 02 05:46:02.132976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128705 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 05:46:02.132976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128709 2575 flags.go:64] FLAG: --tls-min-version="" Jun 02 05:46:02.132976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128712 2575 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 05:46:02.132976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128715 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 05:46:02.132976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128719 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 05:46:02.132976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128733 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 05:46:02.132976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128737 2575 flags.go:64] FLAG: --v="2" Jun 02 05:46:02.132976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128742 2575 flags.go:64] FLAG: --version="false" Jun 02 05:46:02.132976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128746 2575 flags.go:64] FLAG: --vmodule="" Jun 02 05:46:02.132976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128750 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 05:46:02.132976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.128754 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 05:46:02.132976 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128852 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 05:46:02.132976 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128856 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 05:46:02.132976 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128860 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 05:46:02.133603 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128863 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 05:46:02.133603 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128865 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 05:46:02.133603 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128868 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 05:46:02.133603 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128870 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 05:46:02.133603 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128873 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 05:46:02.133603 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128875 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 05:46:02.133603 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128878 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 05:46:02.133603 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128881 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 05:46:02.133603 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128883 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 05:46:02.133603 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128886 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 05:46:02.133603 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128888 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 05:46:02.133603 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128891 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 05:46:02.133603 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128893 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 05:46:02.133603 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128896 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 05:46:02.133603 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128898 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 05:46:02.133603 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128901 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 05:46:02.133603 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128905 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 05:46:02.133603 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128909 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 05:46:02.133603 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128914 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 05:46:02.134104 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128917 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 05:46:02.134104 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128919 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 05:46:02.134104 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128922 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 05:46:02.134104 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128925 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 05:46:02.134104 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128928 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 05:46:02.134104 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128931 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 05:46:02.134104 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128933 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 05:46:02.134104 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128935 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 05:46:02.134104 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128939 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 05:46:02.134104 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128941 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 05:46:02.134104 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128944 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 05:46:02.134104 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128946 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 05:46:02.134104 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128949 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 02 05:46:02.134104 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128952 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 05:46:02.134104 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128954 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 05:46:02.134104 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128957 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 05:46:02.134104 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128959 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 05:46:02.134104 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128962 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 05:46:02.134104 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128965 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 05:46:02.134104 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128967 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 05:46:02.134617 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128970 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 05:46:02.134617 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128972 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 05:46:02.134617 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128975 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 05:46:02.134617 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128977 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 05:46:02.134617 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128980 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 05:46:02.134617 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128982 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 05:46:02.134617 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128985 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 05:46:02.134617 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128988 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 05:46:02.134617 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128990 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 05:46:02.134617 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128993 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 05:46:02.134617 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.128995 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 05:46:02.134617 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129003 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 05:46:02.134617 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129006 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 05:46:02.134617 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129008 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 05:46:02.134617 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129011 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 05:46:02.134617 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129013 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 05:46:02.134617 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129017 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 05:46:02.134617 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129019 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 05:46:02.134617 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129022 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 05:46:02.134617 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129025 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 05:46:02.135329 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129028 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 05:46:02.135329 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129030 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 05:46:02.135329 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129033 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 05:46:02.135329 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129036 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 05:46:02.135329 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129038 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 05:46:02.135329 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129041 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 05:46:02.135329 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129044 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 05:46:02.135329 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129046 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 05:46:02.135329 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129049 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 05:46:02.135329 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129051 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 05:46:02.135329 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129053 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 05:46:02.135329 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129056 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 05:46:02.135329 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129058 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 05:46:02.135329 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129061 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 05:46:02.135329 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129063 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 05:46:02.135329 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129066 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 05:46:02.135329 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129068 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 05:46:02.135329 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129071 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 05:46:02.135329 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129073 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 05:46:02.135329 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129076 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 05:46:02.136079 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129078 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 05:46:02.136079 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129080 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 05:46:02.136079 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129085 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 05:46:02.136079 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.129090 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 05:46:02.136079 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.129682 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 05:46:02.137575 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.137447 2575 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 05:46:02.137617 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.137577 2575 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 05:46:02.137651 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137626 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 05:46:02.137651 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137632 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 05:46:02.137651 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137636 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 05:46:02.137651 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137639 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 05:46:02.137651 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137642 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 05:46:02.137651 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137645 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 05:46:02.137651 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137649 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 05:46:02.137651 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137652 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 05:46:02.137875 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137655 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 05:46:02.137875 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137658 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 05:46:02.137875 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137661 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 05:46:02.137875 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137664 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 05:46:02.137875 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137667 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 05:46:02.137875 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137669 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 05:46:02.137875 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137672 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 05:46:02.137875 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137675 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 05:46:02.137875 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137677 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 05:46:02.137875 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137680 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 05:46:02.137875 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137682 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 05:46:02.137875 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137685 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 05:46:02.137875 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137689 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 05:46:02.137875 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137691 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 05:46:02.137875 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137694 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 05:46:02.137875 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137697 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 05:46:02.137875 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137699 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 05:46:02.137875 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137702 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 05:46:02.137875 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137704 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 05:46:02.137875 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137708 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 05:46:02.138367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137710 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 05:46:02.138367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137713 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 05:46:02.138367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137716 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 05:46:02.138367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137719 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 05:46:02.138367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137736 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 05:46:02.138367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137741 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 05:46:02.138367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137745 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 05:46:02.138367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137749 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 05:46:02.138367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137752 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 05:46:02.138367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137755 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 05:46:02.138367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137758 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 05:46:02.138367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137760 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 05:46:02.138367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137763 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 05:46:02.138367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137766 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 05:46:02.138367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137769 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 05:46:02.138367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137773 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 05:46:02.138367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137776 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 05:46:02.138367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137778 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 05:46:02.138367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137782 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 05:46:02.138367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137785 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 05:46:02.138874 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137787 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 02 05:46:02.138874 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137790 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 05:46:02.138874 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137792 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 05:46:02.138874 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137795 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 05:46:02.138874 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137799 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 05:46:02.138874 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137803 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 05:46:02.138874 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137806 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 05:46:02.138874 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137809 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 05:46:02.138874 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137812 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 05:46:02.138874 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137814 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 05:46:02.138874 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137817 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 05:46:02.138874 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137820 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 05:46:02.138874 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137823 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 05:46:02.138874 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137826 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 05:46:02.138874 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137829 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 05:46:02.138874 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137831 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 05:46:02.138874 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137834 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 05:46:02.138874 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137837 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 05:46:02.138874 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137839 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 05:46:02.138874 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137842 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 05:46:02.139367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137844 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 05:46:02.139367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137847 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 05:46:02.139367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137849 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 05:46:02.139367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137854 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 05:46:02.139367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137858 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 05:46:02.139367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137868 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 05:46:02.139367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137873 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 05:46:02.139367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137877 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 05:46:02.139367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137881 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 05:46:02.139367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137884 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 05:46:02.139367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137887 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 05:46:02.139367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137890 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 05:46:02.139367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137893 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 05:46:02.139367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137895 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 05:46:02.139367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137898 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 05:46:02.139367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137901 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 05:46:02.139367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137905 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 05:46:02.139367 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.137907 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 05:46:02.139884 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.137912 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 05:46:02.139884 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138012 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 05:46:02.139884 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138041 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 05:46:02.139884 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138045 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 05:46:02.139884 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138049 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 05:46:02.139884 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138054 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 05:46:02.139884 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138057 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 05:46:02.139884 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138060 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 05:46:02.139884 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138062 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 05:46:02.139884 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138065 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 05:46:02.139884 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138068 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 05:46:02.139884 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138071 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 05:46:02.139884 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138073 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 05:46:02.139884 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138076 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 05:46:02.139884 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138079 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 05:46:02.140252 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138081 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 05:46:02.140252 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138084 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 05:46:02.140252 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138087 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 05:46:02.140252 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138089 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 05:46:02.140252 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138091 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 05:46:02.140252 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138095 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 05:46:02.140252 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138097 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 05:46:02.140252 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138100 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 05:46:02.140252 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138104 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 05:46:02.140252 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138107 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 05:46:02.140252 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138111 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 05:46:02.140252 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138114 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 05:46:02.140252 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138116 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 05:46:02.140252 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138119 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 05:46:02.140252 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138122 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 05:46:02.140252 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138125 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 05:46:02.140252 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138127 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 05:46:02.140252 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138130 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 05:46:02.140252 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138132 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 05:46:02.140720 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138135 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 05:46:02.140720 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138138 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 05:46:02.140720 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138140 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 05:46:02.140720 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138143 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 05:46:02.140720 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138146 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 05:46:02.140720 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138148 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 05:46:02.140720 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138151 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 05:46:02.140720 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138154 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 05:46:02.140720 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138156 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 05:46:02.140720 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138158 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 05:46:02.140720 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138161 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 05:46:02.140720 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138163 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 05:46:02.140720 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138166 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 05:46:02.140720 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138169 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 05:46:02.140720 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138171 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 05:46:02.140720 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138174 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 05:46:02.140720 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138176 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 05:46:02.140720 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138179 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 05:46:02.140720 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138182 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 05:46:02.140720 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138185 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 05:46:02.141222 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138187 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 05:46:02.141222 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138190 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 05:46:02.141222 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138194 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 05:46:02.141222 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138196 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 05:46:02.141222 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138199 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 05:46:02.141222 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138201 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 05:46:02.141222 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138204 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 05:46:02.141222 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138206 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 05:46:02.141222 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138209 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 05:46:02.141222 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138211 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 05:46:02.141222 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138214 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 05:46:02.141222 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138216 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 05:46:02.141222 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138219 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 05:46:02.141222 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138221 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 05:46:02.141222 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138224 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 05:46:02.141222 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138227 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 05:46:02.141222 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138229 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 05:46:02.141222 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138232 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 05:46:02.141222 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138235 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 05:46:02.141222 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138238 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 05:46:02.141708 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138240 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 05:46:02.141708 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138243 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 05:46:02.141708 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138245 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 05:46:02.141708 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138247 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 05:46:02.141708 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138250 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 02 05:46:02.141708 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138252 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 05:46:02.141708 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138255 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 05:46:02.141708 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138258 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 05:46:02.141708 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138260 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 05:46:02.141708 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138263 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 05:46:02.141708 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138266 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 05:46:02.141708 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138268 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 05:46:02.141708 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:02.138271 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 05:46:02.141708 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.138275 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 05:46:02.141708 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.138961 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 05:46:02.145628 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.145611 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 05:46:02.146433 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.146422 2575 server.go:1019] "Starting client certificate rotation" Jun 02 05:46:02.146550 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.146532 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 05:46:02.146585 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.146575 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 05:46:02.166655 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.166633 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 05:46:02.168471 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.168446 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 05:46:02.179814 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.179792 2575 log.go:25] "Validated CRI v1 runtime API" Jun 02 05:46:02.184919 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.184900 2575 log.go:25] "Validated CRI v1 image API" Jun 02 05:46:02.186642 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.186625 2575 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 05:46:02.190797 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.190772 2575 fs.go:135] Filesystem UUIDs: map[21436bc6-ab8c-41b3-a7be-18dcbb767759:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ba019fc7-ac0c-48db-804b-fdc8bafc8a0a:/dev/nvme0n1p3] Jun 02 05:46:02.190873 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.190796 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 05:46:02.195569 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.195452 2575 manager.go:217] Machine: {Timestamp:2026-06-02 05:46:02.194944925 +0000 UTC m=+0.326825809 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100335 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f058d6dac10cd276ee88150d25ed5 SystemUUID:ec2f058d-6dac-10cd-276e-e88150d25ed5 BootID:9a3e7b14-d13b-4ff5-825a-d70ee6533a90 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b6:e5:84:b7:6b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b6:e5:84:b7:6b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:07:50:bf:a2:a6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 05:46:02.195866 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.195846 2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 05:46:02.195935 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.195921 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 05:46:02.196077 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.196063 2575 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 05:46:02.198326 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.198300 2575 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 05:46:02.198493 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.198329 2575 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-52.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 05:46:02.198569 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.198503 2575 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 05:46:02.198569 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.198515 2575 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 05:46:02.198569 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.198525 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 05:46:02.199423 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.199411 2575 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 05:46:02.200694 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.200682 2575 state_mem.go:36] "Initialized new in-memory state store" Jun 02 05:46:02.200843 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.200832 2575 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 05:46:02.202568 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.202556 2575 kubelet.go:491] "Attempting to sync node with API server" Jun 02 05:46:02.202623 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.202581 2575 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 05:46:02.202623 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.202599 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 05:46:02.202623 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.202614 2575 kubelet.go:397] "Adding apiserver pod source" Jun 02 05:46:02.202777 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.202626 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 05:46:02.203616 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.203602 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 05:46:02.203683 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.203627 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 05:46:02.206282 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.206264 2575 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 05:46:02.208066 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.208052 2575 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 05:46:02.210351 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.210339 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 05:46:02.210398 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.210357 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 05:46:02.210398 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.210365 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 05:46:02.210398 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.210374 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 05:46:02.210398 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.210396 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 05:46:02.210507 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.210403 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 05:46:02.210507 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.210408 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 05:46:02.210507 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.210414 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 05:46:02.210507 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.210421 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 05:46:02.210507 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.210428 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 05:46:02.210507 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.210443 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 05:46:02.210507 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.210450 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 05:46:02.211239 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.211228 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 05:46:02.211272 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.211240 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 05:46:02.214988 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.214975 2575 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 05:46:02.215042 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.215022 2575 server.go:1295] "Started kubelet" Jun 02 05:46:02.215204 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.215133 2575 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 05:46:02.215315 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.215220 2575 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 05:46:02.215315 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.215141 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 05:46:02.215775 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.215753 2575 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-52.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 05:46:02.215829 ip-10-0-134-52 systemd[1]: Started Kubernetes Kubelet. Jun 02 05:46:02.215993 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:02.215876 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-52.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 05:46:02.215993 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:02.215889 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 05:46:02.216438 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.216339 2575 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 05:46:02.216914 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.216796 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zh2tg" Jun 02 05:46:02.219149 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.219127 2575 server.go:317] "Adding debug handlers to kubelet server" Jun 02 05:46:02.221699 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.221679 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zh2tg" Jun 02 05:46:02.222932 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:02.222013 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-52.ec2.internal.18b52d6a49551447 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-52.ec2.internal,UID:ip-10-0-134-52.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-52.ec2.internal,},FirstTimestamp:2026-06-02 05:46:02.214995015 +0000 UTC m=+0.346875898,LastTimestamp:2026-06-02 05:46:02.214995015 +0000 UTC m=+0.346875898,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-52.ec2.internal,}" Jun 02 05:46:02.223091 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.223062 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 05:46:02.223417 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:02.223389 2575 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 05:46:02.223485 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.223436 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 05:46:02.223598 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.223575 2575 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 05:46:02.223598 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.223595 2575 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 05:46:02.223774 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.223714 2575 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 05:46:02.223828 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.223800 2575 reconstruct.go:97] "Volume reconstruction finished" Jun 02 05:46:02.223828 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.223808 2575 reconciler.go:26] "Reconciler: start to sync state" Jun 02 05:46:02.224131 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.224113 2575 factory.go:55] Registering systemd factory Jun 02 05:46:02.224215 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.224134 2575 factory.go:223] Registration of the systemd container factory successfully Jun 02 05:46:02.224262 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:02.224210 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-52.ec2.internal\" not found" Jun 02 05:46:02.224357 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.224344 2575 factory.go:153] Registering CRI-O factory Jun 02 05:46:02.224357 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.224357 2575 factory.go:223] Registration of the crio container factory successfully Jun 02 05:46:02.224433 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.224416 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 05:46:02.224469 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.224435 2575 factory.go:103] Registering Raw factory Jun 02 05:46:02.224469 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.224456 2575 manager.go:1196] Started watching for new ooms in manager Jun 02 05:46:02.224917 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.224901 2575 manager.go:319] Starting recovery of all containers Jun 02 05:46:02.227981 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.227931 2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 05:46:02.231416 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:02.231391 2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-52.ec2.internal\" not found" node="ip-10-0-134-52.ec2.internal" Jun 02 05:46:02.235127 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.235111 2575 manager.go:324] Recovery completed Jun 02 05:46:02.239172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.239158 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 05:46:02.240902 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.240885 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientMemory" Jun 02 05:46:02.240962 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.240916 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 05:46:02.240962 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.240926 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientPID" Jun 02 05:46:02.241431 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.241418 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 05:46:02.241485 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.241430 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 05:46:02.241485 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.241448 2575 state_mem.go:36] "Initialized new in-memory state store" Jun 02 05:46:02.243544 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.243532 2575 policy_none.go:49] "None policy: Start" Jun 02 05:46:02.243597 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.243548 2575 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 05:46:02.243597 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.243559 2575 state_mem.go:35] "Initializing new in-memory state store" Jun 02 05:46:02.290458 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.290441 2575 manager.go:341] "Starting Device Plugin manager" Jun 02 05:46:02.291371 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:02.290529 2575 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 05:46:02.291371 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.290545 2575 server.go:85] "Starting device plugin registration server" Jun 02 05:46:02.291371 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.290816 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 05:46:02.291371 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.290832 2575 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 05:46:02.291584 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.290939 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 05:46:02.291584 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.291504 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 05:46:02.291584 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.291513 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 05:46:02.293503 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:02.292653 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 05:46:02.293503 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:02.292708 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-52.ec2.internal\" not found" Jun 02 05:46:02.347894 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.347851 2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 05:46:02.349024 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.349009 2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 05:46:02.349088 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.349036 2575 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 05:46:02.349088 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.349056 2575 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 05:46:02.349088 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.349063 2575 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 05:46:02.349236 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:02.349153 2575 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 05:46:02.351552 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.351534 2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 05:46:02.391467 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.391385 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 05:46:02.392504 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.392485 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientMemory" Jun 02 05:46:02.392595 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.392518 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 05:46:02.392595 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.392531 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientPID" Jun 02 05:46:02.392595 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.392552 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-52.ec2.internal" Jun 02 05:46:02.400779 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.400759 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-52.ec2.internal" Jun 02 05:46:02.400824 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:02.400785 2575 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-52.ec2.internal\": node \"ip-10-0-134-52.ec2.internal\" not found" Jun 02 05:46:02.431388 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:02.431357 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-52.ec2.internal\" not found" Jun 02 05:46:02.449457 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.449418 2575 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-52.ec2.internal"] Jun 02 05:46:02.449518 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.449506 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 05:46:02.451277 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.451261 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientMemory" Jun 02 05:46:02.451383 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.451289 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 05:46:02.451383 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.451303 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientPID" Jun 02 05:46:02.452539 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.452526 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 05:46:02.452675 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.452661 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" Jun 02 05:46:02.452710 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.452693 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 05:46:02.453298 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.453281 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientMemory" Jun 02 05:46:02.453400 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.453285 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientMemory" Jun 02 05:46:02.453400 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.453331 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 05:46:02.453400 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.453343 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientPID" Jun 02 05:46:02.453400 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.453310 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 05:46:02.453400 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.453379 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientPID" Jun 02 05:46:02.454461 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.454446 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-52.ec2.internal" Jun 02 05:46:02.454503 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.454470 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 05:46:02.455139 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.455127 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientMemory" Jun 02 05:46:02.455219 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.455150 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 05:46:02.455219 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.455162 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientPID" Jun 02 05:46:02.473346 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:02.473324 2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-52.ec2.internal\" not found" node="ip-10-0-134-52.ec2.internal" Jun 02 05:46:02.476910 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:02.476883 2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-52.ec2.internal\" not found" node="ip-10-0-134-52.ec2.internal" Jun 02 05:46:02.526003 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.525969 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/56e29088026b32923ea613473ac85f0c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-52.ec2.internal\" (UID: \"56e29088026b32923ea613473ac85f0c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-52.ec2.internal" Jun 02 05:46:02.526003 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.526001 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/daa56026c3c0bcd327234b83e18cad99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal\" (UID: \"daa56026c3c0bcd327234b83e18cad99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" Jun 02 05:46:02.526192 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.526025 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/daa56026c3c0bcd327234b83e18cad99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal\" (UID: \"daa56026c3c0bcd327234b83e18cad99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" Jun 02 05:46:02.531549 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:02.531529 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-52.ec2.internal\" not found" Jun 02 05:46:02.626527 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.626488 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/daa56026c3c0bcd327234b83e18cad99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal\" (UID: \"daa56026c3c0bcd327234b83e18cad99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" Jun 02 05:46:02.626527 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.626521 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/daa56026c3c0bcd327234b83e18cad99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal\" (UID: \"daa56026c3c0bcd327234b83e18cad99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" Jun 02 05:46:02.626718 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.626540 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/56e29088026b32923ea613473ac85f0c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-52.ec2.internal\" (UID: \"56e29088026b32923ea613473ac85f0c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-52.ec2.internal" Jun 02 05:46:02.626718 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.626572 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/56e29088026b32923ea613473ac85f0c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-52.ec2.internal\" (UID: \"56e29088026b32923ea613473ac85f0c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-52.ec2.internal" Jun 02 05:46:02.626718 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.626588 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/daa56026c3c0bcd327234b83e18cad99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal\" (UID: \"daa56026c3c0bcd327234b83e18cad99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" Jun 02 05:46:02.626718 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.626590 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/daa56026c3c0bcd327234b83e18cad99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal\" (UID: \"daa56026c3c0bcd327234b83e18cad99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" Jun 02 05:46:02.632594 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:02.632564 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-52.ec2.internal\" not found" Jun 02 05:46:02.733424 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:02.733353 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-52.ec2.internal\" not found" Jun 02 05:46:02.775549 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.775521 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" Jun 02 05:46:02.780234 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:02.780214 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-52.ec2.internal" Jun 02 05:46:02.834187 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:02.834149 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-52.ec2.internal\" not found" Jun 02 05:46:02.934653 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:02.934620 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-52.ec2.internal\" not found" Jun 02 05:46:03.035184 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:03.035109 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-52.ec2.internal\" not found" Jun 02 05:46:03.135625 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:03.135593 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-52.ec2.internal\" not found" Jun 02 05:46:03.146782 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:03.146758 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 05:46:03.146968 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:03.146895 2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 05:46:03.146968 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:03.146932 2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 05:46:03.223467 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:03.223414 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 05:41:02 +0000 UTC" deadline="2027-12-08 17:09:20.484266919 +0000 UTC" Jun 02 05:46:03.223467 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:03.223462 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13307h23m17.260807866s" Jun 02 05:46:03.223467 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:03.223442 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 05:46:03.235340 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:03.235321 2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 05:46:03.236321 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:03.236304 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-52.ec2.internal\" not found" Jun 02 05:46:03.242702 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:03.242675 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56e29088026b32923ea613473ac85f0c.slice/crio-18acc9cfeaf6d223b4db918962182331868f9e4e3feeb0e1de38c6ce6e67e310 WatchSource:0}: Error finding container 18acc9cfeaf6d223b4db918962182331868f9e4e3feeb0e1de38c6ce6e67e310: Status 404 returned error can't find the container with id 18acc9cfeaf6d223b4db918962182331868f9e4e3feeb0e1de38c6ce6e67e310 Jun 02 05:46:03.242926 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:03.242906 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaa56026c3c0bcd327234b83e18cad99.slice/crio-c9ac9f8d3e3bee3ac361809d3edc217305a429002537471b6b363c3c743cc699 WatchSource:0}: Error finding container c9ac9f8d3e3bee3ac361809d3edc217305a429002537471b6b363c3c743cc699: Status 404 returned error can't find the container with id c9ac9f8d3e3bee3ac361809d3edc217305a429002537471b6b363c3c743cc699 Jun 02 05:46:03.246189 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:03.246171 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 05:46:03.256640 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:03.256622 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-slsfd" Jun 02 05:46:03.264650 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:03.264632 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-slsfd" Jun 02 05:46:03.336512 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:03.336487 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-52.ec2.internal\" not found" Jun 02 05:46:03.352635 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:03.352580 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-52.ec2.internal" event={"ID":"56e29088026b32923ea613473ac85f0c","Type":"ContainerStarted","Data":"18acc9cfeaf6d223b4db918962182331868f9e4e3feeb0e1de38c6ce6e67e310"} Jun 02 05:46:03.353508 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:03.353489 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" event={"ID":"daa56026c3c0bcd327234b83e18cad99","Type":"ContainerStarted","Data":"c9ac9f8d3e3bee3ac361809d3edc217305a429002537471b6b363c3c743cc699"} Jun 02 05:46:03.385114 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:03.385093 2575 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 05:46:03.432543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:03.432525 2575 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 05:46:03.524588 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:03.524562 2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" Jun 02 05:46:03.536368 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:03.536349 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 05:46:03.537072 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:03.537060 2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-52.ec2.internal" Jun 02 05:46:03.543034 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:03.543016 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 05:46:04.203820 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.203789 2575 apiserver.go:52] "Watching apiserver" Jun 02 05:46:04.210113 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.210089 2575 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 05:46:04.210545 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.210525 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal","openshift-network-diagnostics/network-check-target-vjzk2","openshift-network-operator/iptables-alerter-7b68p","openshift-ovn-kubernetes/ovnkube-node-j46gm","kube-system/konnectivity-agent-6krts","kube-system/kube-apiserver-proxy-ip-10-0-134-52.ec2.internal","openshift-cluster-node-tuning-operator/tuned-fj2n7","openshift-dns/node-resolver-zhf22","openshift-image-registry/node-ca-c9qtg","openshift-multus/multus-additional-cni-plugins-snm6d","openshift-multus/multus-jwslr","openshift-multus/network-metrics-daemon-6btlj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh"] Jun 02 05:46:04.212091 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.212067 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.213146 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.213125 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:04.213272 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:04.213208 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjzk2" podUID="115aa003-3fbb-4c9f-b05b-73d987ad9290" Jun 02 05:46:04.214460 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.214430 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7b68p" Jun 02 05:46:04.215254 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.215069 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m5v8f\"" Jun 02 05:46:04.215780 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.215572 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 05:46:04.215780 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.215711 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 05:46:04.216846 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.216806 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 05:46:04.217230 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.217129 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.217534 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.217506 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 05:46:04.217633 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.217507 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4bvrl\"" Jun 02 05:46:04.218314 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.218296 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6krts" Jun 02 05:46:04.218717 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.218677 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 05:46:04.219508 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.219488 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 05:46:04.219617 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.219595 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 05:46:04.219617 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.219601 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 05:46:04.219915 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.219896 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 05:46:04.219915 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.219908 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4k2pt\"" Jun 02 05:46:04.220064 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.220031 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zhf22" Jun 02 05:46:04.220233 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.220212 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 05:46:04.220453 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.220434 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 05:46:04.220668 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.220619 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 05:46:04.220790 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.220705 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 05:46:04.220790 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.220710 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b2dzm\"" Jun 02 05:46:04.221556 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.221535 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c9qtg" Jun 02 05:46:04.222379 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.222359 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-s8ljd\"" Jun 02 05:46:04.222460 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.222406 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 05:46:04.222519 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.222411 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 05:46:04.222952 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.222933 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.223716 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.223699 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 05:46:04.224783 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.224644 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 05:46:04.224783 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.224666 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 05:46:04.224783 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.224762 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7nbjh\"" Jun 02 05:46:04.225373 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.225345 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 05:46:04.225373 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.225370 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 05:46:04.225507 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.225440 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 05:46:04.225565 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.225546 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5c9kn\"" Jun 02 05:46:04.225618 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.225588 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 05:46:04.225702 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.225678 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.225818 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.225763 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 05:46:04.227060 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.227038 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" Jun 02 05:46:04.227132 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.227077 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:04.227317 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:04.227208 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6btlj" podUID="e1171123-67a2-45d0-b42e-c0b5c97d9e5a" Jun 02 05:46:04.227908 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.227797 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qq9pk\"" Jun 02 05:46:04.227908 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.227820 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 05:46:04.229048 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.229029 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 05:46:04.229338 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.229321 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 05:46:04.229469 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.229455 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 05:46:04.229596 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.229579 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9275p\"" Jun 02 05:46:04.235690 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.235669 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-host-run-k8s-cni-cncf-io\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.235808 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.235707 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-multus-conf-dir\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.235808 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.235748 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-etc-openvswitch\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.235808 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.235783 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-ovn-node-metrics-cert\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.235951 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.235810 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/50b96b68-af8d-432e-ab2d-b682a7154685-hosts-file\") pod \"node-resolver-zhf22\" (UID: \"50b96b68-af8d-432e-ab2d-b682a7154685\") " pod="openshift-dns/node-resolver-zhf22" Jun 02 05:46:04.235951 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.235832 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed81080d-7e5f-4b48-afc2-084a239754c3-serviceca\") pod \"node-ca-c9qtg\" (UID: \"ed81080d-7e5f-4b48-afc2-084a239754c3\") " pod="openshift-image-registry/node-ca-c9qtg" Jun 02 05:46:04.235951 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.235855 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-host-run-netns\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.235951 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.235925 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-etc-sysconfig\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.235951 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.235945 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-etc-kubernetes\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.236139 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.235973 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-var-lib-kubelet\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.236139 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.235995 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-os-release\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.236139 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236035 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5df71152-0932-428b-912f-f306f58d218d-multus-daemon-config\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.236139 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236062 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-etc-sysctl-d\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.236139 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236083 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-etc-systemd\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.236139 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236101 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-lib-modules\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.236390 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236142 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-etc-tuned\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.236390 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236165 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-ovnkube-script-lib\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.236390 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236207 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4456caea-7bd5-49b4-9507-f27c71422e4c-agent-certs\") pod \"konnectivity-agent-6krts\" (UID: \"4456caea-7bd5-49b4-9507-f27c71422e4c\") " pod="kube-system/konnectivity-agent-6krts" Jun 02 05:46:04.236390 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236235 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50b96b68-af8d-432e-ab2d-b682a7154685-tmp-dir\") pod \"node-resolver-zhf22\" (UID: \"50b96b68-af8d-432e-ab2d-b682a7154685\") " pod="openshift-dns/node-resolver-zhf22" Jun 02 05:46:04.236390 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236266 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-sys\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.236390 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236300 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-env-overrides\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.236390 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236328 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33b0e317-106f-4fc8-a724-25108da4bb2c-system-cni-dir\") pod \"multus-additional-cni-plugins-snm6d\" (UID: \"33b0e317-106f-4fc8-a724-25108da4bb2c\") " pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.236390 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236343 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5df71152-0932-428b-912f-f306f58d218d-cni-binary-copy\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.236390 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236363 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-run-ovn\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.236390 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236386 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-etc-modprobe-d\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.236764 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236405 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-host\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.236764 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236418 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-host-run-netns\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.236764 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236435 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-node-log\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.236764 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236467 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-log-socket\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.236764 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236509 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed81080d-7e5f-4b48-afc2-084a239754c3-host\") pod \"node-ca-c9qtg\" (UID: \"ed81080d-7e5f-4b48-afc2-084a239754c3\") " pod="openshift-image-registry/node-ca-c9qtg" Jun 02 05:46:04.236764 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236572 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6f137b2e-c670-4aa4-919d-d6926029b2c9-iptables-alerter-script\") pod \"iptables-alerter-7b68p\" (UID: \"6f137b2e-c670-4aa4-919d-d6926029b2c9\") " pod="openshift-network-operator/iptables-alerter-7b68p" Jun 02 05:46:04.236764 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236593 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-systemd-units\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.236764 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236606 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-cnibin\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.236764 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236629 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-multus-socket-dir-parent\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.236764 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236658 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33b0e317-106f-4fc8-a724-25108da4bb2c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-snm6d\" (UID: \"33b0e317-106f-4fc8-a724-25108da4bb2c\") " pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.236764 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236739 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-system-cni-dir\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.236764 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236763 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-host-run-multus-certs\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.237265 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236784 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-run\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.237265 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236806 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f137b2e-c670-4aa4-919d-d6926029b2c9-host-slash\") pod \"iptables-alerter-7b68p\" (UID: \"6f137b2e-c670-4aa4-919d-d6926029b2c9\") " pod="openshift-network-operator/iptables-alerter-7b68p" Jun 02 05:46:04.237265 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236827 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-host-cni-netd\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.237265 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236864 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/33b0e317-106f-4fc8-a724-25108da4bb2c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-snm6d\" (UID: \"33b0e317-106f-4fc8-a724-25108da4bb2c\") " pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.237265 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236897 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-host-var-lib-kubelet\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.237265 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236919 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-tmp\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.237265 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236940 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-host-kubelet\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.237265 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236973 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-host-run-ovn-kubernetes\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.237265 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.236998 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.237265 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.237042 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33b0e317-106f-4fc8-a724-25108da4bb2c-cnibin\") pod \"multus-additional-cni-plugins-snm6d\" (UID: \"33b0e317-106f-4fc8-a724-25108da4bb2c\") " pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.237265 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.237065 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-host-var-lib-cni-bin\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.237265 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.237095 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-host-var-lib-cni-multus\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.237816 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.237420 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzmm4\" (UniqueName: \"kubernetes.io/projected/115aa003-3fbb-4c9f-b05b-73d987ad9290-kube-api-access-vzmm4\") pod \"network-check-target-vjzk2\" (UID: \"115aa003-3fbb-4c9f-b05b-73d987ad9290\") " pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:04.237816 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.237468 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmt69\" (UniqueName: \"kubernetes.io/projected/6f137b2e-c670-4aa4-919d-d6926029b2c9-kube-api-access-wmt69\") pod \"iptables-alerter-7b68p\" (UID: \"6f137b2e-c670-4aa4-919d-d6926029b2c9\") " pod="openshift-network-operator/iptables-alerter-7b68p" Jun 02 05:46:04.237816 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.237585 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-host-slash\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.237816 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.237632 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-run-systemd\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.237816 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.237777 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-var-lib-openvswitch\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.238051 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.237949 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33b0e317-106f-4fc8-a724-25108da4bb2c-cni-binary-copy\") pod \"multus-additional-cni-plugins-snm6d\" (UID: \"33b0e317-106f-4fc8-a724-25108da4bb2c\") " pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.238051 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.237991 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/33b0e317-106f-4fc8-a724-25108da4bb2c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-snm6d\" (UID: \"33b0e317-106f-4fc8-a724-25108da4bb2c\") " pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.238137 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.238076 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-multus-cni-dir\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.238186 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.238144 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmqx7\" (UniqueName: \"kubernetes.io/projected/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-kube-api-access-zmqx7\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.238249 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.238202 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4khr\" (UniqueName: \"kubernetes.io/projected/33b0e317-106f-4fc8-a724-25108da4bb2c-kube-api-access-k4khr\") pod \"multus-additional-cni-plugins-snm6d\" (UID: \"33b0e317-106f-4fc8-a724-25108da4bb2c\") " pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.238308 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.238259 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7vm7\" (UniqueName: \"kubernetes.io/projected/5df71152-0932-428b-912f-f306f58d218d-kube-api-access-g7vm7\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.238308 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.238293 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-ovnkube-config\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.238412 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.238340 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bkc8\" (UniqueName: \"kubernetes.io/projected/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-kube-api-access-9bkc8\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.238500 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.238470 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-hostroot\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.238641 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.238509 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-etc-kubernetes\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.238641 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.238545 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-host-cni-bin\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.238641 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.238571 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-etc-sysctl-conf\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.238641 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.238620 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-run-openvswitch\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.238848 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.238736 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4456caea-7bd5-49b4-9507-f27c71422e4c-konnectivity-ca\") pod \"konnectivity-agent-6krts\" (UID: \"4456caea-7bd5-49b4-9507-f27c71422e4c\") " pod="kube-system/konnectivity-agent-6krts" Jun 02 05:46:04.238848 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.238787 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqbx2\" (UniqueName: \"kubernetes.io/projected/50b96b68-af8d-432e-ab2d-b682a7154685-kube-api-access-pqbx2\") pod \"node-resolver-zhf22\" (UID: \"50b96b68-af8d-432e-ab2d-b682a7154685\") " pod="openshift-dns/node-resolver-zhf22" Jun 02 05:46:04.238848 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.238836 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33b0e317-106f-4fc8-a724-25108da4bb2c-os-release\") pod \"multus-additional-cni-plugins-snm6d\" (UID: \"33b0e317-106f-4fc8-a724-25108da4bb2c\") " pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.238986 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.238903 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsmss\" (UniqueName: \"kubernetes.io/projected/ed81080d-7e5f-4b48-afc2-084a239754c3-kube-api-access-zsmss\") pod \"node-ca-c9qtg\" (UID: \"ed81080d-7e5f-4b48-afc2-084a239754c3\") " pod="openshift-image-registry/node-ca-c9qtg" Jun 02 05:46:04.264050 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.264017 2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 05:46:04.265318 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.265288 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 05:41:03 +0000 UTC" deadline="2027-12-18 19:07:45.420626458 +0000 UTC" Jun 02 05:46:04.265413 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.265318 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13549h21m41.155311995s" Jun 02 05:46:04.324681 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.324656 2575 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 05:46:04.339177 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.339144 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-etc-openvswitch\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.339177 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.339187 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-ovn-node-metrics-cert\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.339399 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.339215 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/50b96b68-af8d-432e-ab2d-b682a7154685-hosts-file\") pod \"node-resolver-zhf22\" (UID: \"50b96b68-af8d-432e-ab2d-b682a7154685\") " pod="openshift-dns/node-resolver-zhf22" Jun 02 05:46:04.339399 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.339241 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed81080d-7e5f-4b48-afc2-084a239754c3-serviceca\") pod \"node-ca-c9qtg\" (UID: \"ed81080d-7e5f-4b48-afc2-084a239754c3\") " pod="openshift-image-registry/node-ca-c9qtg" Jun 02 05:46:04.339399 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.339265 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-etc-openvswitch\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.339399 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.339319 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-host-run-netns\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.339399 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.339352 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/50b96b68-af8d-432e-ab2d-b682a7154685-hosts-file\") pod \"node-resolver-zhf22\" (UID: \"50b96b68-af8d-432e-ab2d-b682a7154685\") " pod="openshift-dns/node-resolver-zhf22" Jun 02 05:46:04.340199 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.339658 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 05:46:04.340546 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.339266 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-host-run-netns\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.340647 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.340593 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-etc-sysconfig\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.340647 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.340624 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-etc-kubernetes\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.340647 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.340643 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-var-lib-kubelet\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.340813 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.340663 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4400e13b-ecae-4ece-869f-8b003510bf52-socket-dir\") pod \"aws-ebs-csi-driver-node-5g9lh\" (UID: \"4400e13b-ecae-4ece-869f-8b003510bf52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" Jun 02 05:46:04.340813 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.340684 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-os-release\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.340813 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.340711 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5df71152-0932-428b-912f-f306f58d218d-multus-daemon-config\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.340813 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.340749 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-etc-sysctl-d\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.340813 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.340773 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-etc-systemd\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.340813 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.340810 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-lib-modules\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.341088 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.340831 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-etc-tuned\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.341088 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.340832 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-var-lib-kubelet\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.341088 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.340891 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-etc-sysconfig\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.341088 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.340907 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-etc-kubernetes\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.341088 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.340931 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-ovnkube-script-lib\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.341088 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.340965 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4456caea-7bd5-49b4-9507-f27c71422e4c-agent-certs\") pod \"konnectivity-agent-6krts\" (UID: \"4456caea-7bd5-49b4-9507-f27c71422e4c\") " pod="kube-system/konnectivity-agent-6krts" Jun 02 05:46:04.341088 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.340993 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50b96b68-af8d-432e-ab2d-b682a7154685-tmp-dir\") pod \"node-resolver-zhf22\" (UID: \"50b96b68-af8d-432e-ab2d-b682a7154685\") " pod="openshift-dns/node-resolver-zhf22" Jun 02 05:46:04.341088 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341021 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-sys\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.341088 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341047 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-env-overrides\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.341513 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341120 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-etc-sysctl-d\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.341513 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341122 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs\") pod \"network-metrics-daemon-6btlj\" (UID: \"e1171123-67a2-45d0-b42e-c0b5c97d9e5a\") " pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:04.341513 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341137 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-lib-modules\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.341513 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.340352 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed81080d-7e5f-4b48-afc2-084a239754c3-serviceca\") pod \"node-ca-c9qtg\" (UID: \"ed81080d-7e5f-4b48-afc2-084a239754c3\") " pod="openshift-image-registry/node-ca-c9qtg" Jun 02 05:46:04.341513 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341176 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33b0e317-106f-4fc8-a724-25108da4bb2c-system-cni-dir\") pod \"multus-additional-cni-plugins-snm6d\" (UID: \"33b0e317-106f-4fc8-a724-25108da4bb2c\") " pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.341513 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341204 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5df71152-0932-428b-912f-f306f58d218d-cni-binary-copy\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.341513 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341232 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-run-ovn\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.341513 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341261 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jcb8\" (UniqueName: \"kubernetes.io/projected/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-kube-api-access-2jcb8\") pod \"network-metrics-daemon-6btlj\" (UID: \"e1171123-67a2-45d0-b42e-c0b5c97d9e5a\") " pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:04.341513 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341289 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-etc-modprobe-d\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.341513 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341314 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-host\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.341513 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341342 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-host-run-netns\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.341513 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341366 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-node-log\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.341513 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341408 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-log-socket\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.341513 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341433 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed81080d-7e5f-4b48-afc2-084a239754c3-host\") pod \"node-ca-c9qtg\" (UID: \"ed81080d-7e5f-4b48-afc2-084a239754c3\") " pod="openshift-image-registry/node-ca-c9qtg" Jun 02 05:46:04.341513 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341435 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50b96b68-af8d-432e-ab2d-b682a7154685-tmp-dir\") pod \"node-resolver-zhf22\" (UID: \"50b96b68-af8d-432e-ab2d-b682a7154685\") " pod="openshift-dns/node-resolver-zhf22" Jun 02 05:46:04.341513 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341462 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6f137b2e-c670-4aa4-919d-d6926029b2c9-iptables-alerter-script\") pod \"iptables-alerter-7b68p\" (UID: \"6f137b2e-c670-4aa4-919d-d6926029b2c9\") " pod="openshift-network-operator/iptables-alerter-7b68p" Jun 02 05:46:04.341513 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341492 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-systemd-units\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.342312 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341498 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33b0e317-106f-4fc8-a724-25108da4bb2c-system-cni-dir\") pod \"multus-additional-cni-plugins-snm6d\" (UID: \"33b0e317-106f-4fc8-a724-25108da4bb2c\") " pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.342312 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341530 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-etc-systemd\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.342312 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341521 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4400e13b-ecae-4ece-869f-8b003510bf52-sys-fs\") pod \"aws-ebs-csi-driver-node-5g9lh\" (UID: \"4400e13b-ecae-4ece-869f-8b003510bf52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" Jun 02 05:46:04.342312 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341437 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5df71152-0932-428b-912f-f306f58d218d-multus-daemon-config\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.342312 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341548 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-sys\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.342312 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341590 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-run-ovn\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.342312 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341614 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-env-overrides\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.342312 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341640 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-systemd-units\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.342312 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341665 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-cnibin\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.342312 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341679 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed81080d-7e5f-4b48-afc2-084a239754c3-host\") pod \"node-ca-c9qtg\" (UID: \"ed81080d-7e5f-4b48-afc2-084a239754c3\") " pod="openshift-image-registry/node-ca-c9qtg" Jun 02 05:46:04.342312 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341696 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-multus-socket-dir-parent\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.342312 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341713 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-node-log\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.342312 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341754 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33b0e317-106f-4fc8-a724-25108da4bb2c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-snm6d\" (UID: \"33b0e317-106f-4fc8-a724-25108da4bb2c\") " pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.342312 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341763 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-log-socket\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.342312 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341804 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-system-cni-dir\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.342312 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341831 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-host-run-multus-certs\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.342312 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341846 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-multus-socket-dir-parent\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.342312 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341861 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-run\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.343166 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341896 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f137b2e-c670-4aa4-919d-d6926029b2c9-host-slash\") pod \"iptables-alerter-7b68p\" (UID: \"6f137b2e-c670-4aa4-919d-d6926029b2c9\") " pod="openshift-network-operator/iptables-alerter-7b68p" Jun 02 05:46:04.343166 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341804 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-host-run-netns\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.343166 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341911 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-ovnkube-script-lib\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.343166 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341945 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-host-cni-netd\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.343166 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341973 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-cnibin\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.343166 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341974 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/33b0e317-106f-4fc8-a724-25108da4bb2c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-snm6d\" (UID: \"33b0e317-106f-4fc8-a724-25108da4bb2c\") " pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.343166 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342006 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-host-var-lib-kubelet\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.343166 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342024 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-system-cni-dir\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.343166 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342030 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-tmp\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.343166 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342056 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-etc-modprobe-d\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.343166 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.341977 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33b0e317-106f-4fc8-a724-25108da4bb2c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-snm6d\" (UID: \"33b0e317-106f-4fc8-a724-25108da4bb2c\") " pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.343166 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342100 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-host-kubelet\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.343166 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342103 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5df71152-0932-428b-912f-f306f58d218d-cni-binary-copy\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.343166 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342109 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-run\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.343166 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342131 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-host-run-ovn-kubernetes\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.343166 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342136 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f137b2e-c670-4aa4-919d-d6926029b2c9-host-slash\") pod \"iptables-alerter-7b68p\" (UID: \"6f137b2e-c670-4aa4-919d-d6926029b2c9\") " pod="openshift-network-operator/iptables-alerter-7b68p" Jun 02 05:46:04.343166 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342133 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6f137b2e-c670-4aa4-919d-d6926029b2c9-iptables-alerter-script\") pod \"iptables-alerter-7b68p\" (UID: \"6f137b2e-c670-4aa4-919d-d6926029b2c9\") " pod="openshift-network-operator/iptables-alerter-7b68p" Jun 02 05:46:04.343166 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342133 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-host-var-lib-kubelet\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.343976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342102 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-host\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.343976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342163 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-host-cni-netd\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.343976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342161 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.343976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342195 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-host-run-ovn-kubernetes\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.343976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342201 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4400e13b-ecae-4ece-869f-8b003510bf52-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5g9lh\" (UID: \"4400e13b-ecae-4ece-869f-8b003510bf52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" Jun 02 05:46:04.343976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342210 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-host-run-multus-certs\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.343976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342230 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-host-kubelet\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.343976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342248 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33b0e317-106f-4fc8-a724-25108da4bb2c-cnibin\") pod \"multus-additional-cni-plugins-snm6d\" (UID: \"33b0e317-106f-4fc8-a724-25108da4bb2c\") " pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.343976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342275 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-host-var-lib-cni-bin\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.343976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342310 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.343976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342313 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33b0e317-106f-4fc8-a724-25108da4bb2c-cnibin\") pod \"multus-additional-cni-plugins-snm6d\" (UID: \"33b0e317-106f-4fc8-a724-25108da4bb2c\") " pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.343976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342341 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-host-var-lib-cni-multus\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.343976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342364 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-host-var-lib-cni-bin\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.343976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342411 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vzmm4\" (UniqueName: \"kubernetes.io/projected/115aa003-3fbb-4c9f-b05b-73d987ad9290-kube-api-access-vzmm4\") pod \"network-check-target-vjzk2\" (UID: \"115aa003-3fbb-4c9f-b05b-73d987ad9290\") " pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:04.343976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342451 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wmt69\" (UniqueName: \"kubernetes.io/projected/6f137b2e-c670-4aa4-919d-d6926029b2c9-kube-api-access-wmt69\") pod \"iptables-alerter-7b68p\" (UID: \"6f137b2e-c670-4aa4-919d-d6926029b2c9\") " pod="openshift-network-operator/iptables-alerter-7b68p" Jun 02 05:46:04.343976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342477 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-host-slash\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.343976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342520 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-run-systemd\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.344818 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342549 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4400e13b-ecae-4ece-869f-8b003510bf52-etc-selinux\") pod \"aws-ebs-csi-driver-node-5g9lh\" (UID: \"4400e13b-ecae-4ece-869f-8b003510bf52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" Jun 02 05:46:04.344818 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342577 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-var-lib-openvswitch\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.344818 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342603 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33b0e317-106f-4fc8-a724-25108da4bb2c-cni-binary-copy\") pod \"multus-additional-cni-plugins-snm6d\" (UID: \"33b0e317-106f-4fc8-a724-25108da4bb2c\") " pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.344818 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342683 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/33b0e317-106f-4fc8-a724-25108da4bb2c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-snm6d\" (UID: \"33b0e317-106f-4fc8-a724-25108da4bb2c\") " pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.344818 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342690 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-var-lib-openvswitch\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.344818 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342737 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-multus-cni-dir\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.344818 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342769 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zmqx7\" (UniqueName: \"kubernetes.io/projected/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-kube-api-access-zmqx7\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.344818 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342805 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf48f\" (UniqueName: \"kubernetes.io/projected/4400e13b-ecae-4ece-869f-8b003510bf52-kube-api-access-jf48f\") pod \"aws-ebs-csi-driver-node-5g9lh\" (UID: \"4400e13b-ecae-4ece-869f-8b003510bf52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" Jun 02 05:46:04.344818 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342856 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k4khr\" (UniqueName: \"kubernetes.io/projected/33b0e317-106f-4fc8-a724-25108da4bb2c-kube-api-access-k4khr\") pod \"multus-additional-cni-plugins-snm6d\" (UID: \"33b0e317-106f-4fc8-a724-25108da4bb2c\") " pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.344818 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.342964 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g7vm7\" (UniqueName: \"kubernetes.io/projected/5df71152-0932-428b-912f-f306f58d218d-kube-api-access-g7vm7\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.344818 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343007 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-host-var-lib-cni-multus\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.344818 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343020 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-ovnkube-config\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.344818 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343046 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bkc8\" (UniqueName: \"kubernetes.io/projected/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-kube-api-access-9bkc8\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.344818 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343059 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/33b0e317-106f-4fc8-a724-25108da4bb2c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-snm6d\" (UID: \"33b0e317-106f-4fc8-a724-25108da4bb2c\") " pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.344818 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343075 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4400e13b-ecae-4ece-869f-8b003510bf52-registration-dir\") pod \"aws-ebs-csi-driver-node-5g9lh\" (UID: \"4400e13b-ecae-4ece-869f-8b003510bf52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" Jun 02 05:46:04.344818 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343102 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-hostroot\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.344818 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343115 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-run-systemd\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.345330 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343129 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-etc-kubernetes\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.345330 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343159 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-ovn-node-metrics-cert\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.345330 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343199 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-etc-kubernetes\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.345330 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343254 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-hostroot\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.345330 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343442 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33b0e317-106f-4fc8-a724-25108da4bb2c-cni-binary-copy\") pod \"multus-additional-cni-plugins-snm6d\" (UID: \"33b0e317-106f-4fc8-a724-25108da4bb2c\") " pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.345330 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343455 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-host-cni-bin\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.345330 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343488 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-host-slash\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.345330 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343490 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4400e13b-ecae-4ece-869f-8b003510bf52-device-dir\") pod \"aws-ebs-csi-driver-node-5g9lh\" (UID: \"4400e13b-ecae-4ece-869f-8b003510bf52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" Jun 02 05:46:04.345330 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343532 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-etc-sysctl-conf\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.345330 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343543 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-host-cni-bin\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.345330 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343551 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-multus-cni-dir\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.345330 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343593 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-run-openvswitch\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.345330 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343599 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/33b0e317-106f-4fc8-a724-25108da4bb2c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-snm6d\" (UID: \"33b0e317-106f-4fc8-a724-25108da4bb2c\") " pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.345330 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343648 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-run-openvswitch\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.345330 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343650 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4456caea-7bd5-49b4-9507-f27c71422e4c-konnectivity-ca\") pod \"konnectivity-agent-6krts\" (UID: \"4456caea-7bd5-49b4-9507-f27c71422e4c\") " pod="kube-system/konnectivity-agent-6krts" Jun 02 05:46:04.345330 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343683 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqbx2\" (UniqueName: \"kubernetes.io/projected/50b96b68-af8d-432e-ab2d-b682a7154685-kube-api-access-pqbx2\") pod \"node-resolver-zhf22\" (UID: \"50b96b68-af8d-432e-ab2d-b682a7154685\") " pod="openshift-dns/node-resolver-zhf22" Jun 02 05:46:04.345330 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343688 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-etc-sysctl-conf\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.345984 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343713 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33b0e317-106f-4fc8-a724-25108da4bb2c-os-release\") pod \"multus-additional-cni-plugins-snm6d\" (UID: \"33b0e317-106f-4fc8-a724-25108da4bb2c\") " pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.345984 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343779 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zsmss\" (UniqueName: \"kubernetes.io/projected/ed81080d-7e5f-4b48-afc2-084a239754c3-kube-api-access-zsmss\") pod \"node-ca-c9qtg\" (UID: \"ed81080d-7e5f-4b48-afc2-084a239754c3\") " pod="openshift-image-registry/node-ca-c9qtg" Jun 02 05:46:04.345984 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343807 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-host-run-k8s-cni-cncf-io\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.345984 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343854 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-host-run-k8s-cni-cncf-io\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.345984 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343870 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33b0e317-106f-4fc8-a724-25108da4bb2c-os-release\") pod \"multus-additional-cni-plugins-snm6d\" (UID: \"33b0e317-106f-4fc8-a724-25108da4bb2c\") " pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.345984 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.343888 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-multus-conf-dir\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.345984 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.344041 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-multus-conf-dir\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.345984 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.344072 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-ovnkube-config\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.345984 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.344059 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5df71152-0932-428b-912f-f306f58d218d-os-release\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.345984 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.344300 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4456caea-7bd5-49b4-9507-f27c71422e4c-konnectivity-ca\") pod \"konnectivity-agent-6krts\" (UID: \"4456caea-7bd5-49b4-9507-f27c71422e4c\") " pod="kube-system/konnectivity-agent-6krts" Jun 02 05:46:04.345984 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.345115 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4456caea-7bd5-49b4-9507-f27c71422e4c-agent-certs\") pod \"konnectivity-agent-6krts\" (UID: \"4456caea-7bd5-49b4-9507-f27c71422e4c\") " pod="kube-system/konnectivity-agent-6krts" Jun 02 05:46:04.345984 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.345713 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-tmp\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.346449 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.346242 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-etc-tuned\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.356337 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.354361 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmt69\" (UniqueName: \"kubernetes.io/projected/6f137b2e-c670-4aa4-919d-d6926029b2c9-kube-api-access-wmt69\") pod \"iptables-alerter-7b68p\" (UID: \"6f137b2e-c670-4aa4-919d-d6926029b2c9\") " pod="openshift-network-operator/iptables-alerter-7b68p" Jun 02 05:46:04.356337 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.354786 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4khr\" (UniqueName: \"kubernetes.io/projected/33b0e317-106f-4fc8-a724-25108da4bb2c-kube-api-access-k4khr\") pod \"multus-additional-cni-plugins-snm6d\" (UID: \"33b0e317-106f-4fc8-a724-25108da4bb2c\") " pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.356799 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.356766 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7vm7\" (UniqueName: \"kubernetes.io/projected/5df71152-0932-428b-912f-f306f58d218d-kube-api-access-g7vm7\") pod \"multus-jwslr\" (UID: \"5df71152-0932-428b-912f-f306f58d218d\") " pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.357874 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:04.357150 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 05:46:04.357874 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:04.357175 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 05:46:04.357874 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:04.357189 2575 projected.go:194] Error preparing data for projected volume kube-api-access-vzmm4 for pod openshift-network-diagnostics/network-check-target-vjzk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:46:04.357874 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:04.357478 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/115aa003-3fbb-4c9f-b05b-73d987ad9290-kube-api-access-vzmm4 podName:115aa003-3fbb-4c9f-b05b-73d987ad9290 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:04.857431144 +0000 UTC m=+2.989312095 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vzmm4" (UniqueName: "kubernetes.io/projected/115aa003-3fbb-4c9f-b05b-73d987ad9290-kube-api-access-vzmm4") pod "network-check-target-vjzk2" (UID: "115aa003-3fbb-4c9f-b05b-73d987ad9290") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:46:04.358102 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.357934 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqbx2\" (UniqueName: \"kubernetes.io/projected/50b96b68-af8d-432e-ab2d-b682a7154685-kube-api-access-pqbx2\") pod \"node-resolver-zhf22\" (UID: \"50b96b68-af8d-432e-ab2d-b682a7154685\") " pod="openshift-dns/node-resolver-zhf22" Jun 02 05:46:04.359566 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.359538 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmqx7\" (UniqueName: \"kubernetes.io/projected/e7d6b49b-7faa-4b7d-b3ba-2398141c920d-kube-api-access-zmqx7\") pod \"ovnkube-node-j46gm\" (UID: \"e7d6b49b-7faa-4b7d-b3ba-2398141c920d\") " pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.360055 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.360033 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsmss\" (UniqueName: \"kubernetes.io/projected/ed81080d-7e5f-4b48-afc2-084a239754c3-kube-api-access-zsmss\") pod \"node-ca-c9qtg\" (UID: \"ed81080d-7e5f-4b48-afc2-084a239754c3\") " pod="openshift-image-registry/node-ca-c9qtg" Jun 02 05:46:04.360440 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.360421 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bkc8\" (UniqueName: \"kubernetes.io/projected/7e301e42-e23c-4260-a79a-ec6dc54f3c1b-kube-api-access-9bkc8\") pod \"tuned-fj2n7\" (UID: \"7e301e42-e23c-4260-a79a-ec6dc54f3c1b\") " pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.444487 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.444458 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4400e13b-ecae-4ece-869f-8b003510bf52-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5g9lh\" (UID: \"4400e13b-ecae-4ece-869f-8b003510bf52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" Jun 02 05:46:04.444629 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.444507 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4400e13b-ecae-4ece-869f-8b003510bf52-etc-selinux\") pod \"aws-ebs-csi-driver-node-5g9lh\" (UID: \"4400e13b-ecae-4ece-869f-8b003510bf52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" Jun 02 05:46:04.444629 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.444527 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jf48f\" (UniqueName: \"kubernetes.io/projected/4400e13b-ecae-4ece-869f-8b003510bf52-kube-api-access-jf48f\") pod \"aws-ebs-csi-driver-node-5g9lh\" (UID: \"4400e13b-ecae-4ece-869f-8b003510bf52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" Jun 02 05:46:04.444629 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.444578 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4400e13b-ecae-4ece-869f-8b003510bf52-registration-dir\") pod \"aws-ebs-csi-driver-node-5g9lh\" (UID: \"4400e13b-ecae-4ece-869f-8b003510bf52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" Jun 02 05:46:04.444629 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.444604 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4400e13b-ecae-4ece-869f-8b003510bf52-etc-selinux\") pod \"aws-ebs-csi-driver-node-5g9lh\" (UID: \"4400e13b-ecae-4ece-869f-8b003510bf52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" Jun 02 05:46:04.444629 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.444604 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4400e13b-ecae-4ece-869f-8b003510bf52-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5g9lh\" (UID: \"4400e13b-ecae-4ece-869f-8b003510bf52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" Jun 02 05:46:04.445020 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.444609 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4400e13b-ecae-4ece-869f-8b003510bf52-device-dir\") pod \"aws-ebs-csi-driver-node-5g9lh\" (UID: \"4400e13b-ecae-4ece-869f-8b003510bf52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" Jun 02 05:46:04.445020 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.444653 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4400e13b-ecae-4ece-869f-8b003510bf52-registration-dir\") pod \"aws-ebs-csi-driver-node-5g9lh\" (UID: \"4400e13b-ecae-4ece-869f-8b003510bf52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" Jun 02 05:46:04.445020 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.444656 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4400e13b-ecae-4ece-869f-8b003510bf52-device-dir\") pod \"aws-ebs-csi-driver-node-5g9lh\" (UID: \"4400e13b-ecae-4ece-869f-8b003510bf52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" Jun 02 05:46:04.445020 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.444685 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4400e13b-ecae-4ece-869f-8b003510bf52-socket-dir\") pod \"aws-ebs-csi-driver-node-5g9lh\" (UID: \"4400e13b-ecae-4ece-869f-8b003510bf52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" Jun 02 05:46:04.445020 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.444721 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs\") pod \"network-metrics-daemon-6btlj\" (UID: \"e1171123-67a2-45d0-b42e-c0b5c97d9e5a\") " pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:04.445020 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.444768 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2jcb8\" (UniqueName: \"kubernetes.io/projected/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-kube-api-access-2jcb8\") pod \"network-metrics-daemon-6btlj\" (UID: \"e1171123-67a2-45d0-b42e-c0b5c97d9e5a\") " pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:04.445020 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.444782 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4400e13b-ecae-4ece-869f-8b003510bf52-socket-dir\") pod \"aws-ebs-csi-driver-node-5g9lh\" (UID: \"4400e13b-ecae-4ece-869f-8b003510bf52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" Jun 02 05:46:04.445020 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.444800 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4400e13b-ecae-4ece-869f-8b003510bf52-sys-fs\") pod \"aws-ebs-csi-driver-node-5g9lh\" (UID: \"4400e13b-ecae-4ece-869f-8b003510bf52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" Jun 02 05:46:04.445020 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:04.444860 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:46:04.445020 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.444885 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4400e13b-ecae-4ece-869f-8b003510bf52-sys-fs\") pod \"aws-ebs-csi-driver-node-5g9lh\" (UID: \"4400e13b-ecae-4ece-869f-8b003510bf52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" Jun 02 05:46:04.445020 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:04.444929 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs podName:e1171123-67a2-45d0-b42e-c0b5c97d9e5a nodeName:}" failed. No retries permitted until 2026-06-02 05:46:04.944909055 +0000 UTC m=+3.076789939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs") pod "network-metrics-daemon-6btlj" (UID: "e1171123-67a2-45d0-b42e-c0b5c97d9e5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:46:04.458231 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.458136 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf48f\" (UniqueName: \"kubernetes.io/projected/4400e13b-ecae-4ece-869f-8b003510bf52-kube-api-access-jf48f\") pod \"aws-ebs-csi-driver-node-5g9lh\" (UID: \"4400e13b-ecae-4ece-869f-8b003510bf52\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" Jun 02 05:46:04.458231 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.458140 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jcb8\" (UniqueName: \"kubernetes.io/projected/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-kube-api-access-2jcb8\") pod \"network-metrics-daemon-6btlj\" (UID: \"e1171123-67a2-45d0-b42e-c0b5c97d9e5a\") " pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:04.527172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.527136 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" Jun 02 05:46:04.536980 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.536958 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7b68p" Jun 02 05:46:04.545736 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.545694 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:04.550404 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.550375 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6krts" Jun 02 05:46:04.556622 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.556598 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zhf22" Jun 02 05:46:04.563136 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.563119 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c9qtg" Jun 02 05:46:04.568663 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.568646 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-snm6d" Jun 02 05:46:04.576221 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.576196 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jwslr" Jun 02 05:46:04.581821 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.581802 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" Jun 02 05:46:04.672518 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.672489 2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 05:46:04.813989 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:04.813959 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33b0e317_106f_4fc8_a724_25108da4bb2c.slice/crio-5680a6a10c76e9cd2f1d2a4462a04dae61a7bd3e730e9b6e809e93aa0410db46 WatchSource:0}: Error finding container 5680a6a10c76e9cd2f1d2a4462a04dae61a7bd3e730e9b6e809e93aa0410db46: Status 404 returned error can't find the container with id 5680a6a10c76e9cd2f1d2a4462a04dae61a7bd3e730e9b6e809e93aa0410db46 Jun 02 05:46:04.814862 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:04.814837 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e301e42_e23c_4260_a79a_ec6dc54f3c1b.slice/crio-039e4064072cde7d637aea5d220996b372a9cb9f3c7db5ae9a1f47b76c9d843c WatchSource:0}: Error finding container 039e4064072cde7d637aea5d220996b372a9cb9f3c7db5ae9a1f47b76c9d843c: Status 404 returned error can't find the container with id 039e4064072cde7d637aea5d220996b372a9cb9f3c7db5ae9a1f47b76c9d843c Jun 02 05:46:04.815693 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:04.815670 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4456caea_7bd5_49b4_9507_f27c71422e4c.slice/crio-eca1d8bd0ffd53e3a5c060ad43365e963e80e36acdebeb87bbbfc0ac36dfdfdb WatchSource:0}: Error finding container eca1d8bd0ffd53e3a5c060ad43365e963e80e36acdebeb87bbbfc0ac36dfdfdb: Status 404 returned error can't find the container with id eca1d8bd0ffd53e3a5c060ad43365e963e80e36acdebeb87bbbfc0ac36dfdfdb Jun 02 05:46:04.817262 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:04.817070 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4400e13b_ecae_4ece_869f_8b003510bf52.slice/crio-a6c47c2267c52af4eae0d15deb88f6d3c4596bd4920f5412dfeb1daf241ac911 WatchSource:0}: Error finding container a6c47c2267c52af4eae0d15deb88f6d3c4596bd4920f5412dfeb1daf241ac911: Status 404 returned error can't find the container with id a6c47c2267c52af4eae0d15deb88f6d3c4596bd4920f5412dfeb1daf241ac911 Jun 02 05:46:04.818106 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:04.817957 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50b96b68_af8d_432e_ab2d_b682a7154685.slice/crio-d9c097ed2b3f0256a8e511776ace2e8ae10c132942c2b64a2b66e17b5dd2542f WatchSource:0}: Error finding container d9c097ed2b3f0256a8e511776ace2e8ae10c132942c2b64a2b66e17b5dd2542f: Status 404 returned error can't find the container with id d9c097ed2b3f0256a8e511776ace2e8ae10c132942c2b64a2b66e17b5dd2542f Jun 02 05:46:04.820500 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:04.820416 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7d6b49b_7faa_4b7d_b3ba_2398141c920d.slice/crio-4a8596a00b10231b0945231a1395a9f86478bab043ed010fa948d568a0a7a670 WatchSource:0}: Error finding container 4a8596a00b10231b0945231a1395a9f86478bab043ed010fa948d568a0a7a670: Status 404 returned error can't find the container with id 4a8596a00b10231b0945231a1395a9f86478bab043ed010fa948d568a0a7a670 Jun 02 05:46:04.821521 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:04.821491 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded81080d_7e5f_4b48_afc2_084a239754c3.slice/crio-9858e4eaed16faf499a731cfe69ec2114382a293acbba639e98a887680dc3a31 WatchSource:0}: Error finding container 9858e4eaed16faf499a731cfe69ec2114382a293acbba639e98a887680dc3a31: Status 404 returned error can't find the container with id 9858e4eaed16faf499a731cfe69ec2114382a293acbba639e98a887680dc3a31 Jun 02 05:46:04.823199 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:04.823119 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f137b2e_c670_4aa4_919d_d6926029b2c9.slice/crio-d3ef28ea5c5c4439c27e366de0b2ef5cb7362ff648bf5817050a581edd6fda77 WatchSource:0}: Error finding container d3ef28ea5c5c4439c27e366de0b2ef5cb7362ff648bf5817050a581edd6fda77: Status 404 returned error can't find the container with id d3ef28ea5c5c4439c27e366de0b2ef5cb7362ff648bf5817050a581edd6fda77 Jun 02 05:46:04.823975 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:04.823899 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df71152_0932_428b_912f_f306f58d218d.slice/crio-8a6ff75774d77b7a4cbad533c989af313985f632d5a4883c83b7d84fbc9036ee WatchSource:0}: Error finding container 8a6ff75774d77b7a4cbad533c989af313985f632d5a4883c83b7d84fbc9036ee: Status 404 returned error can't find the container with id 8a6ff75774d77b7a4cbad533c989af313985f632d5a4883c83b7d84fbc9036ee Jun 02 05:46:04.948795 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.948760 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vzmm4\" (UniqueName: \"kubernetes.io/projected/115aa003-3fbb-4c9f-b05b-73d987ad9290-kube-api-access-vzmm4\") pod \"network-check-target-vjzk2\" (UID: \"115aa003-3fbb-4c9f-b05b-73d987ad9290\") " pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:04.948933 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:04.948815 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs\") pod \"network-metrics-daemon-6btlj\" (UID: \"e1171123-67a2-45d0-b42e-c0b5c97d9e5a\") " pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:04.948933 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:04.948903 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:46:04.948995 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:04.948927 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 05:46:04.948995 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:04.948946 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 05:46:04.948995 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:04.948958 2575 projected.go:194] Error preparing data for projected volume kube-api-access-vzmm4 for pod openshift-network-diagnostics/network-check-target-vjzk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:46:04.948995 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:04.948967 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs podName:e1171123-67a2-45d0-b42e-c0b5c97d9e5a nodeName:}" failed. No retries permitted until 2026-06-02 05:46:05.948941854 +0000 UTC m=+4.080822723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs") pod "network-metrics-daemon-6btlj" (UID: "e1171123-67a2-45d0-b42e-c0b5c97d9e5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:46:04.949136 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:04.949001 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/115aa003-3fbb-4c9f-b05b-73d987ad9290-kube-api-access-vzmm4 podName:115aa003-3fbb-4c9f-b05b-73d987ad9290 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:05.948987147 +0000 UTC m=+4.080868020 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vzmm4" (UniqueName: "kubernetes.io/projected/115aa003-3fbb-4c9f-b05b-73d987ad9290-kube-api-access-vzmm4") pod "network-check-target-vjzk2" (UID: "115aa003-3fbb-4c9f-b05b-73d987ad9290") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:46:05.266013 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:05.265967 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 05:41:03 +0000 UTC" deadline="2027-12-05 07:16:45.091117622 +0000 UTC" Jun 02 05:46:05.266013 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:05.266010 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13225h30m39.825111224s" Jun 02 05:46:05.350274 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:05.350158 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:05.350433 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:05.350385 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjzk2" podUID="115aa003-3fbb-4c9f-b05b-73d987ad9290" Jun 02 05:46:05.351032 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:05.350869 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:05.351032 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:05.350978 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6btlj" podUID="e1171123-67a2-45d0-b42e-c0b5c97d9e5a" Jun 02 05:46:05.365461 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:05.365297 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c9qtg" event={"ID":"ed81080d-7e5f-4b48-afc2-084a239754c3","Type":"ContainerStarted","Data":"9858e4eaed16faf499a731cfe69ec2114382a293acbba639e98a887680dc3a31"} Jun 02 05:46:05.369409 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:05.369381 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" event={"ID":"4400e13b-ecae-4ece-869f-8b003510bf52","Type":"ContainerStarted","Data":"a6c47c2267c52af4eae0d15deb88f6d3c4596bd4920f5412dfeb1daf241ac911"} Jun 02 05:46:05.379208 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:05.378761 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snm6d" event={"ID":"33b0e317-106f-4fc8-a724-25108da4bb2c","Type":"ContainerStarted","Data":"5680a6a10c76e9cd2f1d2a4462a04dae61a7bd3e730e9b6e809e93aa0410db46"} Jun 02 05:46:05.382343 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:05.382244 2575 generic.go:358] "Generic (PLEG): container finished" podID="daa56026c3c0bcd327234b83e18cad99" containerID="9ba26087f7b5f3926c75f251c758bf7c4508d16a05eba01d8a9b94e6bbd31dc0" exitCode=0 Jun 02 05:46:05.382343 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:05.382316 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" event={"ID":"daa56026c3c0bcd327234b83e18cad99","Type":"ContainerDied","Data":"9ba26087f7b5f3926c75f251c758bf7c4508d16a05eba01d8a9b94e6bbd31dc0"} Jun 02 05:46:05.401710 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:05.401663 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7b68p" event={"ID":"6f137b2e-c670-4aa4-919d-d6926029b2c9","Type":"ContainerStarted","Data":"d3ef28ea5c5c4439c27e366de0b2ef5cb7362ff648bf5817050a581edd6fda77"} Jun 02 05:46:05.405400 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:05.405354 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" event={"ID":"e7d6b49b-7faa-4b7d-b3ba-2398141c920d","Type":"ContainerStarted","Data":"4a8596a00b10231b0945231a1395a9f86478bab043ed010fa948d568a0a7a670"} Jun 02 05:46:05.429629 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:05.429548 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zhf22" event={"ID":"50b96b68-af8d-432e-ab2d-b682a7154685","Type":"ContainerStarted","Data":"d9c097ed2b3f0256a8e511776ace2e8ae10c132942c2b64a2b66e17b5dd2542f"} Jun 02 05:46:05.448856 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:05.448810 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6krts" event={"ID":"4456caea-7bd5-49b4-9507-f27c71422e4c","Type":"ContainerStarted","Data":"eca1d8bd0ffd53e3a5c060ad43365e963e80e36acdebeb87bbbfc0ac36dfdfdb"} Jun 02 05:46:05.469642 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:05.469600 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" event={"ID":"7e301e42-e23c-4260-a79a-ec6dc54f3c1b","Type":"ContainerStarted","Data":"039e4064072cde7d637aea5d220996b372a9cb9f3c7db5ae9a1f47b76c9d843c"} Jun 02 05:46:05.489216 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:05.488589 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-52.ec2.internal" event={"ID":"56e29088026b32923ea613473ac85f0c","Type":"ContainerStarted","Data":"5cc5a21b7963129764b63e6a8c9fac98d0983c92606a785ba7ed96893424fa8a"} Jun 02 05:46:05.510063 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:05.510027 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jwslr" event={"ID":"5df71152-0932-428b-912f-f306f58d218d","Type":"ContainerStarted","Data":"8a6ff75774d77b7a4cbad533c989af313985f632d5a4883c83b7d84fbc9036ee"} Jun 02 05:46:05.956789 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:05.956681 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vzmm4\" (UniqueName: \"kubernetes.io/projected/115aa003-3fbb-4c9f-b05b-73d987ad9290-kube-api-access-vzmm4\") pod \"network-check-target-vjzk2\" (UID: \"115aa003-3fbb-4c9f-b05b-73d987ad9290\") " pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:05.956789 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:05.956769 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs\") pod \"network-metrics-daemon-6btlj\" (UID: \"e1171123-67a2-45d0-b42e-c0b5c97d9e5a\") " pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:05.957003 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:05.956906 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:46:05.957003 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:05.956968 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs podName:e1171123-67a2-45d0-b42e-c0b5c97d9e5a nodeName:}" failed. No retries permitted until 2026-06-02 05:46:07.956948915 +0000 UTC m=+6.088829798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs") pod "network-metrics-daemon-6btlj" (UID: "e1171123-67a2-45d0-b42e-c0b5c97d9e5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:46:05.957387 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:05.957368 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 05:46:05.957483 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:05.957390 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 05:46:05.957483 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:05.957402 2575 projected.go:194] Error preparing data for projected volume kube-api-access-vzmm4 for pod openshift-network-diagnostics/network-check-target-vjzk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:46:05.957483 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:05.957444 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/115aa003-3fbb-4c9f-b05b-73d987ad9290-kube-api-access-vzmm4 podName:115aa003-3fbb-4c9f-b05b-73d987ad9290 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:07.957430128 +0000 UTC m=+6.089311001 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vzmm4" (UniqueName: "kubernetes.io/projected/115aa003-3fbb-4c9f-b05b-73d987ad9290-kube-api-access-vzmm4") pod "network-check-target-vjzk2" (UID: "115aa003-3fbb-4c9f-b05b-73d987ad9290") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:46:06.535526 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:06.535464 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" event={"ID":"daa56026c3c0bcd327234b83e18cad99","Type":"ContainerStarted","Data":"995f0d73d773a343a5cfec19675f177f1255cfc5b866aea7526cd6562861bcf9"} Jun 02 05:46:06.569576 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:06.569508 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-52.ec2.internal" podStartSLOduration=3.5694837919999998 podStartE2EDuration="3.569483792s" podCreationTimestamp="2026-06-02 05:46:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 05:46:05.503891577 +0000 UTC m=+3.635772472" watchObservedRunningTime="2026-06-02 05:46:06.569483792 +0000 UTC m=+4.701364684" Jun 02 05:46:06.570265 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:06.570226 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" podStartSLOduration=3.570215805 podStartE2EDuration="3.570215805s" podCreationTimestamp="2026-06-02 05:46:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 05:46:06.56990267 +0000 UTC m=+4.701783577" watchObservedRunningTime="2026-06-02 05:46:06.570215805 +0000 UTC m=+4.702096697" Jun 02 05:46:07.349521 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:07.349486 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:07.349689 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:07.349487 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:07.349689 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:07.349619 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjzk2" podUID="115aa003-3fbb-4c9f-b05b-73d987ad9290" Jun 02 05:46:07.349882 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:07.349814 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6btlj" podUID="e1171123-67a2-45d0-b42e-c0b5c97d9e5a" Jun 02 05:46:07.973184 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:07.973145 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs\") pod \"network-metrics-daemon-6btlj\" (UID: \"e1171123-67a2-45d0-b42e-c0b5c97d9e5a\") " pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:07.973637 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:07.973217 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vzmm4\" (UniqueName: \"kubernetes.io/projected/115aa003-3fbb-4c9f-b05b-73d987ad9290-kube-api-access-vzmm4\") pod \"network-check-target-vjzk2\" (UID: \"115aa003-3fbb-4c9f-b05b-73d987ad9290\") " pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:07.973637 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:07.973328 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:46:07.973637 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:07.973388 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 05:46:07.973637 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:07.973404 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs podName:e1171123-67a2-45d0-b42e-c0b5c97d9e5a nodeName:}" failed. No retries permitted until 2026-06-02 05:46:11.973384419 +0000 UTC m=+10.105265291 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs") pod "network-metrics-daemon-6btlj" (UID: "e1171123-67a2-45d0-b42e-c0b5c97d9e5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:46:07.973637 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:07.973404 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 05:46:07.973637 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:07.973427 2575 projected.go:194] Error preparing data for projected volume kube-api-access-vzmm4 for pod openshift-network-diagnostics/network-check-target-vjzk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:46:07.973637 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:07.973462 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/115aa003-3fbb-4c9f-b05b-73d987ad9290-kube-api-access-vzmm4 podName:115aa003-3fbb-4c9f-b05b-73d987ad9290 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:11.973451548 +0000 UTC m=+10.105332420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vzmm4" (UniqueName: "kubernetes.io/projected/115aa003-3fbb-4c9f-b05b-73d987ad9290-kube-api-access-vzmm4") pod "network-check-target-vjzk2" (UID: "115aa003-3fbb-4c9f-b05b-73d987ad9290") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:46:09.350132 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:09.350093 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:09.350607 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:09.350236 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjzk2" podUID="115aa003-3fbb-4c9f-b05b-73d987ad9290" Jun 02 05:46:09.350851 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:09.350818 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:09.350985 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:09.350950 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6btlj" podUID="e1171123-67a2-45d0-b42e-c0b5c97d9e5a" Jun 02 05:46:11.349926 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:11.349886 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:11.350408 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:11.349907 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:11.350408 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:11.350032 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjzk2" podUID="115aa003-3fbb-4c9f-b05b-73d987ad9290" Jun 02 05:46:11.350408 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:11.350088 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6btlj" podUID="e1171123-67a2-45d0-b42e-c0b5c97d9e5a" Jun 02 05:46:12.007192 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:12.006881 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs\") pod \"network-metrics-daemon-6btlj\" (UID: \"e1171123-67a2-45d0-b42e-c0b5c97d9e5a\") " pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:12.007192 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:12.006948 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vzmm4\" (UniqueName: \"kubernetes.io/projected/115aa003-3fbb-4c9f-b05b-73d987ad9290-kube-api-access-vzmm4\") pod \"network-check-target-vjzk2\" (UID: \"115aa003-3fbb-4c9f-b05b-73d987ad9290\") " pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:12.007192 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:12.007107 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 05:46:12.007192 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:12.007124 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 05:46:12.007192 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:12.007121 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:46:12.007192 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:12.007140 2575 projected.go:194] Error preparing data for projected volume kube-api-access-vzmm4 for pod openshift-network-diagnostics/network-check-target-vjzk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:46:12.007685 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:12.007210 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs podName:e1171123-67a2-45d0-b42e-c0b5c97d9e5a nodeName:}" failed. No retries permitted until 2026-06-02 05:46:20.007187968 +0000 UTC m=+18.139068840 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs") pod "network-metrics-daemon-6btlj" (UID: "e1171123-67a2-45d0-b42e-c0b5c97d9e5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:46:12.007685 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:12.007232 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/115aa003-3fbb-4c9f-b05b-73d987ad9290-kube-api-access-vzmm4 podName:115aa003-3fbb-4c9f-b05b-73d987ad9290 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:20.007222457 +0000 UTC m=+18.139103327 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vzmm4" (UniqueName: "kubernetes.io/projected/115aa003-3fbb-4c9f-b05b-73d987ad9290-kube-api-access-vzmm4") pod "network-check-target-vjzk2" (UID: "115aa003-3fbb-4c9f-b05b-73d987ad9290") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:46:13.349462 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:13.349422 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:13.350160 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:13.349427 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:13.350160 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:13.349557 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjzk2" podUID="115aa003-3fbb-4c9f-b05b-73d987ad9290" Jun 02 05:46:13.350160 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:13.349622 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6btlj" podUID="e1171123-67a2-45d0-b42e-c0b5c97d9e5a" Jun 02 05:46:15.349507 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:15.349471 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:15.349507 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:15.349499 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:15.350019 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:15.349599 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjzk2" podUID="115aa003-3fbb-4c9f-b05b-73d987ad9290" Jun 02 05:46:15.350019 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:15.349755 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6btlj" podUID="e1171123-67a2-45d0-b42e-c0b5c97d9e5a" Jun 02 05:46:17.349530 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:17.349496 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:17.349530 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:17.349528 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:17.350052 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:17.349642 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6btlj" podUID="e1171123-67a2-45d0-b42e-c0b5c97d9e5a" Jun 02 05:46:17.350052 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:17.349776 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjzk2" podUID="115aa003-3fbb-4c9f-b05b-73d987ad9290" Jun 02 05:46:19.349600 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:19.349566 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:19.350098 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:19.349566 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:19.350098 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:19.349715 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6btlj" podUID="e1171123-67a2-45d0-b42e-c0b5c97d9e5a" Jun 02 05:46:19.350098 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:19.349758 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjzk2" podUID="115aa003-3fbb-4c9f-b05b-73d987ad9290" Jun 02 05:46:20.062932 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:20.062901 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs\") pod \"network-metrics-daemon-6btlj\" (UID: \"e1171123-67a2-45d0-b42e-c0b5c97d9e5a\") " pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:20.063187 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:20.062949 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vzmm4\" (UniqueName: \"kubernetes.io/projected/115aa003-3fbb-4c9f-b05b-73d987ad9290-kube-api-access-vzmm4\") pod \"network-check-target-vjzk2\" (UID: \"115aa003-3fbb-4c9f-b05b-73d987ad9290\") " pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:20.063187 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:20.063063 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:46:20.063187 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:20.063090 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 05:46:20.063187 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:20.063103 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 05:46:20.063187 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:20.063115 2575 projected.go:194] Error preparing data for projected volume kube-api-access-vzmm4 for pod openshift-network-diagnostics/network-check-target-vjzk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:46:20.063187 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:20.063128 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs podName:e1171123-67a2-45d0-b42e-c0b5c97d9e5a nodeName:}" failed. No retries permitted until 2026-06-02 05:46:36.063108504 +0000 UTC m=+34.194989393 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs") pod "network-metrics-daemon-6btlj" (UID: "e1171123-67a2-45d0-b42e-c0b5c97d9e5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:46:20.063187 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:20.063148 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/115aa003-3fbb-4c9f-b05b-73d987ad9290-kube-api-access-vzmm4 podName:115aa003-3fbb-4c9f-b05b-73d987ad9290 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:36.063138699 +0000 UTC m=+34.195019568 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vzmm4" (UniqueName: "kubernetes.io/projected/115aa003-3fbb-4c9f-b05b-73d987ad9290-kube-api-access-vzmm4") pod "network-check-target-vjzk2" (UID: "115aa003-3fbb-4c9f-b05b-73d987ad9290") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:46:21.350139 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:21.350088 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:21.350597 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:21.350231 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjzk2" podUID="115aa003-3fbb-4c9f-b05b-73d987ad9290" Jun 02 05:46:21.350597 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:21.350294 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:21.350597 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:21.350403 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6btlj" podUID="e1171123-67a2-45d0-b42e-c0b5c97d9e5a" Jun 02 05:46:23.350322 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:23.349976 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:23.351066 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:23.349978 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:23.351066 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:23.350403 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjzk2" podUID="115aa003-3fbb-4c9f-b05b-73d987ad9290" Jun 02 05:46:23.351066 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:23.350528 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6btlj" podUID="e1171123-67a2-45d0-b42e-c0b5c97d9e5a" Jun 02 05:46:23.574508 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:23.574470 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c9qtg" event={"ID":"ed81080d-7e5f-4b48-afc2-084a239754c3","Type":"ContainerStarted","Data":"2009850a263b36af25a28ac941b57ea63a64954b04d3c09a82a8675cf1f24d87"} Jun 02 05:46:23.575863 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:23.575835 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" event={"ID":"4400e13b-ecae-4ece-869f-8b003510bf52","Type":"ContainerStarted","Data":"deb2dae5d87d9fa8be7ae835406f6be8f63c41080b0809f78d7d3ad434e328f7"} Jun 02 05:46:23.581012 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:23.580987 2575 generic.go:358] "Generic (PLEG): container finished" podID="33b0e317-106f-4fc8-a724-25108da4bb2c" containerID="d5e22889d01aa65b9f759ad3c0082b0a75241ca30564caab63c93802eda950e3" exitCode=0 Jun 02 05:46:23.581100 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:23.581067 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snm6d" event={"ID":"33b0e317-106f-4fc8-a724-25108da4bb2c","Type":"ContainerDied","Data":"d5e22889d01aa65b9f759ad3c0082b0a75241ca30564caab63c93802eda950e3"} Jun 02 05:46:23.583633 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:23.583618 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j46gm_e7d6b49b-7faa-4b7d-b3ba-2398141c920d/ovn-acl-logging/0.log" Jun 02 05:46:23.583932 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:23.583912 2575 generic.go:358] "Generic (PLEG): container finished" podID="e7d6b49b-7faa-4b7d-b3ba-2398141c920d" containerID="28f61b292c8df149c2221a267a7701997abbf7729d6eb39cf2553df0bf3840a8" exitCode=1 Jun 02 05:46:23.583999 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:23.583973 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" event={"ID":"e7d6b49b-7faa-4b7d-b3ba-2398141c920d","Type":"ContainerStarted","Data":"8a9f66529c0e8935f50be92c2f4bc8c1cf74cbb555f4ca948d8ff59ff636e598"} Jun 02 05:46:23.584054 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:23.584000 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" event={"ID":"e7d6b49b-7faa-4b7d-b3ba-2398141c920d","Type":"ContainerStarted","Data":"2af9774371ae08932ebb7a4220e94cd01cec3fa55c65b97e24888fa2525abf5c"} Jun 02 05:46:23.584054 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:23.584016 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" event={"ID":"e7d6b49b-7faa-4b7d-b3ba-2398141c920d","Type":"ContainerStarted","Data":"d7984ac73fd54afaf57c30359f0b4ef41c63367a77717c96ac8de98f9e390844"} Jun 02 05:46:23.584054 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:23.584029 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" event={"ID":"e7d6b49b-7faa-4b7d-b3ba-2398141c920d","Type":"ContainerStarted","Data":"65a9eaa8af952463ae56226ed229286d2cc187829e58dc5dc64cee92f9625163"} Jun 02 05:46:23.584054 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:23.584041 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" event={"ID":"e7d6b49b-7faa-4b7d-b3ba-2398141c920d","Type":"ContainerDied","Data":"28f61b292c8df149c2221a267a7701997abbf7729d6eb39cf2553df0bf3840a8"} Jun 02 05:46:23.584208 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:23.584055 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" event={"ID":"e7d6b49b-7faa-4b7d-b3ba-2398141c920d","Type":"ContainerStarted","Data":"ef48da104d26de26d26911563667e70b3c5c86d691b658fba49cba6d5b050297"} Jun 02 05:46:23.585199 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:23.585181 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zhf22" event={"ID":"50b96b68-af8d-432e-ab2d-b682a7154685","Type":"ContainerStarted","Data":"fa16091a8258e8199cf687223ad2b45e627b8ff0d21337abea1aed0b8fcbca7b"} Jun 02 05:46:23.586316 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:23.586299 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6krts" event={"ID":"4456caea-7bd5-49b4-9507-f27c71422e4c","Type":"ContainerStarted","Data":"92d58d7d921111df544107e9783e4bc450e0b36be22e3f88ed66b3c0a4bb648a"} Jun 02 05:46:23.587547 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:23.587519 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" event={"ID":"7e301e42-e23c-4260-a79a-ec6dc54f3c1b","Type":"ContainerStarted","Data":"c5bb99fd5332033c100a65326482f17c3930c91c0e202c6a6873bc1f0cd40b2d"} Jun 02 05:46:23.588750 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:23.588711 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jwslr" event={"ID":"5df71152-0932-428b-912f-f306f58d218d","Type":"ContainerStarted","Data":"b81c3888709ac3358d3bd7e24574a50dcf18d81ddcd8a07f87069737c20726e1"} Jun 02 05:46:23.591846 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:23.591815 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-c9qtg" podStartSLOduration=4.007372125 podStartE2EDuration="21.591805245s" podCreationTimestamp="2026-06-02 05:46:02 +0000 UTC" firstStartedPulling="2026-06-02 05:46:04.823834375 +0000 UTC m=+2.955715257" lastFinishedPulling="2026-06-02 05:46:22.408267505 +0000 UTC m=+20.540148377" observedRunningTime="2026-06-02 05:46:23.591559082 +0000 UTC m=+21.723439983" watchObservedRunningTime="2026-06-02 05:46:23.591805245 +0000 UTC m=+21.723686136" Jun 02 05:46:23.604434 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:23.604402 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6krts" podStartSLOduration=4.013705219 podStartE2EDuration="21.604392056s" podCreationTimestamp="2026-06-02 05:46:02 +0000 UTC" firstStartedPulling="2026-06-02 05:46:04.817582298 +0000 UTC m=+2.949463168" lastFinishedPulling="2026-06-02 05:46:22.408269116 +0000 UTC m=+20.540150005" observedRunningTime="2026-06-02 05:46:23.604279607 +0000 UTC m=+21.736160497" watchObservedRunningTime="2026-06-02 05:46:23.604392056 +0000 UTC m=+21.736272947" Jun 02 05:46:23.623052 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:23.623016 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-jwslr" podStartSLOduration=3.3748718220000002 podStartE2EDuration="21.623006483s" podCreationTimestamp="2026-06-02 05:46:02 +0000 UTC" firstStartedPulling="2026-06-02 05:46:04.825902254 +0000 UTC m=+2.957783123" lastFinishedPulling="2026-06-02 05:46:23.074036905 +0000 UTC m=+21.205917784" observedRunningTime="2026-06-02 05:46:23.622764696 +0000 UTC m=+21.754645587" watchObservedRunningTime="2026-06-02 05:46:23.623006483 +0000 UTC m=+21.754887374" Jun 02 05:46:23.639531 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:23.639483 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fj2n7" podStartSLOduration=3.641667576 podStartE2EDuration="21.639461811s" podCreationTimestamp="2026-06-02 05:46:02 +0000 UTC" firstStartedPulling="2026-06-02 05:46:04.81668772 +0000 UTC m=+2.948568589" lastFinishedPulling="2026-06-02 05:46:22.814481929 +0000 UTC m=+20.946362824" observedRunningTime="2026-06-02 05:46:23.638984319 +0000 UTC m=+21.770865205" watchObservedRunningTime="2026-06-02 05:46:23.639461811 +0000 UTC m=+21.771342704" Jun 02 05:46:23.655283 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:23.655246 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-zhf22" podStartSLOduration=3.990605373 podStartE2EDuration="21.655235254s" podCreationTimestamp="2026-06-02 05:46:02 +0000 UTC" firstStartedPulling="2026-06-02 05:46:04.820118214 +0000 UTC m=+2.951999101" lastFinishedPulling="2026-06-02 05:46:22.484748109 +0000 UTC m=+20.616628982" observedRunningTime="2026-06-02 05:46:23.65487267 +0000 UTC m=+21.786753561" watchObservedRunningTime="2026-06-02 05:46:23.655235254 +0000 UTC m=+21.787116157" Jun 02 05:46:23.749224 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:23.749037 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 05:46:24.305519 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:24.305399 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T05:46:23.749225451Z","UUID":"60ef2c12-4b61-40ca-88f1-4eb8bb4cf1b5","Handler":null,"Name":"","Endpoint":""} Jun 02 05:46:24.308468 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:24.308076 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 05:46:24.308468 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:24.308108 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 05:46:24.592414 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:24.592377 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7b68p" event={"ID":"6f137b2e-c670-4aa4-919d-d6926029b2c9","Type":"ContainerStarted","Data":"4818203e7f27c4888b0b1592139b80f05e23e3b9605173ec5fc1523be834abec"} Jun 02 05:46:24.594276 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:24.594248 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" event={"ID":"4400e13b-ecae-4ece-869f-8b003510bf52","Type":"ContainerStarted","Data":"e35da223d5b6f328bf14086a71ad7614ec04e4aff93a55c4c056266291ad05e8"} Jun 02 05:46:25.350270 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:25.350240 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:25.350470 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:25.350361 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjzk2" podUID="115aa003-3fbb-4c9f-b05b-73d987ad9290" Jun 02 05:46:25.350470 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:25.350420 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:25.350574 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:25.350537 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6btlj" podUID="e1171123-67a2-45d0-b42e-c0b5c97d9e5a" Jun 02 05:46:25.598751 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:25.598708 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j46gm_e7d6b49b-7faa-4b7d-b3ba-2398141c920d/ovn-acl-logging/0.log" Jun 02 05:46:25.599228 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:25.599079 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" event={"ID":"e7d6b49b-7faa-4b7d-b3ba-2398141c920d","Type":"ContainerStarted","Data":"346a1efbf265db40f01f28fe91cf680eb81e75d5b38a2b39d2d9cac2c5daeb36"} Jun 02 05:46:25.600959 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:25.600896 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" event={"ID":"4400e13b-ecae-4ece-869f-8b003510bf52","Type":"ContainerStarted","Data":"ecf6c014796d1d23c4909c5ad50e77cc6fd27d81ca13ea2242684c51df803cb1"} Jun 02 05:46:25.617841 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:25.617797 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7b68p" podStartSLOduration=5.964912033 podStartE2EDuration="23.61778573s" podCreationTimestamp="2026-06-02 05:46:02 +0000 UTC" firstStartedPulling="2026-06-02 05:46:04.825910623 +0000 UTC m=+2.957791491" lastFinishedPulling="2026-06-02 05:46:22.478784307 +0000 UTC m=+20.610665188" observedRunningTime="2026-06-02 05:46:24.635630371 +0000 UTC m=+22.767511275" watchObservedRunningTime="2026-06-02 05:46:25.61778573 +0000 UTC m=+23.749666618" Jun 02 05:46:25.618363 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:25.618333 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g9lh" podStartSLOduration=3.461207485 podStartE2EDuration="23.618324566s" podCreationTimestamp="2026-06-02 05:46:02 +0000 UTC" firstStartedPulling="2026-06-02 05:46:04.819160688 +0000 UTC m=+2.951041567" lastFinishedPulling="2026-06-02 05:46:24.976277763 +0000 UTC m=+23.108158648" observedRunningTime="2026-06-02 05:46:25.616630238 +0000 UTC m=+23.748511128" watchObservedRunningTime="2026-06-02 05:46:25.618324566 +0000 UTC m=+23.750205456" Jun 02 05:46:26.157701 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:26.157668 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6krts" Jun 02 05:46:26.158579 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:26.158560 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6krts" Jun 02 05:46:26.603455 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:26.603424 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6krts" Jun 02 05:46:26.603892 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:26.603618 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6krts" Jun 02 05:46:27.349549 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:27.349515 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:27.349749 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:27.349515 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:27.349749 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:27.349617 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjzk2" podUID="115aa003-3fbb-4c9f-b05b-73d987ad9290" Jun 02 05:46:27.349749 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:27.349690 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6btlj" podUID="e1171123-67a2-45d0-b42e-c0b5c97d9e5a" Jun 02 05:46:28.135891 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:28.135706 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-75wbj"] Jun 02 05:46:28.139397 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:28.139381 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75wbj" Jun 02 05:46:28.139490 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:28.139441 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75wbj" podUID="b7658156-5f0e-4869-bab6-af9ab63b1c38" Jun 02 05:46:28.224645 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:28.224615 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7658156-5f0e-4869-bab6-af9ab63b1c38-original-pull-secret\") pod \"global-pull-secret-syncer-75wbj\" (UID: \"b7658156-5f0e-4869-bab6-af9ab63b1c38\") " pod="kube-system/global-pull-secret-syncer-75wbj" Jun 02 05:46:28.224813 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:28.224663 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b7658156-5f0e-4869-bab6-af9ab63b1c38-dbus\") pod \"global-pull-secret-syncer-75wbj\" (UID: \"b7658156-5f0e-4869-bab6-af9ab63b1c38\") " pod="kube-system/global-pull-secret-syncer-75wbj" Jun 02 05:46:28.224813 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:28.224702 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b7658156-5f0e-4869-bab6-af9ab63b1c38-kubelet-config\") pod \"global-pull-secret-syncer-75wbj\" (UID: \"b7658156-5f0e-4869-bab6-af9ab63b1c38\") " pod="kube-system/global-pull-secret-syncer-75wbj" Jun 02 05:46:28.325289 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:28.325251 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7658156-5f0e-4869-bab6-af9ab63b1c38-original-pull-secret\") pod \"global-pull-secret-syncer-75wbj\" (UID: \"b7658156-5f0e-4869-bab6-af9ab63b1c38\") " pod="kube-system/global-pull-secret-syncer-75wbj" Jun 02 05:46:28.325515 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:28.325326 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b7658156-5f0e-4869-bab6-af9ab63b1c38-dbus\") pod \"global-pull-secret-syncer-75wbj\" (UID: \"b7658156-5f0e-4869-bab6-af9ab63b1c38\") " pod="kube-system/global-pull-secret-syncer-75wbj" Jun 02 05:46:28.325515 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:28.325358 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b7658156-5f0e-4869-bab6-af9ab63b1c38-kubelet-config\") pod \"global-pull-secret-syncer-75wbj\" (UID: \"b7658156-5f0e-4869-bab6-af9ab63b1c38\") " pod="kube-system/global-pull-secret-syncer-75wbj" Jun 02 05:46:28.325515 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:28.325406 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 05:46:28.325515 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:28.325446 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b7658156-5f0e-4869-bab6-af9ab63b1c38-kubelet-config\") pod \"global-pull-secret-syncer-75wbj\" (UID: \"b7658156-5f0e-4869-bab6-af9ab63b1c38\") " pod="kube-system/global-pull-secret-syncer-75wbj" Jun 02 05:46:28.325515 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:28.325474 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7658156-5f0e-4869-bab6-af9ab63b1c38-original-pull-secret podName:b7658156-5f0e-4869-bab6-af9ab63b1c38 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:28.825454203 +0000 UTC m=+26.957335097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7658156-5f0e-4869-bab6-af9ab63b1c38-original-pull-secret") pod "global-pull-secret-syncer-75wbj" (UID: "b7658156-5f0e-4869-bab6-af9ab63b1c38") : object "kube-system"/"original-pull-secret" not registered Jun 02 05:46:28.325716 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:28.325586 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b7658156-5f0e-4869-bab6-af9ab63b1c38-dbus\") pod \"global-pull-secret-syncer-75wbj\" (UID: \"b7658156-5f0e-4869-bab6-af9ab63b1c38\") " pod="kube-system/global-pull-secret-syncer-75wbj" Jun 02 05:46:28.609964 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:28.609930 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j46gm_e7d6b49b-7faa-4b7d-b3ba-2398141c920d/ovn-acl-logging/0.log" Jun 02 05:46:28.610406 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:28.610364 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" event={"ID":"e7d6b49b-7faa-4b7d-b3ba-2398141c920d","Type":"ContainerStarted","Data":"e6aa097e96856d58c3583e8ce26eda4a6095146d85c14a381231e1eb08e68c0f"} Jun 02 05:46:28.613647 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:28.612010 2575 scope.go:117] "RemoveContainer" containerID="28f61b292c8df149c2221a267a7701997abbf7729d6eb39cf2553df0bf3840a8" Jun 02 05:46:28.830020 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:28.829974 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7658156-5f0e-4869-bab6-af9ab63b1c38-original-pull-secret\") pod \"global-pull-secret-syncer-75wbj\" (UID: \"b7658156-5f0e-4869-bab6-af9ab63b1c38\") " pod="kube-system/global-pull-secret-syncer-75wbj" Jun 02 05:46:28.830194 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:28.830182 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 05:46:28.830270 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:28.830257 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7658156-5f0e-4869-bab6-af9ab63b1c38-original-pull-secret podName:b7658156-5f0e-4869-bab6-af9ab63b1c38 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:29.830235933 +0000 UTC m=+27.962116810 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7658156-5f0e-4869-bab6-af9ab63b1c38-original-pull-secret") pod "global-pull-secret-syncer-75wbj" (UID: "b7658156-5f0e-4869-bab6-af9ab63b1c38") : object "kube-system"/"original-pull-secret" not registered Jun 02 05:46:29.349828 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:29.349798 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:29.350347 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:29.349939 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjzk2" podUID="115aa003-3fbb-4c9f-b05b-73d987ad9290" Jun 02 05:46:29.350347 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:29.349800 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:29.350482 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:29.350422 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6btlj" podUID="e1171123-67a2-45d0-b42e-c0b5c97d9e5a" Jun 02 05:46:29.600632 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:29.600544 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6btlj"] Jun 02 05:46:29.603698 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:29.603673 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vjzk2"] Jun 02 05:46:29.611888 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:29.611859 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-75wbj"] Jun 02 05:46:29.612057 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:29.611992 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75wbj" Jun 02 05:46:29.612134 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:29.612102 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75wbj" podUID="b7658156-5f0e-4869-bab6-af9ab63b1c38" Jun 02 05:46:29.612494 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:29.612413 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:29.612615 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:29.612533 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6btlj" podUID="e1171123-67a2-45d0-b42e-c0b5c97d9e5a" Jun 02 05:46:29.612615 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:29.612566 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:29.612738 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:29.612631 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjzk2" podUID="115aa003-3fbb-4c9f-b05b-73d987ad9290" Jun 02 05:46:29.838239 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:29.838198 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7658156-5f0e-4869-bab6-af9ab63b1c38-original-pull-secret\") pod \"global-pull-secret-syncer-75wbj\" (UID: \"b7658156-5f0e-4869-bab6-af9ab63b1c38\") " pod="kube-system/global-pull-secret-syncer-75wbj" Jun 02 05:46:29.838405 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:29.838369 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 05:46:29.838463 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:29.838444 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7658156-5f0e-4869-bab6-af9ab63b1c38-original-pull-secret podName:b7658156-5f0e-4869-bab6-af9ab63b1c38 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:31.838424067 +0000 UTC m=+29.970304936 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7658156-5f0e-4869-bab6-af9ab63b1c38-original-pull-secret") pod "global-pull-secret-syncer-75wbj" (UID: "b7658156-5f0e-4869-bab6-af9ab63b1c38") : object "kube-system"/"original-pull-secret" not registered Jun 02 05:46:30.616001 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:30.615792 2575 generic.go:358] "Generic (PLEG): container finished" podID="33b0e317-106f-4fc8-a724-25108da4bb2c" containerID="0d82b38b670d3ba179f67e64e82d8df2ca41316e7af5bba2a268fb052230b42e" exitCode=0 Jun 02 05:46:30.616429 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:30.615878 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snm6d" event={"ID":"33b0e317-106f-4fc8-a724-25108da4bb2c","Type":"ContainerDied","Data":"0d82b38b670d3ba179f67e64e82d8df2ca41316e7af5bba2a268fb052230b42e"} Jun 02 05:46:30.619372 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:30.619355 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j46gm_e7d6b49b-7faa-4b7d-b3ba-2398141c920d/ovn-acl-logging/0.log" Jun 02 05:46:30.619669 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:30.619649 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" event={"ID":"e7d6b49b-7faa-4b7d-b3ba-2398141c920d","Type":"ContainerStarted","Data":"9df68c6c93746f093ccd1d98d9f248181eb3444f4dccfc9c3625b08a835af092"} Jun 02 05:46:30.619924 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:30.619904 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:30.620043 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:30.619929 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:30.620043 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:30.619984 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:30.634844 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:30.634820 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:30.634941 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:30.634888 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:46:30.664482 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:30.664437 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" podStartSLOduration=10.98487443 podStartE2EDuration="28.664424696s" podCreationTimestamp="2026-06-02 05:46:02 +0000 UTC" firstStartedPulling="2026-06-02 05:46:04.822556268 +0000 UTC m=+2.954437144" lastFinishedPulling="2026-06-02 05:46:22.502106538 +0000 UTC m=+20.633987410" observedRunningTime="2026-06-02 05:46:30.662953211 +0000 UTC m=+28.794834112" watchObservedRunningTime="2026-06-02 05:46:30.664424696 +0000 UTC m=+28.796305586" Jun 02 05:46:31.349567 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:31.349537 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:31.349698 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:31.349580 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75wbj" Jun 02 05:46:31.349698 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:31.349537 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:31.349698 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:31.349663 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6btlj" podUID="e1171123-67a2-45d0-b42e-c0b5c97d9e5a" Jun 02 05:46:31.349886 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:31.349716 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjzk2" podUID="115aa003-3fbb-4c9f-b05b-73d987ad9290" Jun 02 05:46:31.349886 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:31.349795 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75wbj" podUID="b7658156-5f0e-4869-bab6-af9ab63b1c38" Jun 02 05:46:31.622942 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:31.622861 2575 generic.go:358] "Generic (PLEG): container finished" podID="33b0e317-106f-4fc8-a724-25108da4bb2c" containerID="a44ccd243066fc5823593ae715ade1753c404db49da6e7739e6193490ddadc7b" exitCode=0 Jun 02 05:46:31.622942 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:31.622925 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snm6d" event={"ID":"33b0e317-106f-4fc8-a724-25108da4bb2c","Type":"ContainerDied","Data":"a44ccd243066fc5823593ae715ade1753c404db49da6e7739e6193490ddadc7b"} Jun 02 05:46:31.852681 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:31.852643 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7658156-5f0e-4869-bab6-af9ab63b1c38-original-pull-secret\") pod \"global-pull-secret-syncer-75wbj\" (UID: \"b7658156-5f0e-4869-bab6-af9ab63b1c38\") " pod="kube-system/global-pull-secret-syncer-75wbj" Jun 02 05:46:31.852870 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:31.852819 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 05:46:31.852918 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:31.852876 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7658156-5f0e-4869-bab6-af9ab63b1c38-original-pull-secret podName:b7658156-5f0e-4869-bab6-af9ab63b1c38 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:35.85286221 +0000 UTC m=+33.984743078 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7658156-5f0e-4869-bab6-af9ab63b1c38-original-pull-secret") pod "global-pull-secret-syncer-75wbj" (UID: "b7658156-5f0e-4869-bab6-af9ab63b1c38") : object "kube-system"/"original-pull-secret" not registered Jun 02 05:46:32.630217 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:32.630184 2575 generic.go:358] "Generic (PLEG): container finished" podID="33b0e317-106f-4fc8-a724-25108da4bb2c" containerID="e581a18e11bd506dc90e856eb00b6f39b95d83b4375c90cb65e81ad2e9cd61c0" exitCode=0 Jun 02 05:46:32.630771 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:32.630268 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snm6d" event={"ID":"33b0e317-106f-4fc8-a724-25108da4bb2c","Type":"ContainerDied","Data":"e581a18e11bd506dc90e856eb00b6f39b95d83b4375c90cb65e81ad2e9cd61c0"} Jun 02 05:46:32.641951 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:32.641916 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" podUID="e7d6b49b-7faa-4b7d-b3ba-2398141c920d" containerName="ovnkube-controller" probeResult="failure" output="" Jun 02 05:46:33.350033 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:33.349991 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:33.350033 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:33.350028 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75wbj" Jun 02 05:46:33.350271 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:33.349991 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:33.350271 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:33.350127 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjzk2" podUID="115aa003-3fbb-4c9f-b05b-73d987ad9290" Jun 02 05:46:33.350271 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:33.350216 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75wbj" podUID="b7658156-5f0e-4869-bab6-af9ab63b1c38" Jun 02 05:46:33.350430 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:33.350329 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6btlj" podUID="e1171123-67a2-45d0-b42e-c0b5c97d9e5a" Jun 02 05:46:34.765515 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.765442 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeReady" Jun 02 05:46:34.766073 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.765593 2575 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 05:46:34.805350 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.805316 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tqr92"] Jun 02 05:46:34.808042 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.808006 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-758p5"] Jun 02 05:46:34.808184 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.808019 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tqr92" Jun 02 05:46:34.810608 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.810584 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 05:46:34.810803 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.810641 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 05:46:34.810803 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.810681 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qs5xc\"" Jun 02 05:46:34.810803 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.810754 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-758p5" Jun 02 05:46:34.813106 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.813074 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 05:46:34.813363 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.813340 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 05:46:34.813476 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.813388 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jz498\"" Jun 02 05:46:34.813476 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.813461 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 05:46:34.820442 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.820386 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tqr92"] Jun 02 05:46:34.822021 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.821995 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-758p5"] Jun 02 05:46:34.875829 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.875793 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0587da4-0df5-48c6-9df5-3b69cc457181-tmp-dir\") pod \"dns-default-tqr92\" (UID: \"f0587da4-0df5-48c6-9df5-3b69cc457181\") " pod="openshift-dns/dns-default-tqr92" Jun 02 05:46:34.875829 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.875838 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtcjx\" (UniqueName: \"kubernetes.io/projected/f0587da4-0df5-48c6-9df5-3b69cc457181-kube-api-access-vtcjx\") pod \"dns-default-tqr92\" (UID: \"f0587da4-0df5-48c6-9df5-3b69cc457181\") " pod="openshift-dns/dns-default-tqr92" Jun 02 05:46:34.876074 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.875869 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f0587da4-0df5-48c6-9df5-3b69cc457181-config-volume\") pod \"dns-default-tqr92\" (UID: \"f0587da4-0df5-48c6-9df5-3b69cc457181\") " pod="openshift-dns/dns-default-tqr92" Jun 02 05:46:34.876074 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.875892 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls\") pod \"dns-default-tqr92\" (UID: \"f0587da4-0df5-48c6-9df5-3b69cc457181\") " pod="openshift-dns/dns-default-tqr92" Jun 02 05:46:34.876074 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.875922 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4sns\" (UniqueName: \"kubernetes.io/projected/3e1a7f6b-52e8-4248-b043-8248779a965a-kube-api-access-g4sns\") pod \"ingress-canary-758p5\" (UID: \"3e1a7f6b-52e8-4248-b043-8248779a965a\") " pod="openshift-ingress-canary/ingress-canary-758p5" Jun 02 05:46:34.876074 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.876039 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert\") pod \"ingress-canary-758p5\" (UID: \"3e1a7f6b-52e8-4248-b043-8248779a965a\") " pod="openshift-ingress-canary/ingress-canary-758p5" Jun 02 05:46:34.977050 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.977013 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vtcjx\" (UniqueName: \"kubernetes.io/projected/f0587da4-0df5-48c6-9df5-3b69cc457181-kube-api-access-vtcjx\") pod \"dns-default-tqr92\" (UID: \"f0587da4-0df5-48c6-9df5-3b69cc457181\") " pod="openshift-dns/dns-default-tqr92" Jun 02 05:46:34.977280 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.977057 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f0587da4-0df5-48c6-9df5-3b69cc457181-config-volume\") pod \"dns-default-tqr92\" (UID: \"f0587da4-0df5-48c6-9df5-3b69cc457181\") " pod="openshift-dns/dns-default-tqr92" Jun 02 05:46:34.977280 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.977076 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls\") pod \"dns-default-tqr92\" (UID: \"f0587da4-0df5-48c6-9df5-3b69cc457181\") " pod="openshift-dns/dns-default-tqr92" Jun 02 05:46:34.977280 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:34.977195 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 05:46:34.977280 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:34.977260 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls podName:f0587da4-0df5-48c6-9df5-3b69cc457181 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:35.477240592 +0000 UTC m=+33.609121474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls") pod "dns-default-tqr92" (UID: "f0587da4-0df5-48c6-9df5-3b69cc457181") : secret "dns-default-metrics-tls" not found Jun 02 05:46:34.977516 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.977297 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g4sns\" (UniqueName: \"kubernetes.io/projected/3e1a7f6b-52e8-4248-b043-8248779a965a-kube-api-access-g4sns\") pod \"ingress-canary-758p5\" (UID: \"3e1a7f6b-52e8-4248-b043-8248779a965a\") " pod="openshift-ingress-canary/ingress-canary-758p5" Jun 02 05:46:34.977516 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.977358 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert\") pod \"ingress-canary-758p5\" (UID: \"3e1a7f6b-52e8-4248-b043-8248779a965a\") " pod="openshift-ingress-canary/ingress-canary-758p5" Jun 02 05:46:34.977516 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.977467 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0587da4-0df5-48c6-9df5-3b69cc457181-tmp-dir\") pod \"dns-default-tqr92\" (UID: \"f0587da4-0df5-48c6-9df5-3b69cc457181\") " pod="openshift-dns/dns-default-tqr92" Jun 02 05:46:34.977663 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:34.977584 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 05:46:34.977663 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:34.977637 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert podName:3e1a7f6b-52e8-4248-b043-8248779a965a nodeName:}" failed. No retries permitted until 2026-06-02 05:46:35.477622037 +0000 UTC m=+33.609502919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert") pod "ingress-canary-758p5" (UID: "3e1a7f6b-52e8-4248-b043-8248779a965a") : secret "canary-serving-cert" not found Jun 02 05:46:34.977793 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.977675 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f0587da4-0df5-48c6-9df5-3b69cc457181-config-volume\") pod \"dns-default-tqr92\" (UID: \"f0587da4-0df5-48c6-9df5-3b69cc457181\") " pod="openshift-dns/dns-default-tqr92" Jun 02 05:46:34.977793 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.977763 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0587da4-0df5-48c6-9df5-3b69cc457181-tmp-dir\") pod \"dns-default-tqr92\" (UID: \"f0587da4-0df5-48c6-9df5-3b69cc457181\") " pod="openshift-dns/dns-default-tqr92" Jun 02 05:46:34.987903 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.987716 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtcjx\" (UniqueName: \"kubernetes.io/projected/f0587da4-0df5-48c6-9df5-3b69cc457181-kube-api-access-vtcjx\") pod \"dns-default-tqr92\" (UID: \"f0587da4-0df5-48c6-9df5-3b69cc457181\") " pod="openshift-dns/dns-default-tqr92" Jun 02 05:46:34.988060 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:34.987833 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4sns\" (UniqueName: \"kubernetes.io/projected/3e1a7f6b-52e8-4248-b043-8248779a965a-kube-api-access-g4sns\") pod \"ingress-canary-758p5\" (UID: \"3e1a7f6b-52e8-4248-b043-8248779a965a\") " pod="openshift-ingress-canary/ingress-canary-758p5" Jun 02 05:46:35.349734 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:35.349702 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75wbj" Jun 02 05:46:35.349734 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:35.349740 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:35.349938 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:35.349789 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:35.352680 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:35.352635 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 05:46:35.352833 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:35.352806 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 05:46:35.352904 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:35.352846 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 05:46:35.352904 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:35.352856 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x8xws\"" Jun 02 05:46:35.353637 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:35.353621 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9mk8f\"" Jun 02 05:46:35.353745 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:35.353663 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 05:46:35.481032 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:35.481000 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls\") pod \"dns-default-tqr92\" (UID: \"f0587da4-0df5-48c6-9df5-3b69cc457181\") " pod="openshift-dns/dns-default-tqr92" Jun 02 05:46:35.481215 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:35.481054 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert\") pod \"ingress-canary-758p5\" (UID: \"3e1a7f6b-52e8-4248-b043-8248779a965a\") " pod="openshift-ingress-canary/ingress-canary-758p5" Jun 02 05:46:35.481215 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:35.481181 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 05:46:35.481324 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:35.481228 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 05:46:35.481324 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:35.481278 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls podName:f0587da4-0df5-48c6-9df5-3b69cc457181 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:36.481254535 +0000 UTC m=+34.613135406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls") pod "dns-default-tqr92" (UID: "f0587da4-0df5-48c6-9df5-3b69cc457181") : secret "dns-default-metrics-tls" not found Jun 02 05:46:35.481324 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:35.481294 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert podName:3e1a7f6b-52e8-4248-b043-8248779a965a nodeName:}" failed. No retries permitted until 2026-06-02 05:46:36.481287962 +0000 UTC m=+34.613168831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert") pod "ingress-canary-758p5" (UID: "3e1a7f6b-52e8-4248-b043-8248779a965a") : secret "canary-serving-cert" not found Jun 02 05:46:35.885477 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:35.885433 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7658156-5f0e-4869-bab6-af9ab63b1c38-original-pull-secret\") pod \"global-pull-secret-syncer-75wbj\" (UID: \"b7658156-5f0e-4869-bab6-af9ab63b1c38\") " pod="kube-system/global-pull-secret-syncer-75wbj" Jun 02 05:46:35.887955 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:35.887925 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7658156-5f0e-4869-bab6-af9ab63b1c38-original-pull-secret\") pod \"global-pull-secret-syncer-75wbj\" (UID: \"b7658156-5f0e-4869-bab6-af9ab63b1c38\") " pod="kube-system/global-pull-secret-syncer-75wbj" Jun 02 05:46:35.974893 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:35.974858 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75wbj" Jun 02 05:46:36.087402 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:36.087356 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs\") pod \"network-metrics-daemon-6btlj\" (UID: \"e1171123-67a2-45d0-b42e-c0b5c97d9e5a\") " pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:46:36.087576 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:36.087428 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vzmm4\" (UniqueName: \"kubernetes.io/projected/115aa003-3fbb-4c9f-b05b-73d987ad9290-kube-api-access-vzmm4\") pod \"network-check-target-vjzk2\" (UID: \"115aa003-3fbb-4c9f-b05b-73d987ad9290\") " pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:36.087641 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:36.087571 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 05:46:36.087641 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:36.087633 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs podName:e1171123-67a2-45d0-b42e-c0b5c97d9e5a nodeName:}" failed. No retries permitted until 2026-06-02 05:47:08.087618405 +0000 UTC m=+66.219499275 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs") pod "network-metrics-daemon-6btlj" (UID: "e1171123-67a2-45d0-b42e-c0b5c97d9e5a") : secret "metrics-daemon-secret" not found Jun 02 05:46:36.090967 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:36.090939 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzmm4\" (UniqueName: \"kubernetes.io/projected/115aa003-3fbb-4c9f-b05b-73d987ad9290-kube-api-access-vzmm4\") pod \"network-check-target-vjzk2\" (UID: \"115aa003-3fbb-4c9f-b05b-73d987ad9290\") " pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:36.122551 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:36.122504 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-75wbj"] Jun 02 05:46:36.268329 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:36.268251 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:36.490331 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:36.490290 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert\") pod \"ingress-canary-758p5\" (UID: \"3e1a7f6b-52e8-4248-b043-8248779a965a\") " pod="openshift-ingress-canary/ingress-canary-758p5" Jun 02 05:46:36.490535 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:36.490402 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls\") pod \"dns-default-tqr92\" (UID: \"f0587da4-0df5-48c6-9df5-3b69cc457181\") " pod="openshift-dns/dns-default-tqr92" Jun 02 05:46:36.490535 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:36.490473 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 05:46:36.490535 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:36.490507 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 05:46:36.490696 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:36.490568 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert podName:3e1a7f6b-52e8-4248-b043-8248779a965a nodeName:}" failed. No retries permitted until 2026-06-02 05:46:38.490544951 +0000 UTC m=+36.622425840 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert") pod "ingress-canary-758p5" (UID: "3e1a7f6b-52e8-4248-b043-8248779a965a") : secret "canary-serving-cert" not found Jun 02 05:46:36.490696 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:36.490592 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls podName:f0587da4-0df5-48c6-9df5-3b69cc457181 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:38.490580606 +0000 UTC m=+36.622461477 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls") pod "dns-default-tqr92" (UID: "f0587da4-0df5-48c6-9df5-3b69cc457181") : secret "dns-default-metrics-tls" not found Jun 02 05:46:38.176620 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:38.176581 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7658156_5f0e_4869_bab6_af9ab63b1c38.slice/crio-90404f9548f43ce8fc490a4abdf5d9d9e33bafedf376adbc8586504f87c79f5e WatchSource:0}: Error finding container 90404f9548f43ce8fc490a4abdf5d9d9e33bafedf376adbc8586504f87c79f5e: Status 404 returned error can't find the container with id 90404f9548f43ce8fc490a4abdf5d9d9e33bafedf376adbc8586504f87c79f5e Jun 02 05:46:38.292233 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:38.292201 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vjzk2"] Jun 02 05:46:38.297790 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:46:38.297747 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod115aa003_3fbb_4c9f_b05b_73d987ad9290.slice/crio-d46821d11403892dd11390f0f2633841378332eb5b2c7cdac426fdb632fa00e8 WatchSource:0}: Error finding container d46821d11403892dd11390f0f2633841378332eb5b2c7cdac426fdb632fa00e8: Status 404 returned error can't find the container with id d46821d11403892dd11390f0f2633841378332eb5b2c7cdac426fdb632fa00e8 Jun 02 05:46:38.505416 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:38.505171 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls\") pod \"dns-default-tqr92\" (UID: \"f0587da4-0df5-48c6-9df5-3b69cc457181\") " pod="openshift-dns/dns-default-tqr92" Jun 02 05:46:38.505416 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:38.505378 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 05:46:38.505416 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:38.505416 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert\") pod \"ingress-canary-758p5\" (UID: \"3e1a7f6b-52e8-4248-b043-8248779a965a\") " pod="openshift-ingress-canary/ingress-canary-758p5" Jun 02 05:46:38.505692 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:38.505449 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls podName:f0587da4-0df5-48c6-9df5-3b69cc457181 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:42.505430767 +0000 UTC m=+40.637311655 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls") pod "dns-default-tqr92" (UID: "f0587da4-0df5-48c6-9df5-3b69cc457181") : secret "dns-default-metrics-tls" not found Jun 02 05:46:38.505692 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:38.505516 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 05:46:38.505692 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:38.505565 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert podName:3e1a7f6b-52e8-4248-b043-8248779a965a nodeName:}" failed. No retries permitted until 2026-06-02 05:46:42.505549239 +0000 UTC m=+40.637430108 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert") pod "ingress-canary-758p5" (UID: "3e1a7f6b-52e8-4248-b043-8248779a965a") : secret "canary-serving-cert" not found Jun 02 05:46:38.643173 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:38.643131 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-75wbj" event={"ID":"b7658156-5f0e-4869-bab6-af9ab63b1c38","Type":"ContainerStarted","Data":"90404f9548f43ce8fc490a4abdf5d9d9e33bafedf376adbc8586504f87c79f5e"} Jun 02 05:46:38.646258 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:38.646213 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snm6d" event={"ID":"33b0e317-106f-4fc8-a724-25108da4bb2c","Type":"ContainerStarted","Data":"89505e7395b7745b759c34073a53e1295fd8dc3b2f057d9a580d434c882596cc"} Jun 02 05:46:38.647495 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:38.647453 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vjzk2" event={"ID":"115aa003-3fbb-4c9f-b05b-73d987ad9290","Type":"ContainerStarted","Data":"d46821d11403892dd11390f0f2633841378332eb5b2c7cdac426fdb632fa00e8"} Jun 02 05:46:39.651785 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:39.651743 2575 generic.go:358] "Generic (PLEG): container finished" podID="33b0e317-106f-4fc8-a724-25108da4bb2c" containerID="89505e7395b7745b759c34073a53e1295fd8dc3b2f057d9a580d434c882596cc" exitCode=0 Jun 02 05:46:39.652446 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:39.651793 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snm6d" event={"ID":"33b0e317-106f-4fc8-a724-25108da4bb2c","Type":"ContainerDied","Data":"89505e7395b7745b759c34073a53e1295fd8dc3b2f057d9a580d434c882596cc"} Jun 02 05:46:40.657658 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:40.657587 2575 generic.go:358] "Generic (PLEG): container finished" podID="33b0e317-106f-4fc8-a724-25108da4bb2c" containerID="9aca24076337517fd7b400e693ce42eb198d2be55a320071cc8b40950fc75673" exitCode=0 Jun 02 05:46:40.658256 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:40.657659 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snm6d" event={"ID":"33b0e317-106f-4fc8-a724-25108da4bb2c","Type":"ContainerDied","Data":"9aca24076337517fd7b400e693ce42eb198d2be55a320071cc8b40950fc75673"} Jun 02 05:46:42.540454 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:42.540408 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls\") pod \"dns-default-tqr92\" (UID: \"f0587da4-0df5-48c6-9df5-3b69cc457181\") " pod="openshift-dns/dns-default-tqr92" Jun 02 05:46:42.540941 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:42.540476 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert\") pod \"ingress-canary-758p5\" (UID: \"3e1a7f6b-52e8-4248-b043-8248779a965a\") " pod="openshift-ingress-canary/ingress-canary-758p5" Jun 02 05:46:42.540941 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:42.540595 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 05:46:42.540941 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:42.540617 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 05:46:42.540941 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:42.540684 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls podName:f0587da4-0df5-48c6-9df5-3b69cc457181 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:50.54065984 +0000 UTC m=+48.672540720 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls") pod "dns-default-tqr92" (UID: "f0587da4-0df5-48c6-9df5-3b69cc457181") : secret "dns-default-metrics-tls" not found Jun 02 05:46:42.540941 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:42.540709 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert podName:3e1a7f6b-52e8-4248-b043-8248779a965a nodeName:}" failed. No retries permitted until 2026-06-02 05:46:50.540696806 +0000 UTC m=+48.672577677 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert") pod "ingress-canary-758p5" (UID: "3e1a7f6b-52e8-4248-b043-8248779a965a") : secret "canary-serving-cert" not found Jun 02 05:46:43.665652 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:43.665547 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-75wbj" event={"ID":"b7658156-5f0e-4869-bab6-af9ab63b1c38","Type":"ContainerStarted","Data":"28496835236eed509d7ccef93cf7a6da5278fefcaf1acd6ebf911ece8ec79fa1"} Jun 02 05:46:43.668776 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:43.668740 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snm6d" event={"ID":"33b0e317-106f-4fc8-a724-25108da4bb2c","Type":"ContainerStarted","Data":"b4146b2de1b92aa08569de1a3aeb9a268f277584b97afe6aaf26eaf787c77f61"} Jun 02 05:46:43.670054 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:43.670032 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vjzk2" event={"ID":"115aa003-3fbb-4c9f-b05b-73d987ad9290","Type":"ContainerStarted","Data":"e1c3e8f9f14fc11ca53e62c4d43b1d7d7a2d76aaaef4cde12aaf7c979631097d"} Jun 02 05:46:43.670167 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:43.670151 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:46:43.681058 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:43.681017 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-75wbj" podStartSLOduration=10.427807671 podStartE2EDuration="15.681005254s" podCreationTimestamp="2026-06-02 05:46:28 +0000 UTC" firstStartedPulling="2026-06-02 05:46:38.178459454 +0000 UTC m=+36.310340323" lastFinishedPulling="2026-06-02 05:46:43.431657035 +0000 UTC m=+41.563537906" observedRunningTime="2026-06-02 05:46:43.680281306 +0000 UTC m=+41.812162196" watchObservedRunningTime="2026-06-02 05:46:43.681005254 +0000 UTC m=+41.812886145" Jun 02 05:46:43.694529 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:43.694493 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vjzk2" podStartSLOduration=36.553693595 podStartE2EDuration="41.694481315s" podCreationTimestamp="2026-06-02 05:46:02 +0000 UTC" firstStartedPulling="2026-06-02 05:46:38.300287767 +0000 UTC m=+36.432168636" lastFinishedPulling="2026-06-02 05:46:43.441075473 +0000 UTC m=+41.572956356" observedRunningTime="2026-06-02 05:46:43.69368269 +0000 UTC m=+41.825563581" watchObservedRunningTime="2026-06-02 05:46:43.694481315 +0000 UTC m=+41.826362583" Jun 02 05:46:43.712156 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:43.712112 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-snm6d" podStartSLOduration=8.045659137 podStartE2EDuration="41.712100875s" podCreationTimestamp="2026-06-02 05:46:02 +0000 UTC" firstStartedPulling="2026-06-02 05:46:04.815568567 +0000 UTC m=+2.947449437" lastFinishedPulling="2026-06-02 05:46:38.482010306 +0000 UTC m=+36.613891175" observedRunningTime="2026-06-02 05:46:43.711344582 +0000 UTC m=+41.843225473" watchObservedRunningTime="2026-06-02 05:46:43.712100875 +0000 UTC m=+41.843981799" Jun 02 05:46:50.599231 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:50.599187 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert\") pod \"ingress-canary-758p5\" (UID: \"3e1a7f6b-52e8-4248-b043-8248779a965a\") " pod="openshift-ingress-canary/ingress-canary-758p5" Jun 02 05:46:50.599673 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:46:50.599263 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls\") pod \"dns-default-tqr92\" (UID: \"f0587da4-0df5-48c6-9df5-3b69cc457181\") " pod="openshift-dns/dns-default-tqr92" Jun 02 05:46:50.599673 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:50.599344 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 05:46:50.599673 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:50.599349 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 05:46:50.599673 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:50.599406 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls podName:f0587da4-0df5-48c6-9df5-3b69cc457181 nodeName:}" failed. No retries permitted until 2026-06-02 05:47:06.599391758 +0000 UTC m=+64.731272627 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls") pod "dns-default-tqr92" (UID: "f0587da4-0df5-48c6-9df5-3b69cc457181") : secret "dns-default-metrics-tls" not found Jun 02 05:46:50.599673 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:46:50.599421 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert podName:3e1a7f6b-52e8-4248-b043-8248779a965a nodeName:}" failed. No retries permitted until 2026-06-02 05:47:06.599414831 +0000 UTC m=+64.731295699 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert") pod "ingress-canary-758p5" (UID: "3e1a7f6b-52e8-4248-b043-8248779a965a") : secret "canary-serving-cert" not found Jun 02 05:47:02.640146 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:02.640117 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j46gm" Jun 02 05:47:06.601765 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:06.601697 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls\") pod \"dns-default-tqr92\" (UID: \"f0587da4-0df5-48c6-9df5-3b69cc457181\") " pod="openshift-dns/dns-default-tqr92" Jun 02 05:47:06.601765 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:06.601778 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert\") pod \"ingress-canary-758p5\" (UID: \"3e1a7f6b-52e8-4248-b043-8248779a965a\") " pod="openshift-ingress-canary/ingress-canary-758p5" Jun 02 05:47:06.602185 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:06.601882 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 05:47:06.602185 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:06.601954 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls podName:f0587da4-0df5-48c6-9df5-3b69cc457181 nodeName:}" failed. No retries permitted until 2026-06-02 05:47:38.60193784 +0000 UTC m=+96.733818715 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls") pod "dns-default-tqr92" (UID: "f0587da4-0df5-48c6-9df5-3b69cc457181") : secret "dns-default-metrics-tls" not found Jun 02 05:47:06.602185 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:06.601891 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 05:47:06.602185 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:06.602013 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert podName:3e1a7f6b-52e8-4248-b043-8248779a965a nodeName:}" failed. No retries permitted until 2026-06-02 05:47:38.602001733 +0000 UTC m=+96.733882602 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert") pod "ingress-canary-758p5" (UID: "3e1a7f6b-52e8-4248-b043-8248779a965a") : secret "canary-serving-cert" not found Jun 02 05:47:08.113131 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:08.113088 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs\") pod \"network-metrics-daemon-6btlj\" (UID: \"e1171123-67a2-45d0-b42e-c0b5c97d9e5a\") " pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:47:08.113607 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:08.113238 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 05:47:08.113607 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:08.113309 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs podName:e1171123-67a2-45d0-b42e-c0b5c97d9e5a nodeName:}" failed. No retries permitted until 2026-06-02 05:48:12.113293689 +0000 UTC m=+130.245174557 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs") pod "network-metrics-daemon-6btlj" (UID: "e1171123-67a2-45d0-b42e-c0b5c97d9e5a") : secret "metrics-daemon-secret" not found Jun 02 05:47:14.675302 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:14.675272 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vjzk2" Jun 02 05:47:24.242681 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:24.242560 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5bb468cc95-h6d4x"] Jun 02 05:47:24.246486 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:24.246469 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:24.248859 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:24.248828 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 02 05:47:24.248859 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:24.248839 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 02 05:47:24.249067 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:24.248888 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 02 05:47:24.249067 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:24.248906 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-bqszq\"" Jun 02 05:47:24.249171 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:24.249139 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 02 05:47:24.249969 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:24.249953 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 05:47:24.250060 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:24.249953 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 05:47:24.254644 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:24.254624 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5bb468cc95-h6d4x"] Jun 02 05:47:24.320811 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:24.320780 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-stats-auth\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:24.320957 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:24.320837 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-default-certificate\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:24.320957 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:24.320864 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-service-ca-bundle\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:24.320957 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:24.320881 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6475g\" (UniqueName: \"kubernetes.io/projected/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-kube-api-access-6475g\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:24.320957 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:24.320908 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-metrics-certs\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:24.421720 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:24.421684 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-metrics-certs\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:24.421720 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:24.421737 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-stats-auth\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:24.421976 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:24.421827 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 05:47:24.421976 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:24.421911 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-metrics-certs podName:3c4d7e14-ce85-4a4a-b566-3afbab8fc451 nodeName:}" failed. No retries permitted until 2026-06-02 05:47:24.921893548 +0000 UTC m=+83.053774419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-metrics-certs") pod "router-default-5bb468cc95-h6d4x" (UID: "3c4d7e14-ce85-4a4a-b566-3afbab8fc451") : secret "router-metrics-certs-default" not found Jun 02 05:47:24.421976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:24.421930 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-default-certificate\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:24.421976 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:24.421970 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-service-ca-bundle\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:24.422181 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:24.421998 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6475g\" (UniqueName: \"kubernetes.io/projected/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-kube-api-access-6475g\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:24.422181 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:24.422082 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-service-ca-bundle podName:3c4d7e14-ce85-4a4a-b566-3afbab8fc451 nodeName:}" failed. No retries permitted until 2026-06-02 05:47:24.922066372 +0000 UTC m=+83.053947241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-service-ca-bundle") pod "router-default-5bb468cc95-h6d4x" (UID: "3c4d7e14-ce85-4a4a-b566-3afbab8fc451") : configmap references non-existent config key: service-ca.crt Jun 02 05:47:24.424975 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:24.424947 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-stats-auth\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:24.425093 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:24.425070 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-default-certificate\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:24.430391 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:24.430372 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6475g\" (UniqueName: \"kubernetes.io/projected/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-kube-api-access-6475g\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:24.924085 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:24.924026 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-metrics-certs\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:24.924272 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:24.924116 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-service-ca-bundle\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:24.924272 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:24.924187 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 05:47:24.924272 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:24.924225 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-service-ca-bundle podName:3c4d7e14-ce85-4a4a-b566-3afbab8fc451 nodeName:}" failed. No retries permitted until 2026-06-02 05:47:25.924211763 +0000 UTC m=+84.056092637 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-service-ca-bundle") pod "router-default-5bb468cc95-h6d4x" (UID: "3c4d7e14-ce85-4a4a-b566-3afbab8fc451") : configmap references non-existent config key: service-ca.crt Jun 02 05:47:24.924272 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:24.924248 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-metrics-certs podName:3c4d7e14-ce85-4a4a-b566-3afbab8fc451 nodeName:}" failed. No retries permitted until 2026-06-02 05:47:25.924234037 +0000 UTC m=+84.056114910 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-metrics-certs") pod "router-default-5bb468cc95-h6d4x" (UID: "3c4d7e14-ce85-4a4a-b566-3afbab8fc451") : secret "router-metrics-certs-default" not found Jun 02 05:47:25.931490 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:25.931434 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-metrics-certs\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:25.931904 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:25.931603 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-service-ca-bundle\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:25.931904 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:25.931601 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 05:47:25.931904 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:25.931679 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-metrics-certs podName:3c4d7e14-ce85-4a4a-b566-3afbab8fc451 nodeName:}" failed. No retries permitted until 2026-06-02 05:47:27.93166396 +0000 UTC m=+86.063544830 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-metrics-certs") pod "router-default-5bb468cc95-h6d4x" (UID: "3c4d7e14-ce85-4a4a-b566-3afbab8fc451") : secret "router-metrics-certs-default" not found Jun 02 05:47:25.931904 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:25.931692 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-service-ca-bundle podName:3c4d7e14-ce85-4a4a-b566-3afbab8fc451 nodeName:}" failed. No retries permitted until 2026-06-02 05:47:27.931686129 +0000 UTC m=+86.063566998 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-service-ca-bundle") pod "router-default-5bb468cc95-h6d4x" (UID: "3c4d7e14-ce85-4a4a-b566-3afbab8fc451") : configmap references non-existent config key: service-ca.crt Jun 02 05:47:27.945198 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:27.945160 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-metrics-certs\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:27.945589 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:27.945298 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-service-ca-bundle\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:27.945589 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:27.945305 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 05:47:27.945589 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:27.945365 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-metrics-certs podName:3c4d7e14-ce85-4a4a-b566-3afbab8fc451 nodeName:}" failed. No retries permitted until 2026-06-02 05:47:31.945348312 +0000 UTC m=+90.077229185 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-metrics-certs") pod "router-default-5bb468cc95-h6d4x" (UID: "3c4d7e14-ce85-4a4a-b566-3afbab8fc451") : secret "router-metrics-certs-default" not found Jun 02 05:47:27.945589 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:27.945386 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-service-ca-bundle podName:3c4d7e14-ce85-4a4a-b566-3afbab8fc451 nodeName:}" failed. No retries permitted until 2026-06-02 05:47:31.945374278 +0000 UTC m=+90.077255153 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-service-ca-bundle") pod "router-default-5bb468cc95-h6d4x" (UID: "3c4d7e14-ce85-4a4a-b566-3afbab8fc451") : configmap references non-existent config key: service-ca.crt Jun 02 05:47:29.249038 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:29.249001 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w9kbp"] Jun 02 05:47:29.252160 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:29.252136 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w9kbp" Jun 02 05:47:29.254425 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:29.254406 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 02 05:47:29.255363 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:29.255347 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 02 05:47:29.255446 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:29.255388 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-wnqz4\"" Jun 02 05:47:29.259559 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:29.259537 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w9kbp"] Jun 02 05:47:29.356028 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:29.355995 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj9mh\" (UniqueName: \"kubernetes.io/projected/7a099b02-5b14-41ce-9043-2381220fa89c-kube-api-access-dj9mh\") pod \"volume-data-source-validator-7598fd5bd-w9kbp\" (UID: \"7a099b02-5b14-41ce-9043-2381220fa89c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w9kbp" Jun 02 05:47:29.456717 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:29.456673 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dj9mh\" (UniqueName: \"kubernetes.io/projected/7a099b02-5b14-41ce-9043-2381220fa89c-kube-api-access-dj9mh\") pod \"volume-data-source-validator-7598fd5bd-w9kbp\" (UID: \"7a099b02-5b14-41ce-9043-2381220fa89c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w9kbp" Jun 02 05:47:29.464686 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:29.464654 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj9mh\" (UniqueName: \"kubernetes.io/projected/7a099b02-5b14-41ce-9043-2381220fa89c-kube-api-access-dj9mh\") pod \"volume-data-source-validator-7598fd5bd-w9kbp\" (UID: \"7a099b02-5b14-41ce-9043-2381220fa89c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w9kbp" Jun 02 05:47:29.561739 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:29.561700 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w9kbp" Jun 02 05:47:29.679169 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:29.679141 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w9kbp"] Jun 02 05:47:29.682201 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:47:29.682167 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a099b02_5b14_41ce_9043_2381220fa89c.slice/crio-0f2de35695405e9956575a9421ea13719d114b78f9a2b238ea3d067e88511424 WatchSource:0}: Error finding container 0f2de35695405e9956575a9421ea13719d114b78f9a2b238ea3d067e88511424: Status 404 returned error can't find the container with id 0f2de35695405e9956575a9421ea13719d114b78f9a2b238ea3d067e88511424 Jun 02 05:47:29.756028 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:29.755999 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w9kbp" event={"ID":"7a099b02-5b14-41ce-9043-2381220fa89c","Type":"ContainerStarted","Data":"0f2de35695405e9956575a9421ea13719d114b78f9a2b238ea3d067e88511424"} Jun 02 05:47:30.247663 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:30.247628 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-9qqgq"] Jun 02 05:47:30.250339 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:30.250322 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" Jun 02 05:47:30.253030 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:30.253008 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 02 05:47:30.253817 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:30.253800 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 02 05:47:30.253913 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:30.253804 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-xrrjs\"" Jun 02 05:47:30.254093 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:30.254070 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 02 05:47:30.254176 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:30.254075 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 02 05:47:30.259716 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:30.259691 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 02 05:47:30.262399 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:30.262379 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-9qqgq"] Jun 02 05:47:30.363739 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:30.363703 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxcxr\" (UniqueName: \"kubernetes.io/projected/b68ed6d7-9e23-4f45-a0fb-18ca25e28836-kube-api-access-hxcxr\") pod \"console-operator-86d7c6cc77-9qqgq\" (UID: \"b68ed6d7-9e23-4f45-a0fb-18ca25e28836\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" Jun 02 05:47:30.363904 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:30.363842 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b68ed6d7-9e23-4f45-a0fb-18ca25e28836-config\") pod \"console-operator-86d7c6cc77-9qqgq\" (UID: \"b68ed6d7-9e23-4f45-a0fb-18ca25e28836\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" Jun 02 05:47:30.363904 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:30.363888 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b68ed6d7-9e23-4f45-a0fb-18ca25e28836-trusted-ca\") pod \"console-operator-86d7c6cc77-9qqgq\" (UID: \"b68ed6d7-9e23-4f45-a0fb-18ca25e28836\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" Jun 02 05:47:30.364011 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:30.363937 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b68ed6d7-9e23-4f45-a0fb-18ca25e28836-serving-cert\") pod \"console-operator-86d7c6cc77-9qqgq\" (UID: \"b68ed6d7-9e23-4f45-a0fb-18ca25e28836\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" Jun 02 05:47:30.465155 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:30.465101 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b68ed6d7-9e23-4f45-a0fb-18ca25e28836-config\") pod \"console-operator-86d7c6cc77-9qqgq\" (UID: \"b68ed6d7-9e23-4f45-a0fb-18ca25e28836\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" Jun 02 05:47:30.465155 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:30.465159 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b68ed6d7-9e23-4f45-a0fb-18ca25e28836-trusted-ca\") pod \"console-operator-86d7c6cc77-9qqgq\" (UID: \"b68ed6d7-9e23-4f45-a0fb-18ca25e28836\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" Jun 02 05:47:30.465405 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:30.465306 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b68ed6d7-9e23-4f45-a0fb-18ca25e28836-serving-cert\") pod \"console-operator-86d7c6cc77-9qqgq\" (UID: \"b68ed6d7-9e23-4f45-a0fb-18ca25e28836\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" Jun 02 05:47:30.465567 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:30.465418 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hxcxr\" (UniqueName: \"kubernetes.io/projected/b68ed6d7-9e23-4f45-a0fb-18ca25e28836-kube-api-access-hxcxr\") pod \"console-operator-86d7c6cc77-9qqgq\" (UID: \"b68ed6d7-9e23-4f45-a0fb-18ca25e28836\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" Jun 02 05:47:30.465995 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:30.465962 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b68ed6d7-9e23-4f45-a0fb-18ca25e28836-config\") pod \"console-operator-86d7c6cc77-9qqgq\" (UID: \"b68ed6d7-9e23-4f45-a0fb-18ca25e28836\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" Jun 02 05:47:30.466218 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:30.466196 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b68ed6d7-9e23-4f45-a0fb-18ca25e28836-trusted-ca\") pod \"console-operator-86d7c6cc77-9qqgq\" (UID: \"b68ed6d7-9e23-4f45-a0fb-18ca25e28836\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" Jun 02 05:47:30.467928 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:30.467900 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b68ed6d7-9e23-4f45-a0fb-18ca25e28836-serving-cert\") pod \"console-operator-86d7c6cc77-9qqgq\" (UID: \"b68ed6d7-9e23-4f45-a0fb-18ca25e28836\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" Jun 02 05:47:30.474598 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:30.474572 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxcxr\" (UniqueName: \"kubernetes.io/projected/b68ed6d7-9e23-4f45-a0fb-18ca25e28836-kube-api-access-hxcxr\") pod \"console-operator-86d7c6cc77-9qqgq\" (UID: \"b68ed6d7-9e23-4f45-a0fb-18ca25e28836\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" Jun 02 05:47:30.539155 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:30.539072 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zhf22_50b96b68-af8d-432e-ab2d-b682a7154685/dns-node-resolver/0.log" Jun 02 05:47:30.561584 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:30.561555 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" Jun 02 05:47:30.686399 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:30.686363 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-9qqgq"] Jun 02 05:47:30.688885 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:47:30.688857 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb68ed6d7_9e23_4f45_a0fb_18ca25e28836.slice/crio-3076793fab1e846369f09c9431324f42a8fde75e7365fb7507e415a62e4a4ec3 WatchSource:0}: Error finding container 3076793fab1e846369f09c9431324f42a8fde75e7365fb7507e415a62e4a4ec3: Status 404 returned error can't find the container with id 3076793fab1e846369f09c9431324f42a8fde75e7365fb7507e415a62e4a4ec3 Jun 02 05:47:30.758923 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:30.758881 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" event={"ID":"b68ed6d7-9e23-4f45-a0fb-18ca25e28836","Type":"ContainerStarted","Data":"3076793fab1e846369f09c9431324f42a8fde75e7365fb7507e415a62e4a4ec3"} Jun 02 05:47:31.137468 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:31.137441 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c9qtg_ed81080d-7e5f-4b48-afc2-084a239754c3/node-ca/0.log" Jun 02 05:47:31.762691 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:31.762651 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w9kbp" event={"ID":"7a099b02-5b14-41ce-9043-2381220fa89c","Type":"ContainerStarted","Data":"800c6cdc22e898a8f9862d263fea3abb834bf5af6db54722d6702866d39b70db"} Jun 02 05:47:31.778040 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:31.777989 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w9kbp" podStartSLOduration=1.435930265 podStartE2EDuration="2.777970689s" podCreationTimestamp="2026-06-02 05:47:29 +0000 UTC" firstStartedPulling="2026-06-02 05:47:29.686069614 +0000 UTC m=+87.817950487" lastFinishedPulling="2026-06-02 05:47:31.02811004 +0000 UTC m=+89.159990911" observedRunningTime="2026-06-02 05:47:31.77714439 +0000 UTC m=+89.909025282" watchObservedRunningTime="2026-06-02 05:47:31.777970689 +0000 UTC m=+89.909851599" Jun 02 05:47:31.978999 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:31.978937 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-metrics-certs\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:31.979172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:31.979084 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-service-ca-bundle\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:31.979172 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:31.979097 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 05:47:31.979172 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:31.979173 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-metrics-certs podName:3c4d7e14-ce85-4a4a-b566-3afbab8fc451 nodeName:}" failed. No retries permitted until 2026-06-02 05:47:39.979152096 +0000 UTC m=+98.111032976 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-metrics-certs") pod "router-default-5bb468cc95-h6d4x" (UID: "3c4d7e14-ce85-4a4a-b566-3afbab8fc451") : secret "router-metrics-certs-default" not found Jun 02 05:47:31.979300 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:31.979214 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-service-ca-bundle podName:3c4d7e14-ce85-4a4a-b566-3afbab8fc451 nodeName:}" failed. No retries permitted until 2026-06-02 05:47:39.97919706 +0000 UTC m=+98.111077951 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-service-ca-bundle") pod "router-default-5bb468cc95-h6d4x" (UID: "3c4d7e14-ce85-4a4a-b566-3afbab8fc451") : configmap references non-existent config key: service-ca.crt Jun 02 05:47:33.768425 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:33.768393 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qqgq_b68ed6d7-9e23-4f45-a0fb-18ca25e28836/console-operator/0.log" Jun 02 05:47:33.768812 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:33.768434 2575 generic.go:358] "Generic (PLEG): container finished" podID="b68ed6d7-9e23-4f45-a0fb-18ca25e28836" containerID="afe3992663a4719f6c1ce502e89daa305fc9bd69d57e83243d9f4b545de1386b" exitCode=255 Jun 02 05:47:33.768812 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:33.768463 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" event={"ID":"b68ed6d7-9e23-4f45-a0fb-18ca25e28836","Type":"ContainerDied","Data":"afe3992663a4719f6c1ce502e89daa305fc9bd69d57e83243d9f4b545de1386b"} Jun 02 05:47:33.768812 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:33.768757 2575 scope.go:117] "RemoveContainer" containerID="afe3992663a4719f6c1ce502e89daa305fc9bd69d57e83243d9f4b545de1386b" Jun 02 05:47:34.348892 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:34.348851 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-xk66t"] Jun 02 05:47:34.351866 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:34.351842 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-xk66t" Jun 02 05:47:34.354264 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:34.354241 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 02 05:47:34.354264 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:34.354261 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 02 05:47:34.354532 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:34.354289 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 02 05:47:34.354532 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:34.354362 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6sknq\"" Jun 02 05:47:34.354532 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:34.354397 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 02 05:47:34.358000 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:34.357958 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-xk66t"] Jun 02 05:47:34.399762 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:34.399711 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d1f8d560-1e9f-42d4-8518-e019c0dbede4-config\") pod \"service-ca-operator-69877444c-xk66t\" (UID: \"d1f8d560-1e9f-42d4-8518-e019c0dbede4\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-xk66t" Jun 02 05:47:34.399887 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:34.399769 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1f8d560-1e9f-42d4-8518-e019c0dbede4-serving-cert\") pod \"service-ca-operator-69877444c-xk66t\" (UID: \"d1f8d560-1e9f-42d4-8518-e019c0dbede4\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-xk66t" Jun 02 05:47:34.399929 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:34.399897 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjqgl\" (UniqueName: \"kubernetes.io/projected/d1f8d560-1e9f-42d4-8518-e019c0dbede4-kube-api-access-tjqgl\") pod \"service-ca-operator-69877444c-xk66t\" (UID: \"d1f8d560-1e9f-42d4-8518-e019c0dbede4\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-xk66t" Jun 02 05:47:34.500967 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:34.500935 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tjqgl\" (UniqueName: \"kubernetes.io/projected/d1f8d560-1e9f-42d4-8518-e019c0dbede4-kube-api-access-tjqgl\") pod \"service-ca-operator-69877444c-xk66t\" (UID: \"d1f8d560-1e9f-42d4-8518-e019c0dbede4\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-xk66t" Jun 02 05:47:34.501095 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:34.500981 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d1f8d560-1e9f-42d4-8518-e019c0dbede4-config\") pod \"service-ca-operator-69877444c-xk66t\" (UID: \"d1f8d560-1e9f-42d4-8518-e019c0dbede4\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-xk66t" Jun 02 05:47:34.501095 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:34.501006 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1f8d560-1e9f-42d4-8518-e019c0dbede4-serving-cert\") pod \"service-ca-operator-69877444c-xk66t\" (UID: \"d1f8d560-1e9f-42d4-8518-e019c0dbede4\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-xk66t" Jun 02 05:47:34.501631 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:34.501611 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d1f8d560-1e9f-42d4-8518-e019c0dbede4-config\") pod \"service-ca-operator-69877444c-xk66t\" (UID: \"d1f8d560-1e9f-42d4-8518-e019c0dbede4\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-xk66t" Jun 02 05:47:34.503227 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:34.503195 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1f8d560-1e9f-42d4-8518-e019c0dbede4-serving-cert\") pod \"service-ca-operator-69877444c-xk66t\" (UID: \"d1f8d560-1e9f-42d4-8518-e019c0dbede4\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-xk66t" Jun 02 05:47:34.514666 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:34.514646 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjqgl\" (UniqueName: \"kubernetes.io/projected/d1f8d560-1e9f-42d4-8518-e019c0dbede4-kube-api-access-tjqgl\") pod \"service-ca-operator-69877444c-xk66t\" (UID: \"d1f8d560-1e9f-42d4-8518-e019c0dbede4\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-xk66t" Jun 02 05:47:34.662261 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:34.662177 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-xk66t" Jun 02 05:47:34.772797 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:34.772770 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qqgq_b68ed6d7-9e23-4f45-a0fb-18ca25e28836/console-operator/1.log" Jun 02 05:47:34.773187 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:34.773171 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qqgq_b68ed6d7-9e23-4f45-a0fb-18ca25e28836/console-operator/0.log" Jun 02 05:47:34.773234 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:34.773206 2575 generic.go:358] "Generic (PLEG): container finished" podID="b68ed6d7-9e23-4f45-a0fb-18ca25e28836" containerID="faa1f139d2fbe78dcb2c347c06b371814f1a6887d92c04e208468eff7b4949ec" exitCode=255 Jun 02 05:47:34.773275 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:34.773262 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" event={"ID":"b68ed6d7-9e23-4f45-a0fb-18ca25e28836","Type":"ContainerDied","Data":"faa1f139d2fbe78dcb2c347c06b371814f1a6887d92c04e208468eff7b4949ec"} Jun 02 05:47:34.773309 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:34.773296 2575 scope.go:117] "RemoveContainer" containerID="afe3992663a4719f6c1ce502e89daa305fc9bd69d57e83243d9f4b545de1386b" Jun 02 05:47:34.773519 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:34.773503 2575 scope.go:117] "RemoveContainer" containerID="faa1f139d2fbe78dcb2c347c06b371814f1a6887d92c04e208468eff7b4949ec" Jun 02 05:47:34.773715 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:34.773695 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-9qqgq_openshift-console-operator(b68ed6d7-9e23-4f45-a0fb-18ca25e28836)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" podUID="b68ed6d7-9e23-4f45-a0fb-18ca25e28836" Jun 02 05:47:34.779708 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:34.779683 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-xk66t"] Jun 02 05:47:34.783864 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:47:34.783844 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f8d560_1e9f_42d4_8518_e019c0dbede4.slice/crio-286fcba9e746b2d84b582f23c202109f17f4bdf5371291adcb539f9a3d317e49 WatchSource:0}: Error finding container 286fcba9e746b2d84b582f23c202109f17f4bdf5371291adcb539f9a3d317e49: Status 404 returned error can't find the container with id 286fcba9e746b2d84b582f23c202109f17f4bdf5371291adcb539f9a3d317e49 Jun 02 05:47:35.776711 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:35.776683 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qqgq_b68ed6d7-9e23-4f45-a0fb-18ca25e28836/console-operator/1.log" Jun 02 05:47:35.777183 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:35.777105 2575 scope.go:117] "RemoveContainer" containerID="faa1f139d2fbe78dcb2c347c06b371814f1a6887d92c04e208468eff7b4949ec" Jun 02 05:47:35.777354 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:35.777324 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-9qqgq_openshift-console-operator(b68ed6d7-9e23-4f45-a0fb-18ca25e28836)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" podUID="b68ed6d7-9e23-4f45-a0fb-18ca25e28836" Jun 02 05:47:35.778002 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:35.777976 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-xk66t" event={"ID":"d1f8d560-1e9f-42d4-8518-e019c0dbede4","Type":"ContainerStarted","Data":"286fcba9e746b2d84b582f23c202109f17f4bdf5371291adcb539f9a3d317e49"} Jun 02 05:47:37.784159 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:37.784061 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-xk66t" event={"ID":"d1f8d560-1e9f-42d4-8518-e019c0dbede4","Type":"ContainerStarted","Data":"ef2a068d8a52a0ec140b1e970f6915ffd362db13081782730a6fb668cb3399dd"} Jun 02 05:47:37.801068 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:37.801019 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-xk66t" podStartSLOduration=1.178679297 podStartE2EDuration="3.801003839s" podCreationTimestamp="2026-06-02 05:47:34 +0000 UTC" firstStartedPulling="2026-06-02 05:47:34.785882073 +0000 UTC m=+92.917762956" lastFinishedPulling="2026-06-02 05:47:37.408206611 +0000 UTC m=+95.540087498" observedRunningTime="2026-06-02 05:47:37.799946428 +0000 UTC m=+95.931827320" watchObservedRunningTime="2026-06-02 05:47:37.801003839 +0000 UTC m=+95.932884729" Jun 02 05:47:37.965703 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:37.965664 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-cjw8l"] Jun 02 05:47:37.968785 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:37.968768 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-cjw8l" Jun 02 05:47:37.972008 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:37.971975 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-wq84g\"" Jun 02 05:47:37.979159 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:37.979136 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-cjw8l"] Jun 02 05:47:38.031804 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:38.031768 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct467\" (UniqueName: \"kubernetes.io/projected/d5a5ceaf-da3b-4647-ab4e-2364d1885410-kube-api-access-ct467\") pod \"network-check-source-56d84b9f44-cjw8l\" (UID: \"d5a5ceaf-da3b-4647-ab4e-2364d1885410\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-cjw8l" Jun 02 05:47:38.132643 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:38.132600 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ct467\" (UniqueName: \"kubernetes.io/projected/d5a5ceaf-da3b-4647-ab4e-2364d1885410-kube-api-access-ct467\") pod \"network-check-source-56d84b9f44-cjw8l\" (UID: \"d5a5ceaf-da3b-4647-ab4e-2364d1885410\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-cjw8l" Jun 02 05:47:38.141373 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:38.141347 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct467\" (UniqueName: \"kubernetes.io/projected/d5a5ceaf-da3b-4647-ab4e-2364d1885410-kube-api-access-ct467\") pod \"network-check-source-56d84b9f44-cjw8l\" (UID: \"d5a5ceaf-da3b-4647-ab4e-2364d1885410\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-cjw8l" Jun 02 05:47:38.277338 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:38.277292 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-cjw8l" Jun 02 05:47:38.421775 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:38.421677 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-cjw8l"] Jun 02 05:47:38.424928 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:47:38.424902 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5a5ceaf_da3b_4647_ab4e_2364d1885410.slice/crio-cf11433a045f8a18f87119c240d678bac15b3e00ce6ca5a09b8aaf21687f668b WatchSource:0}: Error finding container cf11433a045f8a18f87119c240d678bac15b3e00ce6ca5a09b8aaf21687f668b: Status 404 returned error can't find the container with id cf11433a045f8a18f87119c240d678bac15b3e00ce6ca5a09b8aaf21687f668b Jun 02 05:47:38.637921 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:38.637875 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls\") pod \"dns-default-tqr92\" (UID: \"f0587da4-0df5-48c6-9df5-3b69cc457181\") " pod="openshift-dns/dns-default-tqr92" Jun 02 05:47:38.638086 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:38.637940 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert\") pod \"ingress-canary-758p5\" (UID: \"3e1a7f6b-52e8-4248-b043-8248779a965a\") " pod="openshift-ingress-canary/ingress-canary-758p5" Jun 02 05:47:38.638141 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:38.638107 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 05:47:38.638202 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:38.638179 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert podName:3e1a7f6b-52e8-4248-b043-8248779a965a nodeName:}" failed. No retries permitted until 2026-06-02 05:48:42.638160103 +0000 UTC m=+160.770040988 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert") pod "ingress-canary-758p5" (UID: "3e1a7f6b-52e8-4248-b043-8248779a965a") : secret "canary-serving-cert" not found Jun 02 05:47:38.638675 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:38.638579 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 05:47:38.638675 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:38.638634 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls podName:f0587da4-0df5-48c6-9df5-3b69cc457181 nodeName:}" failed. No retries permitted until 2026-06-02 05:48:42.638617989 +0000 UTC m=+160.770498860 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls") pod "dns-default-tqr92" (UID: "f0587da4-0df5-48c6-9df5-3b69cc457181") : secret "dns-default-metrics-tls" not found Jun 02 05:47:38.788880 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:38.788789 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-cjw8l" event={"ID":"d5a5ceaf-da3b-4647-ab4e-2364d1885410","Type":"ContainerStarted","Data":"e608a0aaf82fe447da95206c5380bf33a93eeb5df7fd3d61b73de7d96964533d"} Jun 02 05:47:38.788880 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:38.788840 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-cjw8l" event={"ID":"d5a5ceaf-da3b-4647-ab4e-2364d1885410","Type":"ContainerStarted","Data":"cf11433a045f8a18f87119c240d678bac15b3e00ce6ca5a09b8aaf21687f668b"} Jun 02 05:47:38.805140 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:38.805090 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-cjw8l" podStartSLOduration=1.8050766660000002 podStartE2EDuration="1.805076666s" podCreationTimestamp="2026-06-02 05:47:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 05:47:38.804280539 +0000 UTC m=+96.936161430" watchObservedRunningTime="2026-06-02 05:47:38.805076666 +0000 UTC m=+96.936957598" Jun 02 05:47:40.047819 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:40.047776 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-metrics-certs\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:40.048333 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:40.047889 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-service-ca-bundle\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:40.048333 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:40.047954 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 05:47:40.048333 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:40.048040 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-metrics-certs podName:3c4d7e14-ce85-4a4a-b566-3afbab8fc451 nodeName:}" failed. No retries permitted until 2026-06-02 05:47:56.048017143 +0000 UTC m=+114.179898023 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-metrics-certs") pod "router-default-5bb468cc95-h6d4x" (UID: "3c4d7e14-ce85-4a4a-b566-3afbab8fc451") : secret "router-metrics-certs-default" not found Jun 02 05:47:40.048333 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:40.048063 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-service-ca-bundle podName:3c4d7e14-ce85-4a4a-b566-3afbab8fc451 nodeName:}" failed. No retries permitted until 2026-06-02 05:47:56.048052266 +0000 UTC m=+114.179933136 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-service-ca-bundle") pod "router-default-5bb468cc95-h6d4x" (UID: "3c4d7e14-ce85-4a4a-b566-3afbab8fc451") : configmap references non-existent config key: service-ca.crt Jun 02 05:47:40.562577 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:40.562551 2575 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" Jun 02 05:47:40.562720 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:40.562588 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" Jun 02 05:47:40.562952 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:40.562939 2575 scope.go:117] "RemoveContainer" containerID="faa1f139d2fbe78dcb2c347c06b371814f1a6887d92c04e208468eff7b4949ec" Jun 02 05:47:40.563105 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:40.563089 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-9qqgq_openshift-console-operator(b68ed6d7-9e23-4f45-a0fb-18ca25e28836)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" podUID="b68ed6d7-9e23-4f45-a0fb-18ca25e28836" Jun 02 05:47:55.350207 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:55.350174 2575 scope.go:117] "RemoveContainer" containerID="faa1f139d2fbe78dcb2c347c06b371814f1a6887d92c04e208468eff7b4949ec" Jun 02 05:47:55.827805 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:55.827777 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qqgq_b68ed6d7-9e23-4f45-a0fb-18ca25e28836/console-operator/2.log" Jun 02 05:47:55.828164 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:55.828149 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qqgq_b68ed6d7-9e23-4f45-a0fb-18ca25e28836/console-operator/1.log" Jun 02 05:47:55.828218 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:55.828181 2575 generic.go:358] "Generic (PLEG): container finished" podID="b68ed6d7-9e23-4f45-a0fb-18ca25e28836" containerID="8212413d2fbb7a8912abe7c6f78a42caba1d9860445213a068d1f3025e3790c8" exitCode=255 Jun 02 05:47:55.828260 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:55.828246 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" event={"ID":"b68ed6d7-9e23-4f45-a0fb-18ca25e28836","Type":"ContainerDied","Data":"8212413d2fbb7a8912abe7c6f78a42caba1d9860445213a068d1f3025e3790c8"} Jun 02 05:47:55.828294 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:55.828281 2575 scope.go:117] "RemoveContainer" containerID="faa1f139d2fbe78dcb2c347c06b371814f1a6887d92c04e208468eff7b4949ec" Jun 02 05:47:55.828606 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:55.828584 2575 scope.go:117] "RemoveContainer" containerID="8212413d2fbb7a8912abe7c6f78a42caba1d9860445213a068d1f3025e3790c8" Jun 02 05:47:55.828799 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:47:55.828780 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-9qqgq_openshift-console-operator(b68ed6d7-9e23-4f45-a0fb-18ca25e28836)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" podUID="b68ed6d7-9e23-4f45-a0fb-18ca25e28836" Jun 02 05:47:56.077944 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:56.077849 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-metrics-certs\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:56.078087 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:56.078022 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-service-ca-bundle\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:56.078530 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:56.078512 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-service-ca-bundle\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:56.080196 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:56.080175 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4d7e14-ce85-4a4a-b566-3afbab8fc451-metrics-certs\") pod \"router-default-5bb468cc95-h6d4x\" (UID: \"3c4d7e14-ce85-4a4a-b566-3afbab8fc451\") " pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:56.355614 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:56.355528 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:56.482504 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:56.482470 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5bb468cc95-h6d4x"] Jun 02 05:47:56.485205 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:47:56.485175 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c4d7e14_ce85_4a4a_b566_3afbab8fc451.slice/crio-14b4037a8522504476cb2e3c0611dc8e9813bad2cc3eab8c1ed72fab427d82e2 WatchSource:0}: Error finding container 14b4037a8522504476cb2e3c0611dc8e9813bad2cc3eab8c1ed72fab427d82e2: Status 404 returned error can't find the container with id 14b4037a8522504476cb2e3c0611dc8e9813bad2cc3eab8c1ed72fab427d82e2 Jun 02 05:47:56.831683 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:56.831647 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5bb468cc95-h6d4x" event={"ID":"3c4d7e14-ce85-4a4a-b566-3afbab8fc451","Type":"ContainerStarted","Data":"b7e7081afa0420bae7c145ae08d11b628b829b37458fcfdec0745c0394c2df9b"} Jun 02 05:47:56.831887 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:56.831690 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5bb468cc95-h6d4x" event={"ID":"3c4d7e14-ce85-4a4a-b566-3afbab8fc451","Type":"ContainerStarted","Data":"14b4037a8522504476cb2e3c0611dc8e9813bad2cc3eab8c1ed72fab427d82e2"} Jun 02 05:47:56.833008 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:56.832989 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qqgq_b68ed6d7-9e23-4f45-a0fb-18ca25e28836/console-operator/2.log" Jun 02 05:47:56.851710 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:56.851659 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-5bb468cc95-h6d4x" podStartSLOduration=32.851631332 podStartE2EDuration="32.851631332s" podCreationTimestamp="2026-06-02 05:47:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 05:47:56.850905254 +0000 UTC m=+114.982786145" watchObservedRunningTime="2026-06-02 05:47:56.851631332 +0000 UTC m=+114.983512222" Jun 02 05:47:57.356624 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:57.356589 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:57.359084 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:57.359061 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:57.835457 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:57.835388 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:47:57.836586 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:47:57.836565 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5bb468cc95-h6d4x" Jun 02 05:48:00.561923 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:00.561889 2575 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" Jun 02 05:48:00.561923 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:00.561927 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" Jun 02 05:48:00.562338 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:00.562245 2575 scope.go:117] "RemoveContainer" containerID="8212413d2fbb7a8912abe7c6f78a42caba1d9860445213a068d1f3025e3790c8" Jun 02 05:48:00.562421 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:48:00.562403 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-9qqgq_openshift-console-operator(b68ed6d7-9e23-4f45-a0fb-18ca25e28836)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" podUID="b68ed6d7-9e23-4f45-a0fb-18ca25e28836" Jun 02 05:48:03.816580 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.816537 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-lfbgd"] Jun 02 05:48:03.820578 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.820548 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-779b889f76-z6l72"] Jun 02 05:48:03.820707 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.820688 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lfbgd" Jun 02 05:48:03.822924 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.822898 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:03.823254 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.823228 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 02 05:48:03.823357 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.823316 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 02 05:48:03.823463 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.823430 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zxbhk\"" Jun 02 05:48:03.824998 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.824976 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-d76qq\"" Jun 02 05:48:03.825615 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.825598 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 05:48:03.826087 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.826071 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 05:48:03.826427 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.826403 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 05:48:03.829228 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.829208 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-lfbgd"] Jun 02 05:48:03.830445 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.830424 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 05:48:03.839879 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.839857 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-779b889f76-z6l72"] Jun 02 05:48:03.891210 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.891180 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-779b889f76-z6l72"] Jun 02 05:48:03.891583 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:48:03.891554 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-hrrbt registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-779b889f76-z6l72" podUID="413fb520-d5b9-4fcf-8b78-bad153a4ac99" Jun 02 05:48:03.933408 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.933377 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/413fb520-d5b9-4fcf-8b78-bad153a4ac99-registry-certificates\") pod \"image-registry-779b889f76-z6l72\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:03.933532 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.933410 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/413fb520-d5b9-4fcf-8b78-bad153a4ac99-image-registry-private-configuration\") pod \"image-registry-779b889f76-z6l72\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:03.933532 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.933430 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/413fb520-d5b9-4fcf-8b78-bad153a4ac99-bound-sa-token\") pod \"image-registry-779b889f76-z6l72\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:03.933532 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.933457 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/413fb520-d5b9-4fcf-8b78-bad153a4ac99-registry-tls\") pod \"image-registry-779b889f76-z6l72\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:03.933532 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.933518 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/413fb520-d5b9-4fcf-8b78-bad153a4ac99-installation-pull-secrets\") pod \"image-registry-779b889f76-z6l72\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:03.933671 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.933549 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/413fb520-d5b9-4fcf-8b78-bad153a4ac99-trusted-ca\") pod \"image-registry-779b889f76-z6l72\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:03.933671 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.933592 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrrbt\" (UniqueName: \"kubernetes.io/projected/413fb520-d5b9-4fcf-8b78-bad153a4ac99-kube-api-access-hrrbt\") pod \"image-registry-779b889f76-z6l72\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:03.933748 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.933689 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7656a0c7-fe16-4852-9f35-be1a8a3a2ffc-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-lfbgd\" (UID: \"7656a0c7-fe16-4852-9f35-be1a8a3a2ffc\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lfbgd" Jun 02 05:48:03.933748 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.933719 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/413fb520-d5b9-4fcf-8b78-bad153a4ac99-ca-trust-extracted\") pod \"image-registry-779b889f76-z6l72\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:03.933816 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.933765 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7656a0c7-fe16-4852-9f35-be1a8a3a2ffc-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-lfbgd\" (UID: \"7656a0c7-fe16-4852-9f35-be1a8a3a2ffc\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lfbgd" Jun 02 05:48:03.959469 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.959443 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qq6tn"] Jun 02 05:48:03.962152 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.962131 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-7bwpr"] Jun 02 05:48:03.962290 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.962272 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qq6tn" Jun 02 05:48:03.964891 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.964872 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-7bwpr" Jun 02 05:48:03.968700 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:48:03.968662 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" Jun 02 05:48:03.986539 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:48:03.986516 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-tls\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" Jun 02 05:48:03.990959 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:03.990939 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n2hpl\"" Jun 02 05:48:03.991048 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:48:03.990939 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"prometheus-operator-admission-webhook-tls\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" type="*v1.Secret" Jun 02 05:48:03.991048 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:48:03.990940 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"prometheus-operator-admission-webhook-dockercfg-2bmrg\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-2bmrg\"" type="*v1.Secret" Jun 02 05:48:04.002006 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.001982 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 05:48:04.002362 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.002346 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 05:48:04.012062 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.012042 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-7bwpr"] Jun 02 05:48:04.015043 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.015024 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qq6tn"] Jun 02 05:48:04.034977 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.034954 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7656a0c7-fe16-4852-9f35-be1a8a3a2ffc-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-lfbgd\" (UID: \"7656a0c7-fe16-4852-9f35-be1a8a3a2ffc\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lfbgd" Jun 02 05:48:04.035081 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.034986 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67cc0f8d-3ed2-4a60-a4b6-8ff3df258831-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qq6tn\" (UID: \"67cc0f8d-3ed2-4a60-a4b6-8ff3df258831\") " pod="openshift-insights/insights-runtime-extractor-qq6tn" Jun 02 05:48:04.035081 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.035008 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/413fb520-d5b9-4fcf-8b78-bad153a4ac99-ca-trust-extracted\") pod \"image-registry-779b889f76-z6l72\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:04.035081 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.035030 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7656a0c7-fe16-4852-9f35-be1a8a3a2ffc-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-lfbgd\" (UID: \"7656a0c7-fe16-4852-9f35-be1a8a3a2ffc\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lfbgd" Jun 02 05:48:04.035191 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.035169 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/413fb520-d5b9-4fcf-8b78-bad153a4ac99-registry-certificates\") pod \"image-registry-779b889f76-z6l72\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:04.035230 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.035202 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/413fb520-d5b9-4fcf-8b78-bad153a4ac99-image-registry-private-configuration\") pod \"image-registry-779b889f76-z6l72\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:04.035230 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.035225 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/413fb520-d5b9-4fcf-8b78-bad153a4ac99-bound-sa-token\") pod \"image-registry-779b889f76-z6l72\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:04.035311 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.035255 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/67cc0f8d-3ed2-4a60-a4b6-8ff3df258831-data-volume\") pod \"insights-runtime-extractor-qq6tn\" (UID: \"67cc0f8d-3ed2-4a60-a4b6-8ff3df258831\") " pod="openshift-insights/insights-runtime-extractor-qq6tn" Jun 02 05:48:04.035311 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.035291 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k557\" (UniqueName: \"kubernetes.io/projected/67cc0f8d-3ed2-4a60-a4b6-8ff3df258831-kube-api-access-7k557\") pod \"insights-runtime-extractor-qq6tn\" (UID: \"67cc0f8d-3ed2-4a60-a4b6-8ff3df258831\") " pod="openshift-insights/insights-runtime-extractor-qq6tn" Jun 02 05:48:04.035409 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.035339 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/413fb520-d5b9-4fcf-8b78-bad153a4ac99-registry-tls\") pod \"image-registry-779b889f76-z6l72\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:04.035409 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.035389 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/413fb520-d5b9-4fcf-8b78-bad153a4ac99-installation-pull-secrets\") pod \"image-registry-779b889f76-z6l72\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:04.035503 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.035442 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/413fb520-d5b9-4fcf-8b78-bad153a4ac99-trusted-ca\") pod \"image-registry-779b889f76-z6l72\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:04.035503 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.035468 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hrrbt\" (UniqueName: \"kubernetes.io/projected/413fb520-d5b9-4fcf-8b78-bad153a4ac99-kube-api-access-hrrbt\") pod \"image-registry-779b889f76-z6l72\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:04.035596 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.035509 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67cc0f8d-3ed2-4a60-a4b6-8ff3df258831-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qq6tn\" (UID: \"67cc0f8d-3ed2-4a60-a4b6-8ff3df258831\") " pod="openshift-insights/insights-runtime-extractor-qq6tn" Jun 02 05:48:04.035596 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.035540 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/67cc0f8d-3ed2-4a60-a4b6-8ff3df258831-crio-socket\") pod \"insights-runtime-extractor-qq6tn\" (UID: \"67cc0f8d-3ed2-4a60-a4b6-8ff3df258831\") " pod="openshift-insights/insights-runtime-extractor-qq6tn" Jun 02 05:48:04.035596 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.035443 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/413fb520-d5b9-4fcf-8b78-bad153a4ac99-ca-trust-extracted\") pod \"image-registry-779b889f76-z6l72\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:04.035919 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.035872 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7656a0c7-fe16-4852-9f35-be1a8a3a2ffc-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-lfbgd\" (UID: \"7656a0c7-fe16-4852-9f35-be1a8a3a2ffc\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lfbgd" Jun 02 05:48:04.036312 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.036283 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/413fb520-d5b9-4fcf-8b78-bad153a4ac99-registry-certificates\") pod \"image-registry-779b889f76-z6l72\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:04.036684 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.036657 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/413fb520-d5b9-4fcf-8b78-bad153a4ac99-trusted-ca\") pod \"image-registry-779b889f76-z6l72\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:04.037687 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.037663 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7656a0c7-fe16-4852-9f35-be1a8a3a2ffc-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-lfbgd\" (UID: \"7656a0c7-fe16-4852-9f35-be1a8a3a2ffc\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lfbgd" Jun 02 05:48:04.038012 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.037988 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/413fb520-d5b9-4fcf-8b78-bad153a4ac99-installation-pull-secrets\") pod \"image-registry-779b889f76-z6l72\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:04.038096 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.038061 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/413fb520-d5b9-4fcf-8b78-bad153a4ac99-registry-tls\") pod \"image-registry-779b889f76-z6l72\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:04.038349 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.038334 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/413fb520-d5b9-4fcf-8b78-bad153a4ac99-image-registry-private-configuration\") pod \"image-registry-779b889f76-z6l72\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:04.084997 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.084932 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrrbt\" (UniqueName: \"kubernetes.io/projected/413fb520-d5b9-4fcf-8b78-bad153a4ac99-kube-api-access-hrrbt\") pod \"image-registry-779b889f76-z6l72\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:04.085107 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.085061 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/413fb520-d5b9-4fcf-8b78-bad153a4ac99-bound-sa-token\") pod \"image-registry-779b889f76-z6l72\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:04.134257 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.134222 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lfbgd" Jun 02 05:48:04.136029 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.136009 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67cc0f8d-3ed2-4a60-a4b6-8ff3df258831-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qq6tn\" (UID: \"67cc0f8d-3ed2-4a60-a4b6-8ff3df258831\") " pod="openshift-insights/insights-runtime-extractor-qq6tn" Jun 02 05:48:04.136097 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.136038 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/67cc0f8d-3ed2-4a60-a4b6-8ff3df258831-crio-socket\") pod \"insights-runtime-extractor-qq6tn\" (UID: \"67cc0f8d-3ed2-4a60-a4b6-8ff3df258831\") " pod="openshift-insights/insights-runtime-extractor-qq6tn" Jun 02 05:48:04.136097 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.136070 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67cc0f8d-3ed2-4a60-a4b6-8ff3df258831-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qq6tn\" (UID: \"67cc0f8d-3ed2-4a60-a4b6-8ff3df258831\") " pod="openshift-insights/insights-runtime-extractor-qq6tn" Jun 02 05:48:04.136182 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.136160 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/67cc0f8d-3ed2-4a60-a4b6-8ff3df258831-crio-socket\") pod \"insights-runtime-extractor-qq6tn\" (UID: \"67cc0f8d-3ed2-4a60-a4b6-8ff3df258831\") " pod="openshift-insights/insights-runtime-extractor-qq6tn" Jun 02 05:48:04.136227 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.136190 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/67cc0f8d-3ed2-4a60-a4b6-8ff3df258831-data-volume\") pod \"insights-runtime-extractor-qq6tn\" (UID: \"67cc0f8d-3ed2-4a60-a4b6-8ff3df258831\") " pod="openshift-insights/insights-runtime-extractor-qq6tn" Jun 02 05:48:04.136265 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.136222 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7k557\" (UniqueName: \"kubernetes.io/projected/67cc0f8d-3ed2-4a60-a4b6-8ff3df258831-kube-api-access-7k557\") pod \"insights-runtime-extractor-qq6tn\" (UID: \"67cc0f8d-3ed2-4a60-a4b6-8ff3df258831\") " pod="openshift-insights/insights-runtime-extractor-qq6tn" Jun 02 05:48:04.136298 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.136282 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/abda115b-298a-4390-ae97-aa3a722eaf73-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-7bwpr\" (UID: \"abda115b-298a-4390-ae97-aa3a722eaf73\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-7bwpr" Jun 02 05:48:04.136475 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.136456 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/67cc0f8d-3ed2-4a60-a4b6-8ff3df258831-data-volume\") pod \"insights-runtime-extractor-qq6tn\" (UID: \"67cc0f8d-3ed2-4a60-a4b6-8ff3df258831\") " pod="openshift-insights/insights-runtime-extractor-qq6tn" Jun 02 05:48:04.144640 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.144619 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k557\" (UniqueName: \"kubernetes.io/projected/67cc0f8d-3ed2-4a60-a4b6-8ff3df258831-kube-api-access-7k557\") pod \"insights-runtime-extractor-qq6tn\" (UID: \"67cc0f8d-3ed2-4a60-a4b6-8ff3df258831\") " pod="openshift-insights/insights-runtime-extractor-qq6tn" Jun 02 05:48:04.236647 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.236610 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/abda115b-298a-4390-ae97-aa3a722eaf73-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-7bwpr\" (UID: \"abda115b-298a-4390-ae97-aa3a722eaf73\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-7bwpr" Jun 02 05:48:04.256764 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.256719 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-lfbgd"] Jun 02 05:48:04.259665 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:48:04.259644 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7656a0c7_fe16_4852_9f35_be1a8a3a2ffc.slice/crio-eb41967ad7930f5de4307b0727ede30f78a0abe3343390497a4975fd9b69c615 WatchSource:0}: Error finding container eb41967ad7930f5de4307b0727ede30f78a0abe3343390497a4975fd9b69c615: Status 404 returned error can't find the container with id eb41967ad7930f5de4307b0727ede30f78a0abe3343390497a4975fd9b69c615 Jun 02 05:48:04.852698 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.852660 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lfbgd" event={"ID":"7656a0c7-fe16-4852-9f35-be1a8a3a2ffc","Type":"ContainerStarted","Data":"eb41967ad7930f5de4307b0727ede30f78a0abe3343390497a4975fd9b69c615"} Jun 02 05:48:04.852698 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.852700 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:04.857183 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.857162 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:04.894130 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.894103 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 05:48:04.898892 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.898876 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67cc0f8d-3ed2-4a60-a4b6-8ff3df258831-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qq6tn\" (UID: \"67cc0f8d-3ed2-4a60-a4b6-8ff3df258831\") " pod="openshift-insights/insights-runtime-extractor-qq6tn" Jun 02 05:48:04.941647 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.941621 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/413fb520-d5b9-4fcf-8b78-bad153a4ac99-registry-certificates\") pod \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " Jun 02 05:48:04.941758 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.941665 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/413fb520-d5b9-4fcf-8b78-bad153a4ac99-ca-trust-extracted\") pod \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " Jun 02 05:48:04.941758 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.941684 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/413fb520-d5b9-4fcf-8b78-bad153a4ac99-registry-tls\") pod \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " Jun 02 05:48:04.941758 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.941710 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/413fb520-d5b9-4fcf-8b78-bad153a4ac99-trusted-ca\") pod \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " Jun 02 05:48:04.941758 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.941744 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/413fb520-d5b9-4fcf-8b78-bad153a4ac99-image-registry-private-configuration\") pod \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " Jun 02 05:48:04.941934 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.941763 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/413fb520-d5b9-4fcf-8b78-bad153a4ac99-bound-sa-token\") pod \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " Jun 02 05:48:04.941934 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.941783 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/413fb520-d5b9-4fcf-8b78-bad153a4ac99-installation-pull-secrets\") pod \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " Jun 02 05:48:04.941934 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.941861 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrrbt\" (UniqueName: \"kubernetes.io/projected/413fb520-d5b9-4fcf-8b78-bad153a4ac99-kube-api-access-hrrbt\") pod \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\" (UID: \"413fb520-d5b9-4fcf-8b78-bad153a4ac99\") " Jun 02 05:48:04.942088 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.941943 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/413fb520-d5b9-4fcf-8b78-bad153a4ac99-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "413fb520-d5b9-4fcf-8b78-bad153a4ac99" (UID: "413fb520-d5b9-4fcf-8b78-bad153a4ac99"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 05:48:04.942147 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.942089 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/413fb520-d5b9-4fcf-8b78-bad153a4ac99-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "413fb520-d5b9-4fcf-8b78-bad153a4ac99" (UID: "413fb520-d5b9-4fcf-8b78-bad153a4ac99"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 05:48:04.942147 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.942092 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/413fb520-d5b9-4fcf-8b78-bad153a4ac99-ca-trust-extracted\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:48:04.942244 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.942151 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/413fb520-d5b9-4fcf-8b78-bad153a4ac99-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "413fb520-d5b9-4fcf-8b78-bad153a4ac99" (UID: "413fb520-d5b9-4fcf-8b78-bad153a4ac99"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 05:48:04.943971 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.943944 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/413fb520-d5b9-4fcf-8b78-bad153a4ac99-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "413fb520-d5b9-4fcf-8b78-bad153a4ac99" (UID: "413fb520-d5b9-4fcf-8b78-bad153a4ac99"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 05:48:04.943971 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.943954 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/413fb520-d5b9-4fcf-8b78-bad153a4ac99-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "413fb520-d5b9-4fcf-8b78-bad153a4ac99" (UID: "413fb520-d5b9-4fcf-8b78-bad153a4ac99"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 05:48:04.943971 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.943966 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/413fb520-d5b9-4fcf-8b78-bad153a4ac99-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "413fb520-d5b9-4fcf-8b78-bad153a4ac99" (UID: "413fb520-d5b9-4fcf-8b78-bad153a4ac99"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 05:48:04.944229 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.944204 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/413fb520-d5b9-4fcf-8b78-bad153a4ac99-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "413fb520-d5b9-4fcf-8b78-bad153a4ac99" (UID: "413fb520-d5b9-4fcf-8b78-bad153a4ac99"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 05:48:04.944229 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:04.944211 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/413fb520-d5b9-4fcf-8b78-bad153a4ac99-kube-api-access-hrrbt" (OuterVolumeSpecName: "kube-api-access-hrrbt") pod "413fb520-d5b9-4fcf-8b78-bad153a4ac99" (UID: "413fb520-d5b9-4fcf-8b78-bad153a4ac99"). InnerVolumeSpecName "kube-api-access-hrrbt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 05:48:05.042689 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:05.042657 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrrbt\" (UniqueName: \"kubernetes.io/projected/413fb520-d5b9-4fcf-8b78-bad153a4ac99-kube-api-access-hrrbt\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:48:05.042689 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:05.042687 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/413fb520-d5b9-4fcf-8b78-bad153a4ac99-registry-certificates\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:48:05.042888 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:05.042700 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/413fb520-d5b9-4fcf-8b78-bad153a4ac99-registry-tls\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:48:05.042888 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:05.042710 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/413fb520-d5b9-4fcf-8b78-bad153a4ac99-trusted-ca\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:48:05.042888 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:05.042720 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/413fb520-d5b9-4fcf-8b78-bad153a4ac99-image-registry-private-configuration\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:48:05.042888 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:05.042747 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/413fb520-d5b9-4fcf-8b78-bad153a4ac99-bound-sa-token\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:48:05.042888 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:05.042761 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/413fb520-d5b9-4fcf-8b78-bad153a4ac99-installation-pull-secrets\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:48:05.054433 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:05.054401 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 05:48:05.056643 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:05.056620 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67cc0f8d-3ed2-4a60-a4b6-8ff3df258831-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qq6tn\" (UID: \"67cc0f8d-3ed2-4a60-a4b6-8ff3df258831\") " pod="openshift-insights/insights-runtime-extractor-qq6tn" Jun 02 05:48:05.172348 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:05.172269 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qq6tn" Jun 02 05:48:05.237608 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:48:05.237579 2575 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: failed to sync secret cache: timed out waiting for the condition Jun 02 05:48:05.237766 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:48:05.237748 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abda115b-298a-4390-ae97-aa3a722eaf73-tls-certificates podName:abda115b-298a-4390-ae97-aa3a722eaf73 nodeName:}" failed. No retries permitted until 2026-06-02 05:48:05.737689139 +0000 UTC m=+123.869570031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/abda115b-298a-4390-ae97-aa3a722eaf73-tls-certificates") pod "prometheus-operator-admission-webhook-59b7f8756b-7bwpr" (UID: "abda115b-298a-4390-ae97-aa3a722eaf73") : failed to sync secret cache: timed out waiting for the condition Jun 02 05:48:05.245986 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:05.245955 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-2bmrg\"" Jun 02 05:48:05.302078 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:05.301917 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qq6tn"] Jun 02 05:48:05.304585 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:48:05.304539 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67cc0f8d_3ed2_4a60_a4b6_8ff3df258831.slice/crio-ae659066ab3adcd46ca4a55033123e4822f5da797f0944d6048899f420602037 WatchSource:0}: Error finding container ae659066ab3adcd46ca4a55033123e4822f5da797f0944d6048899f420602037: Status 404 returned error can't find the container with id ae659066ab3adcd46ca4a55033123e4822f5da797f0944d6048899f420602037 Jun 02 05:48:05.415918 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:05.415889 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 02 05:48:05.747927 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:05.747902 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/abda115b-298a-4390-ae97-aa3a722eaf73-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-7bwpr\" (UID: \"abda115b-298a-4390-ae97-aa3a722eaf73\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-7bwpr" Jun 02 05:48:05.750001 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:05.749976 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/abda115b-298a-4390-ae97-aa3a722eaf73-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-7bwpr\" (UID: \"abda115b-298a-4390-ae97-aa3a722eaf73\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-7bwpr" Jun 02 05:48:05.776592 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:05.776567 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-7bwpr" Jun 02 05:48:05.859755 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:05.859627 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lfbgd" event={"ID":"7656a0c7-fe16-4852-9f35-be1a8a3a2ffc","Type":"ContainerStarted","Data":"cdce7f96da0cde35404c2911daa06be68e508f0a71bbadfac7af1f13c22f51f6"} Jun 02 05:48:05.862978 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:05.862956 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-779b889f76-z6l72" Jun 02 05:48:05.862978 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:05.862953 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qq6tn" event={"ID":"67cc0f8d-3ed2-4a60-a4b6-8ff3df258831","Type":"ContainerStarted","Data":"05c5e7f06a9ec908007a36ab80443a1a7eb6187afa07545c1f75861bb9700bb5"} Jun 02 05:48:05.863178 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:05.862994 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qq6tn" event={"ID":"67cc0f8d-3ed2-4a60-a4b6-8ff3df258831","Type":"ContainerStarted","Data":"ae659066ab3adcd46ca4a55033123e4822f5da797f0944d6048899f420602037"} Jun 02 05:48:05.881409 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:05.881356 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lfbgd" podStartSLOduration=1.400885391 podStartE2EDuration="2.881341162s" podCreationTimestamp="2026-06-02 05:48:03 +0000 UTC" firstStartedPulling="2026-06-02 05:48:04.261428661 +0000 UTC m=+122.393309531" lastFinishedPulling="2026-06-02 05:48:05.741884433 +0000 UTC m=+123.873765302" observedRunningTime="2026-06-02 05:48:05.880404313 +0000 UTC m=+124.012285205" watchObservedRunningTime="2026-06-02 05:48:05.881341162 +0000 UTC m=+124.013222052" Jun 02 05:48:05.909507 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:05.908087 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-779b889f76-z6l72"] Jun 02 05:48:05.909838 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:05.909818 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-779b889f76-z6l72"] Jun 02 05:48:05.942839 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:05.942807 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-7bwpr"] Jun 02 05:48:05.945674 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:48:05.945647 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabda115b_298a_4390_ae97_aa3a722eaf73.slice/crio-3b020e2c793928e31cefa7e2fbb77b152e79c5a5a33fd451eefddee5dbb69368 WatchSource:0}: Error finding container 3b020e2c793928e31cefa7e2fbb77b152e79c5a5a33fd451eefddee5dbb69368: Status 404 returned error can't find the container with id 3b020e2c793928e31cefa7e2fbb77b152e79c5a5a33fd451eefddee5dbb69368 Jun 02 05:48:06.352604 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:06.352561 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="413fb520-d5b9-4fcf-8b78-bad153a4ac99" path="/var/lib/kubelet/pods/413fb520-d5b9-4fcf-8b78-bad153a4ac99/volumes" Jun 02 05:48:06.867153 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:06.867110 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qq6tn" event={"ID":"67cc0f8d-3ed2-4a60-a4b6-8ff3df258831","Type":"ContainerStarted","Data":"87ecfb2cdb5400307ff9963e2da1d4921f9f222978e8eb032b706a79a416bf86"} Jun 02 05:48:06.868299 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:06.868266 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-7bwpr" event={"ID":"abda115b-298a-4390-ae97-aa3a722eaf73","Type":"ContainerStarted","Data":"3b020e2c793928e31cefa7e2fbb77b152e79c5a5a33fd451eefddee5dbb69368"} Jun 02 05:48:07.871684 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:07.871637 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-7bwpr" event={"ID":"abda115b-298a-4390-ae97-aa3a722eaf73","Type":"ContainerStarted","Data":"564d078df35a3f4942d8f394258025acd48ec4e07fdbff2ad18099307d265dbd"} Jun 02 05:48:07.871684 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:07.871683 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-7bwpr" Jun 02 05:48:07.873543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:07.873505 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qq6tn" event={"ID":"67cc0f8d-3ed2-4a60-a4b6-8ff3df258831","Type":"ContainerStarted","Data":"e9164fc7241d03f54027ef693a5832039181a1734ef22fe4dbf9a397c715c16d"} Jun 02 05:48:07.876487 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:07.876468 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-7bwpr" Jun 02 05:48:07.887774 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:07.887709 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-7bwpr" podStartSLOduration=3.093645077 podStartE2EDuration="4.8876966s" podCreationTimestamp="2026-06-02 05:48:03 +0000 UTC" firstStartedPulling="2026-06-02 05:48:05.947646016 +0000 UTC m=+124.079526885" lastFinishedPulling="2026-06-02 05:48:07.741697534 +0000 UTC m=+125.873578408" observedRunningTime="2026-06-02 05:48:07.886188551 +0000 UTC m=+126.018069442" watchObservedRunningTime="2026-06-02 05:48:07.8876966 +0000 UTC m=+126.019577490" Jun 02 05:48:07.918913 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:07.918871 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qq6tn" podStartSLOduration=2.5339685259999998 podStartE2EDuration="4.918855324s" podCreationTimestamp="2026-06-02 05:48:03 +0000 UTC" firstStartedPulling="2026-06-02 05:48:05.355453561 +0000 UTC m=+123.487334442" lastFinishedPulling="2026-06-02 05:48:07.740340368 +0000 UTC m=+125.872221240" observedRunningTime="2026-06-02 05:48:07.918559269 +0000 UTC m=+126.050440160" watchObservedRunningTime="2026-06-02 05:48:07.918855324 +0000 UTC m=+126.050736215" Jun 02 05:48:08.086407 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:08.086369 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-gclmq"] Jun 02 05:48:08.089476 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:08.089459 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gclmq" Jun 02 05:48:08.092046 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:08.092018 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-trsx7\"" Jun 02 05:48:08.092046 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:08.092021 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 02 05:48:08.092046 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:08.092045 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 02 05:48:08.092280 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:08.092093 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 05:48:08.092280 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:08.092107 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 05:48:08.092280 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:08.092182 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 05:48:08.095497 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:08.095458 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-gclmq"] Jun 02 05:48:08.169143 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:08.169108 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76f720f3-bf56-45b7-a757-b9e4e1dd377f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-gclmq\" (UID: \"76f720f3-bf56-45b7-a757-b9e4e1dd377f\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gclmq" Jun 02 05:48:08.169143 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:08.169146 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gw5k\" (UniqueName: \"kubernetes.io/projected/76f720f3-bf56-45b7-a757-b9e4e1dd377f-kube-api-access-7gw5k\") pod \"prometheus-operator-658bcd8bdf-gclmq\" (UID: \"76f720f3-bf56-45b7-a757-b9e4e1dd377f\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gclmq" Jun 02 05:48:08.169357 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:08.169183 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/76f720f3-bf56-45b7-a757-b9e4e1dd377f-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-gclmq\" (UID: \"76f720f3-bf56-45b7-a757-b9e4e1dd377f\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gclmq" Jun 02 05:48:08.169357 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:08.169228 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76f720f3-bf56-45b7-a757-b9e4e1dd377f-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-gclmq\" (UID: \"76f720f3-bf56-45b7-a757-b9e4e1dd377f\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gclmq" Jun 02 05:48:08.270135 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:08.270084 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76f720f3-bf56-45b7-a757-b9e4e1dd377f-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-gclmq\" (UID: \"76f720f3-bf56-45b7-a757-b9e4e1dd377f\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gclmq" Jun 02 05:48:08.270328 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:08.270198 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76f720f3-bf56-45b7-a757-b9e4e1dd377f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-gclmq\" (UID: \"76f720f3-bf56-45b7-a757-b9e4e1dd377f\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gclmq" Jun 02 05:48:08.270328 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:08.270223 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7gw5k\" (UniqueName: \"kubernetes.io/projected/76f720f3-bf56-45b7-a757-b9e4e1dd377f-kube-api-access-7gw5k\") pod \"prometheus-operator-658bcd8bdf-gclmq\" (UID: \"76f720f3-bf56-45b7-a757-b9e4e1dd377f\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gclmq" Jun 02 05:48:08.270328 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:08.270263 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/76f720f3-bf56-45b7-a757-b9e4e1dd377f-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-gclmq\" (UID: \"76f720f3-bf56-45b7-a757-b9e4e1dd377f\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gclmq" Jun 02 05:48:08.270500 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:48:08.270350 2575 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 02 05:48:08.270500 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:48:08.270428 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76f720f3-bf56-45b7-a757-b9e4e1dd377f-prometheus-operator-tls podName:76f720f3-bf56-45b7-a757-b9e4e1dd377f nodeName:}" failed. No retries permitted until 2026-06-02 05:48:08.770406353 +0000 UTC m=+126.902287221 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/76f720f3-bf56-45b7-a757-b9e4e1dd377f-prometheus-operator-tls") pod "prometheus-operator-658bcd8bdf-gclmq" (UID: "76f720f3-bf56-45b7-a757-b9e4e1dd377f") : secret "prometheus-operator-tls" not found Jun 02 05:48:08.270850 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:08.270826 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76f720f3-bf56-45b7-a757-b9e4e1dd377f-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-gclmq\" (UID: \"76f720f3-bf56-45b7-a757-b9e4e1dd377f\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gclmq" Jun 02 05:48:08.272548 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:08.272526 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76f720f3-bf56-45b7-a757-b9e4e1dd377f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-gclmq\" (UID: \"76f720f3-bf56-45b7-a757-b9e4e1dd377f\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gclmq" Jun 02 05:48:08.278770 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:08.278745 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gw5k\" (UniqueName: \"kubernetes.io/projected/76f720f3-bf56-45b7-a757-b9e4e1dd377f-kube-api-access-7gw5k\") pod \"prometheus-operator-658bcd8bdf-gclmq\" (UID: \"76f720f3-bf56-45b7-a757-b9e4e1dd377f\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gclmq" Jun 02 05:48:08.773996 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:08.773957 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/76f720f3-bf56-45b7-a757-b9e4e1dd377f-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-gclmq\" (UID: \"76f720f3-bf56-45b7-a757-b9e4e1dd377f\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gclmq" Jun 02 05:48:08.776423 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:08.776383 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/76f720f3-bf56-45b7-a757-b9e4e1dd377f-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-gclmq\" (UID: \"76f720f3-bf56-45b7-a757-b9e4e1dd377f\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gclmq" Jun 02 05:48:08.998738 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:08.998681 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gclmq" Jun 02 05:48:09.119890 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:09.119857 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-gclmq"] Jun 02 05:48:09.122838 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:48:09.122812 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76f720f3_bf56_45b7_a757_b9e4e1dd377f.slice/crio-ad6a892a875b3beab6a8fed829d0b546d1827da4afbc2b44143d29620bf1d203 WatchSource:0}: Error finding container ad6a892a875b3beab6a8fed829d0b546d1827da4afbc2b44143d29620bf1d203: Status 404 returned error can't find the container with id ad6a892a875b3beab6a8fed829d0b546d1827da4afbc2b44143d29620bf1d203 Jun 02 05:48:09.879915 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:09.879878 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gclmq" event={"ID":"76f720f3-bf56-45b7-a757-b9e4e1dd377f","Type":"ContainerStarted","Data":"ad6a892a875b3beab6a8fed829d0b546d1827da4afbc2b44143d29620bf1d203"} Jun 02 05:48:10.884148 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:10.884109 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gclmq" event={"ID":"76f720f3-bf56-45b7-a757-b9e4e1dd377f","Type":"ContainerStarted","Data":"38d6945f3ce2fe14ceb6af1b3fc5107e1b468f7f220777be37b80278b04e09a9"} Jun 02 05:48:10.884148 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:10.884143 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gclmq" event={"ID":"76f720f3-bf56-45b7-a757-b9e4e1dd377f","Type":"ContainerStarted","Data":"9cf28c870d5b38f3d75b585b90a4df5dc4b6548bf0744174a99ebe8c41594f95"} Jun 02 05:48:10.900125 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:10.900077 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gclmq" podStartSLOduration=1.505717862 podStartE2EDuration="2.900063044s" podCreationTimestamp="2026-06-02 05:48:08 +0000 UTC" firstStartedPulling="2026-06-02 05:48:09.12517351 +0000 UTC m=+127.257054378" lastFinishedPulling="2026-06-02 05:48:10.519518691 +0000 UTC m=+128.651399560" observedRunningTime="2026-06-02 05:48:10.899710404 +0000 UTC m=+129.031591296" watchObservedRunningTime="2026-06-02 05:48:10.900063044 +0000 UTC m=+129.031943932" Jun 02 05:48:12.199038 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.198999 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs\") pod \"network-metrics-daemon-6btlj\" (UID: \"e1171123-67a2-45d0-b42e-c0b5c97d9e5a\") " pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:48:12.201392 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.201370 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1171123-67a2-45d0-b42e-c0b5c97d9e5a-metrics-certs\") pod \"network-metrics-daemon-6btlj\" (UID: \"e1171123-67a2-45d0-b42e-c0b5c97d9e5a\") " pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:48:12.262829 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.262796 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x8xws\"" Jun 02 05:48:12.270828 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.270800 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6btlj" Jun 02 05:48:12.397037 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.397002 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6btlj"] Jun 02 05:48:12.399829 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:48:12.399803 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1171123_67a2_45d0_b42e_c0b5c97d9e5a.slice/crio-bb021b7c8a3eb58ef5c263dfb0687f195031ad69fd820c33bfec8be4d50f2022 WatchSource:0}: Error finding container bb021b7c8a3eb58ef5c263dfb0687f195031ad69fd820c33bfec8be4d50f2022: Status 404 returned error can't find the container with id bb021b7c8a3eb58ef5c263dfb0687f195031ad69fd820c33bfec8be4d50f2022 Jun 02 05:48:12.416780 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.416757 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-r4md7"] Jun 02 05:48:12.421249 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.421232 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk"] Jun 02 05:48:12.421417 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.421397 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-r4md7" Jun 02 05:48:12.423585 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.423561 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 02 05:48:12.423585 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.423578 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-zfxc4\"" Jun 02 05:48:12.423748 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.423561 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 02 05:48:12.424347 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.424329 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk" Jun 02 05:48:12.426382 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.426360 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gkfxv\"" Jun 02 05:48:12.426382 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.426378 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 02 05:48:12.426522 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.426443 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 02 05:48:12.426705 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.426688 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 02 05:48:12.430652 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.430633 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-r4md7"] Jun 02 05:48:12.431550 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.431529 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk"] Jun 02 05:48:12.453872 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.453819 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7qq9s"] Jun 02 05:48:12.457027 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.457012 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.459336 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.459311 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-v7nd9\"" Jun 02 05:48:12.459448 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.459353 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 05:48:12.459448 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.459369 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 05:48:12.459448 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.459382 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 05:48:12.602355 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.602322 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03e42d09-6f83-4668-ad46-54e161e27e41-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.602355 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.602368 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fde930f7-b558-4514-8237-3682940dc954-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-bb4vk\" (UID: \"fde930f7-b558-4514-8237-3682940dc954\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk" Jun 02 05:48:12.602577 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.602386 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vp2w\" (UniqueName: \"kubernetes.io/projected/fde930f7-b558-4514-8237-3682940dc954-kube-api-access-8vp2w\") pod \"kube-state-metrics-8469c486bb-bb4vk\" (UID: \"fde930f7-b558-4514-8237-3682940dc954\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk" Jun 02 05:48:12.602577 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.602410 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd32cc7d-6828-45f7-91cc-9eac52479e40-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-r4md7\" (UID: \"bd32cc7d-6828-45f7-91cc-9eac52479e40\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r4md7" Jun 02 05:48:12.602577 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.602460 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdv6d\" (UniqueName: \"kubernetes.io/projected/bd32cc7d-6828-45f7-91cc-9eac52479e40-kube-api-access-kdv6d\") pod \"openshift-state-metrics-85658796db-r4md7\" (UID: \"bd32cc7d-6828-45f7-91cc-9eac52479e40\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r4md7" Jun 02 05:48:12.602577 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.602496 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03e42d09-6f83-4668-ad46-54e161e27e41-root\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.602577 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.602512 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03e42d09-6f83-4668-ad46-54e161e27e41-metrics-client-ca\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.602577 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.602532 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fde930f7-b558-4514-8237-3682940dc954-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-bb4vk\" (UID: \"fde930f7-b558-4514-8237-3682940dc954\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk" Jun 02 05:48:12.602577 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.602555 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fde930f7-b558-4514-8237-3682940dc954-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-bb4vk\" (UID: \"fde930f7-b558-4514-8237-3682940dc954\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk" Jun 02 05:48:12.602828 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.602606 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03e42d09-6f83-4668-ad46-54e161e27e41-sys\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.602828 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.602623 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03e42d09-6f83-4668-ad46-54e161e27e41-node-exporter-tls\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.602828 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.602648 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fde930f7-b558-4514-8237-3682940dc954-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-bb4vk\" (UID: \"fde930f7-b558-4514-8237-3682940dc954\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk" Jun 02 05:48:12.602828 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.602700 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd32cc7d-6828-45f7-91cc-9eac52479e40-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-r4md7\" (UID: \"bd32cc7d-6828-45f7-91cc-9eac52479e40\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r4md7" Jun 02 05:48:12.602828 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.602768 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03e42d09-6f83-4668-ad46-54e161e27e41-node-exporter-textfile\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.602828 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.602806 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03e42d09-6f83-4668-ad46-54e161e27e41-node-exporter-wtmp\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.603048 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.602842 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03e42d09-6f83-4668-ad46-54e161e27e41-node-exporter-accelerators-collector-config\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.603048 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.602874 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnjmq\" (UniqueName: \"kubernetes.io/projected/03e42d09-6f83-4668-ad46-54e161e27e41-kube-api-access-qnjmq\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.603048 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.602890 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd32cc7d-6828-45f7-91cc-9eac52479e40-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-r4md7\" (UID: \"bd32cc7d-6828-45f7-91cc-9eac52479e40\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r4md7" Jun 02 05:48:12.603048 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.602913 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fde930f7-b558-4514-8237-3682940dc954-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-bb4vk\" (UID: \"fde930f7-b558-4514-8237-3682940dc954\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk" Jun 02 05:48:12.703740 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.703682 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03e42d09-6f83-4668-ad46-54e161e27e41-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.703953 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.703766 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fde930f7-b558-4514-8237-3682940dc954-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-bb4vk\" (UID: \"fde930f7-b558-4514-8237-3682940dc954\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk" Jun 02 05:48:12.703953 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.703788 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8vp2w\" (UniqueName: \"kubernetes.io/projected/fde930f7-b558-4514-8237-3682940dc954-kube-api-access-8vp2w\") pod \"kube-state-metrics-8469c486bb-bb4vk\" (UID: \"fde930f7-b558-4514-8237-3682940dc954\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk" Jun 02 05:48:12.703953 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.703806 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd32cc7d-6828-45f7-91cc-9eac52479e40-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-r4md7\" (UID: \"bd32cc7d-6828-45f7-91cc-9eac52479e40\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r4md7" Jun 02 05:48:12.703953 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.703829 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kdv6d\" (UniqueName: \"kubernetes.io/projected/bd32cc7d-6828-45f7-91cc-9eac52479e40-kube-api-access-kdv6d\") pod \"openshift-state-metrics-85658796db-r4md7\" (UID: \"bd32cc7d-6828-45f7-91cc-9eac52479e40\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r4md7" Jun 02 05:48:12.703953 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.703893 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03e42d09-6f83-4668-ad46-54e161e27e41-root\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.703953 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.703925 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03e42d09-6f83-4668-ad46-54e161e27e41-metrics-client-ca\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.704283 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.703962 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fde930f7-b558-4514-8237-3682940dc954-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-bb4vk\" (UID: \"fde930f7-b558-4514-8237-3682940dc954\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk" Jun 02 05:48:12.704283 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.703991 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fde930f7-b558-4514-8237-3682940dc954-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-bb4vk\" (UID: \"fde930f7-b558-4514-8237-3682940dc954\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk" Jun 02 05:48:12.704283 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.704028 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03e42d09-6f83-4668-ad46-54e161e27e41-sys\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.704283 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.704055 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03e42d09-6f83-4668-ad46-54e161e27e41-node-exporter-tls\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.704283 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.704082 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fde930f7-b558-4514-8237-3682940dc954-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-bb4vk\" (UID: \"fde930f7-b558-4514-8237-3682940dc954\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk" Jun 02 05:48:12.704283 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.704131 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd32cc7d-6828-45f7-91cc-9eac52479e40-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-r4md7\" (UID: \"bd32cc7d-6828-45f7-91cc-9eac52479e40\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r4md7" Jun 02 05:48:12.704283 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.704175 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03e42d09-6f83-4668-ad46-54e161e27e41-node-exporter-textfile\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.704283 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.704210 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03e42d09-6f83-4668-ad46-54e161e27e41-node-exporter-wtmp\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.704283 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.704245 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03e42d09-6f83-4668-ad46-54e161e27e41-node-exporter-accelerators-collector-config\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.704283 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:48:12.704262 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 05:48:12.704283 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.704286 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qnjmq\" (UniqueName: \"kubernetes.io/projected/03e42d09-6f83-4668-ad46-54e161e27e41-kube-api-access-qnjmq\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.704850 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.704316 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd32cc7d-6828-45f7-91cc-9eac52479e40-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-r4md7\" (UID: \"bd32cc7d-6828-45f7-91cc-9eac52479e40\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r4md7" Jun 02 05:48:12.704850 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:48:12.704334 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03e42d09-6f83-4668-ad46-54e161e27e41-node-exporter-tls podName:03e42d09-6f83-4668-ad46-54e161e27e41 nodeName:}" failed. No retries permitted until 2026-06-02 05:48:13.204313853 +0000 UTC m=+131.336194723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/03e42d09-6f83-4668-ad46-54e161e27e41-node-exporter-tls") pod "node-exporter-7qq9s" (UID: "03e42d09-6f83-4668-ad46-54e161e27e41") : secret "node-exporter-tls" not found Jun 02 05:48:12.704850 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.704376 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fde930f7-b558-4514-8237-3682940dc954-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-bb4vk\" (UID: \"fde930f7-b558-4514-8237-3682940dc954\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk" Jun 02 05:48:12.704850 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:48:12.704392 2575 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 02 05:48:12.704850 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.704405 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fde930f7-b558-4514-8237-3682940dc954-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-bb4vk\" (UID: \"fde930f7-b558-4514-8237-3682940dc954\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk" Jun 02 05:48:12.704850 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:48:12.704442 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd32cc7d-6828-45f7-91cc-9eac52479e40-openshift-state-metrics-tls podName:bd32cc7d-6828-45f7-91cc-9eac52479e40 nodeName:}" failed. No retries permitted until 2026-06-02 05:48:13.204427548 +0000 UTC m=+131.336308433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/bd32cc7d-6828-45f7-91cc-9eac52479e40-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-r4md7" (UID: "bd32cc7d-6828-45f7-91cc-9eac52479e40") : secret "openshift-state-metrics-tls" not found Jun 02 05:48:12.704850 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.704474 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03e42d09-6f83-4668-ad46-54e161e27e41-sys\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.704850 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.704575 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03e42d09-6f83-4668-ad46-54e161e27e41-metrics-client-ca\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.704850 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.704667 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd32cc7d-6828-45f7-91cc-9eac52479e40-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-r4md7\" (UID: \"bd32cc7d-6828-45f7-91cc-9eac52479e40\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r4md7" Jun 02 05:48:12.704850 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.704693 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fde930f7-b558-4514-8237-3682940dc954-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-bb4vk\" (UID: \"fde930f7-b558-4514-8237-3682940dc954\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk" Jun 02 05:48:12.704850 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.704828 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03e42d09-6f83-4668-ad46-54e161e27e41-node-exporter-wtmp\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.705409 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.704938 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03e42d09-6f83-4668-ad46-54e161e27e41-root\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.705409 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.705101 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03e42d09-6f83-4668-ad46-54e161e27e41-node-exporter-textfile\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.705409 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.705174 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fde930f7-b558-4514-8237-3682940dc954-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-bb4vk\" (UID: \"fde930f7-b558-4514-8237-3682940dc954\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk" Jun 02 05:48:12.705533 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.705453 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03e42d09-6f83-4668-ad46-54e161e27e41-node-exporter-accelerators-collector-config\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.706763 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.706739 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03e42d09-6f83-4668-ad46-54e161e27e41-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.707046 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.707030 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fde930f7-b558-4514-8237-3682940dc954-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-bb4vk\" (UID: \"fde930f7-b558-4514-8237-3682940dc954\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk" Jun 02 05:48:12.707084 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.707066 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd32cc7d-6828-45f7-91cc-9eac52479e40-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-r4md7\" (UID: \"bd32cc7d-6828-45f7-91cc-9eac52479e40\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r4md7" Jun 02 05:48:12.707119 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.707071 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fde930f7-b558-4514-8237-3682940dc954-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-bb4vk\" (UID: \"fde930f7-b558-4514-8237-3682940dc954\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk" Jun 02 05:48:12.713032 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.713001 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnjmq\" (UniqueName: \"kubernetes.io/projected/03e42d09-6f83-4668-ad46-54e161e27e41-kube-api-access-qnjmq\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:12.713563 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.713541 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vp2w\" (UniqueName: \"kubernetes.io/projected/fde930f7-b558-4514-8237-3682940dc954-kube-api-access-8vp2w\") pod \"kube-state-metrics-8469c486bb-bb4vk\" (UID: \"fde930f7-b558-4514-8237-3682940dc954\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk" Jun 02 05:48:12.713672 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.713625 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdv6d\" (UniqueName: \"kubernetes.io/projected/bd32cc7d-6828-45f7-91cc-9eac52479e40-kube-api-access-kdv6d\") pod \"openshift-state-metrics-85658796db-r4md7\" (UID: \"bd32cc7d-6828-45f7-91cc-9eac52479e40\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r4md7" Jun 02 05:48:12.738617 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.738591 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk" Jun 02 05:48:12.871320 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.871284 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk"] Jun 02 05:48:12.873672 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:48:12.873642 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfde930f7_b558_4514_8237_3682940dc954.slice/crio-aead014f2e0a1df922dda5ea7a207a7a5b0a9312832bf8f72ada3eb34ca64074 WatchSource:0}: Error finding container aead014f2e0a1df922dda5ea7a207a7a5b0a9312832bf8f72ada3eb34ca64074: Status 404 returned error can't find the container with id aead014f2e0a1df922dda5ea7a207a7a5b0a9312832bf8f72ada3eb34ca64074 Jun 02 05:48:12.893394 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.893352 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6btlj" event={"ID":"e1171123-67a2-45d0-b42e-c0b5c97d9e5a","Type":"ContainerStarted","Data":"bb021b7c8a3eb58ef5c263dfb0687f195031ad69fd820c33bfec8be4d50f2022"} Jun 02 05:48:12.894581 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:12.894542 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk" event={"ID":"fde930f7-b558-4514-8237-3682940dc954","Type":"ContainerStarted","Data":"aead014f2e0a1df922dda5ea7a207a7a5b0a9312832bf8f72ada3eb34ca64074"} Jun 02 05:48:13.208554 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:13.208522 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03e42d09-6f83-4668-ad46-54e161e27e41-node-exporter-tls\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:13.209013 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:13.208593 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd32cc7d-6828-45f7-91cc-9eac52479e40-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-r4md7\" (UID: \"bd32cc7d-6828-45f7-91cc-9eac52479e40\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r4md7" Jun 02 05:48:13.209013 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:48:13.208713 2575 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 02 05:48:13.209013 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:48:13.208817 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd32cc7d-6828-45f7-91cc-9eac52479e40-openshift-state-metrics-tls podName:bd32cc7d-6828-45f7-91cc-9eac52479e40 nodeName:}" failed. No retries permitted until 2026-06-02 05:48:14.208793193 +0000 UTC m=+132.340674077 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/bd32cc7d-6828-45f7-91cc-9eac52479e40-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-r4md7" (UID: "bd32cc7d-6828-45f7-91cc-9eac52479e40") : secret "openshift-state-metrics-tls" not found Jun 02 05:48:13.211455 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:13.211427 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03e42d09-6f83-4668-ad46-54e161e27e41-node-exporter-tls\") pod \"node-exporter-7qq9s\" (UID: \"03e42d09-6f83-4668-ad46-54e161e27e41\") " pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:13.365697 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:13.365664 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7qq9s" Jun 02 05:48:13.374878 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:48:13.374840 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e42d09_6f83_4668_ad46_54e161e27e41.slice/crio-64a33b6b037d7d704b8748a24f5aeff956a7a4c006bc0d63b76cb6486c084821 WatchSource:0}: Error finding container 64a33b6b037d7d704b8748a24f5aeff956a7a4c006bc0d63b76cb6486c084821: Status 404 returned error can't find the container with id 64a33b6b037d7d704b8748a24f5aeff956a7a4c006bc0d63b76cb6486c084821 Jun 02 05:48:13.900613 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:13.900256 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6btlj" event={"ID":"e1171123-67a2-45d0-b42e-c0b5c97d9e5a","Type":"ContainerStarted","Data":"e330ab1b27280af9048575a980938fda502a772c0c9143b6444815f556cb8662"} Jun 02 05:48:13.900613 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:13.900305 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6btlj" event={"ID":"e1171123-67a2-45d0-b42e-c0b5c97d9e5a","Type":"ContainerStarted","Data":"3a42abe9695dcd3063fe9a13c0edc63afa85c6c9147d20558099a71f22fa51cb"} Jun 02 05:48:13.901749 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:13.901705 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7qq9s" event={"ID":"03e42d09-6f83-4668-ad46-54e161e27e41","Type":"ContainerStarted","Data":"64a33b6b037d7d704b8748a24f5aeff956a7a4c006bc0d63b76cb6486c084821"} Jun 02 05:48:13.916051 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:13.915976 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6btlj" podStartSLOduration=130.909944529 podStartE2EDuration="2m11.915959133s" podCreationTimestamp="2026-06-02 05:46:02 +0000 UTC" firstStartedPulling="2026-06-02 05:48:12.401565727 +0000 UTC m=+130.533446596" lastFinishedPulling="2026-06-02 05:48:13.407580327 +0000 UTC m=+131.539461200" observedRunningTime="2026-06-02 05:48:13.915152265 +0000 UTC m=+132.047033156" watchObservedRunningTime="2026-06-02 05:48:13.915959133 +0000 UTC m=+132.047840024" Jun 02 05:48:14.218685 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.218605 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd32cc7d-6828-45f7-91cc-9eac52479e40-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-r4md7\" (UID: \"bd32cc7d-6828-45f7-91cc-9eac52479e40\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r4md7" Jun 02 05:48:14.220900 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.220873 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd32cc7d-6828-45f7-91cc-9eac52479e40-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-r4md7\" (UID: \"bd32cc7d-6828-45f7-91cc-9eac52479e40\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r4md7" Jun 02 05:48:14.232906 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.232882 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-r4md7" Jun 02 05:48:14.409618 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.409108 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-798588557d-j2l74"] Jun 02 05:48:14.412942 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.412918 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.415629 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.415600 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 02 05:48:14.415755 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.415601 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 02 05:48:14.415755 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.415629 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 02 05:48:14.416035 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.416017 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8c45q\"" Jun 02 05:48:14.416599 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.416578 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 02 05:48:14.416701 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.416617 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 02 05:48:14.416701 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.416648 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-c5t8rgnh1uo59\"" Jun 02 05:48:14.422431 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.422407 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-798588557d-j2l74"] Jun 02 05:48:14.521693 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.521594 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b-metrics-client-ca\") pod \"thanos-querier-798588557d-j2l74\" (UID: \"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b\") " pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.522060 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.521985 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b-secret-thanos-querier-tls\") pod \"thanos-querier-798588557d-j2l74\" (UID: \"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b\") " pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.522261 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.522195 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-798588557d-j2l74\" (UID: \"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b\") " pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.522505 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.522425 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-798588557d-j2l74\" (UID: \"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b\") " pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.522750 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.522700 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-798588557d-j2l74\" (UID: \"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b\") " pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.523026 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.522982 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b-secret-grpc-tls\") pod \"thanos-querier-798588557d-j2l74\" (UID: \"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b\") " pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.523257 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.523173 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbtnm\" (UniqueName: \"kubernetes.io/projected/01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b-kube-api-access-cbtnm\") pod \"thanos-querier-798588557d-j2l74\" (UID: \"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b\") " pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.523257 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.523225 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-798588557d-j2l74\" (UID: \"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b\") " pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.599482 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.599443 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-r4md7"] Jun 02 05:48:14.625880 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.623862 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b-secret-thanos-querier-tls\") pod \"thanos-querier-798588557d-j2l74\" (UID: \"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b\") " pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.625880 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.623913 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-798588557d-j2l74\" (UID: \"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b\") " pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.625880 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.623959 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-798588557d-j2l74\" (UID: \"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b\") " pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.625880 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.624003 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-798588557d-j2l74\" (UID: \"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b\") " pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.625880 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.624041 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b-secret-grpc-tls\") pod \"thanos-querier-798588557d-j2l74\" (UID: \"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b\") " pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.625880 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.624075 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cbtnm\" (UniqueName: \"kubernetes.io/projected/01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b-kube-api-access-cbtnm\") pod \"thanos-querier-798588557d-j2l74\" (UID: \"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b\") " pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.625880 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.624105 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-798588557d-j2l74\" (UID: \"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b\") " pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.625880 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.624183 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b-metrics-client-ca\") pod \"thanos-querier-798588557d-j2l74\" (UID: \"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b\") " pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.625880 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.624929 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b-metrics-client-ca\") pod \"thanos-querier-798588557d-j2l74\" (UID: \"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b\") " pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.630484 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.629716 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b-secret-grpc-tls\") pod \"thanos-querier-798588557d-j2l74\" (UID: \"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b\") " pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.630484 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.630350 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b-secret-thanos-querier-tls\") pod \"thanos-querier-798588557d-j2l74\" (UID: \"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b\") " pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.631905 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.631009 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-798588557d-j2l74\" (UID: \"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b\") " pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.631905 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.631102 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-798588557d-j2l74\" (UID: \"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b\") " pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.631905 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.631839 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-798588557d-j2l74\" (UID: \"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b\") " pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.634831 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.634788 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-798588557d-j2l74\" (UID: \"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b\") " pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.635918 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.635894 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbtnm\" (UniqueName: \"kubernetes.io/projected/01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b-kube-api-access-cbtnm\") pod \"thanos-querier-798588557d-j2l74\" (UID: \"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b\") " pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.723675 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.723644 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:14.869418 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.869247 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-798588557d-j2l74"] Jun 02 05:48:14.871930 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:48:14.871901 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a2ee2b_eb3d_4e01_87b4_c73d9e2e609b.slice/crio-b8f32385ba8be365b8227d86ac85e50d6cf3379fc4a69ff9b85a0e6d82871adb WatchSource:0}: Error finding container b8f32385ba8be365b8227d86ac85e50d6cf3379fc4a69ff9b85a0e6d82871adb: Status 404 returned error can't find the container with id b8f32385ba8be365b8227d86ac85e50d6cf3379fc4a69ff9b85a0e6d82871adb Jun 02 05:48:14.906493 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.906461 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk" event={"ID":"fde930f7-b558-4514-8237-3682940dc954","Type":"ContainerStarted","Data":"cbcc47d8e9ef637ba8a1c763badf0c74dfa4f64f03ac6e230a06e33ef06ed742"} Jun 02 05:48:14.906656 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.906499 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk" event={"ID":"fde930f7-b558-4514-8237-3682940dc954","Type":"ContainerStarted","Data":"0ba9bb273dda61e6327cdfe241b308130a9be392a508f60ef9f0d99f4338eb72"} Jun 02 05:48:14.906656 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.906514 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk" event={"ID":"fde930f7-b558-4514-8237-3682940dc954","Type":"ContainerStarted","Data":"de62e16eadf61b80844c0e2e3a2be886643f0360371d8b5b1150ec45e63d3a82"} Jun 02 05:48:14.907911 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.907885 2575 generic.go:358] "Generic (PLEG): container finished" podID="03e42d09-6f83-4668-ad46-54e161e27e41" containerID="ee826d109333fbb6f5e063848df3312e4f55417fb252bac1f0033d65f456a958" exitCode=0 Jun 02 05:48:14.908029 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.907958 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7qq9s" event={"ID":"03e42d09-6f83-4668-ad46-54e161e27e41","Type":"ContainerDied","Data":"ee826d109333fbb6f5e063848df3312e4f55417fb252bac1f0033d65f456a958"} Jun 02 05:48:14.913786 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.913758 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-r4md7" event={"ID":"bd32cc7d-6828-45f7-91cc-9eac52479e40","Type":"ContainerStarted","Data":"133708f880ea9181f49e063cc242d538c71a1f858f3801bd8d4e75092cdacbdb"} Jun 02 05:48:14.913884 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.913795 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-r4md7" event={"ID":"bd32cc7d-6828-45f7-91cc-9eac52479e40","Type":"ContainerStarted","Data":"5b4ca12fbcfa5d8d61eca50dfc21b14772541478d4b72df550ac5c8ca0e3f0b4"} Jun 02 05:48:14.913884 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.913809 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-r4md7" event={"ID":"bd32cc7d-6828-45f7-91cc-9eac52479e40","Type":"ContainerStarted","Data":"2c60f83f7833d200ac365c5d483535c07fa0c9746eea4f6a7113d910cea9c94a"} Jun 02 05:48:14.914881 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.914858 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-798588557d-j2l74" event={"ID":"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b","Type":"ContainerStarted","Data":"b8f32385ba8be365b8227d86ac85e50d6cf3379fc4a69ff9b85a0e6d82871adb"} Jun 02 05:48:14.927424 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:14.927245 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-bb4vk" podStartSLOduration=1.34474029 podStartE2EDuration="2.92722072s" podCreationTimestamp="2026-06-02 05:48:12 +0000 UTC" firstStartedPulling="2026-06-02 05:48:12.87565179 +0000 UTC m=+131.007532662" lastFinishedPulling="2026-06-02 05:48:14.45813221 +0000 UTC m=+132.590013092" observedRunningTime="2026-06-02 05:48:14.925045046 +0000 UTC m=+133.056925939" watchObservedRunningTime="2026-06-02 05:48:14.92722072 +0000 UTC m=+133.059101613" Jun 02 05:48:15.350492 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:15.350464 2575 scope.go:117] "RemoveContainer" containerID="8212413d2fbb7a8912abe7c6f78a42caba1d9860445213a068d1f3025e3790c8" Jun 02 05:48:15.350861 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:48:15.350641 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-9qqgq_openshift-console-operator(b68ed6d7-9e23-4f45-a0fb-18ca25e28836)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" podUID="b68ed6d7-9e23-4f45-a0fb-18ca25e28836" Jun 02 05:48:15.920998 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:15.920957 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7qq9s" event={"ID":"03e42d09-6f83-4668-ad46-54e161e27e41","Type":"ContainerStarted","Data":"a87045b26cbba68235de150fba7d2e33c290f04794fcb6d687083c1d82341f31"} Jun 02 05:48:15.921188 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:15.921002 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7qq9s" event={"ID":"03e42d09-6f83-4668-ad46-54e161e27e41","Type":"ContainerStarted","Data":"49dda0399a807b823a02cf4ca77ac99b0f1a5928c2b81ac10e167e090f47f034"} Jun 02 05:48:15.941436 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:15.941320 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7qq9s" podStartSLOduration=2.8829573550000003 podStartE2EDuration="3.941300154s" podCreationTimestamp="2026-06-02 05:48:12 +0000 UTC" firstStartedPulling="2026-06-02 05:48:13.40121354 +0000 UTC m=+131.533094425" lastFinishedPulling="2026-06-02 05:48:14.45955635 +0000 UTC m=+132.591437224" observedRunningTime="2026-06-02 05:48:15.939600075 +0000 UTC m=+134.071480976" watchObservedRunningTime="2026-06-02 05:48:15.941300154 +0000 UTC m=+134.073181045" Jun 02 05:48:16.926608 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:16.926555 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-r4md7" event={"ID":"bd32cc7d-6828-45f7-91cc-9eac52479e40","Type":"ContainerStarted","Data":"306d63edbdc0c65bb91f11ad0260325dacdd4c3971dfb0c51894a9c903f783cf"} Jun 02 05:48:16.945203 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:16.945153 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-r4md7" podStartSLOduration=3.793570525 podStartE2EDuration="4.945136968s" podCreationTimestamp="2026-06-02 05:48:12 +0000 UTC" firstStartedPulling="2026-06-02 05:48:14.784777536 +0000 UTC m=+132.916658414" lastFinishedPulling="2026-06-02 05:48:15.936343975 +0000 UTC m=+134.068224857" observedRunningTime="2026-06-02 05:48:16.943377035 +0000 UTC m=+135.075257939" watchObservedRunningTime="2026-06-02 05:48:16.945136968 +0000 UTC m=+135.077017858" Jun 02 05:48:17.198786 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:17.198718 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-jll4k"] Jun 02 05:48:17.202219 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:17.202202 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-jll4k" Jun 02 05:48:17.204476 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:17.204457 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-2lwtv\"" Jun 02 05:48:17.204476 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:17.204466 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 02 05:48:17.210875 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:17.210847 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-jll4k"] Jun 02 05:48:17.350930 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:17.350896 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fbe941d8-3d0e-49b1-882b-a3dc66d11662-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-jll4k\" (UID: \"fbe941d8-3d0e-49b1-882b-a3dc66d11662\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-jll4k" Jun 02 05:48:17.451428 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:17.451339 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fbe941d8-3d0e-49b1-882b-a3dc66d11662-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-jll4k\" (UID: \"fbe941d8-3d0e-49b1-882b-a3dc66d11662\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-jll4k" Jun 02 05:48:17.453836 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:17.453813 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fbe941d8-3d0e-49b1-882b-a3dc66d11662-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-jll4k\" (UID: \"fbe941d8-3d0e-49b1-882b-a3dc66d11662\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-jll4k" Jun 02 05:48:17.512710 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:17.512675 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-jll4k" Jun 02 05:48:17.660162 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:17.660101 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-jll4k"] Jun 02 05:48:17.665783 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:48:17.665753 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbe941d8_3d0e_49b1_882b_a3dc66d11662.slice/crio-8c3c0adb2913532692e0b951cabc938c5e7e51324c5605f9cb69eb3e8cdd31a2 WatchSource:0}: Error finding container 8c3c0adb2913532692e0b951cabc938c5e7e51324c5605f9cb69eb3e8cdd31a2: Status 404 returned error can't find the container with id 8c3c0adb2913532692e0b951cabc938c5e7e51324c5605f9cb69eb3e8cdd31a2 Jun 02 05:48:17.932258 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:17.932199 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-798588557d-j2l74" event={"ID":"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b","Type":"ContainerStarted","Data":"84e638e37b16d4592a1927bbf1058a1b4903adca07720ceef64ef978f658ed13"} Jun 02 05:48:17.932258 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:17.932251 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-798588557d-j2l74" event={"ID":"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b","Type":"ContainerStarted","Data":"26f5f3a25201216fcde6205140047ca346c3120746bd375468cc64dfbb46d680"} Jun 02 05:48:17.932258 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:17.932266 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-798588557d-j2l74" event={"ID":"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b","Type":"ContainerStarted","Data":"ebfea6ebee9217ef1c974d96ce5a3017529fb268fd3e8a5b38d73f6e3a1c2872"} Jun 02 05:48:17.933407 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:17.933372 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-jll4k" event={"ID":"fbe941d8-3d0e-49b1-882b-a3dc66d11662","Type":"ContainerStarted","Data":"8c3c0adb2913532692e0b951cabc938c5e7e51324c5605f9cb69eb3e8cdd31a2"} Jun 02 05:48:18.716898 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.716855 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 05:48:18.721710 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.721685 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.726718 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.726343 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cosk3in9lhtc6\"" Jun 02 05:48:18.726718 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.726369 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 05:48:18.726718 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.726393 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 05:48:18.726718 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.726404 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 05:48:18.726718 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.726417 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 05:48:18.726718 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.726341 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2hpb5\"" Jun 02 05:48:18.726718 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.726500 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 05:48:18.726718 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.726563 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 05:48:18.726718 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.726588 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 05:48:18.726718 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.726596 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 05:48:18.726718 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.726610 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 05:48:18.726718 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.726613 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 05:48:18.726718 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.726693 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 05:48:18.727300 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.727214 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 05:48:18.728558 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.728541 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 05:48:18.736001 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.735972 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 05:48:18.765578 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.765537 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.765805 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.765591 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-config\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.765805 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.765619 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.765805 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.765644 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.765805 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.765782 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b0c3456-82bf-4292-b023-84fa7d61b368-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.766085 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.765821 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.766085 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.765888 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b0c3456-82bf-4292-b023-84fa7d61b368-config-out\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.766085 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.765923 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.766085 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.765965 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.766085 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.766008 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.766085 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.766029 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.766085 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.766049 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-web-config\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.766085 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.766079 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.766475 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.766168 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.766475 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.766203 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7spx\" (UniqueName: \"kubernetes.io/projected/7b0c3456-82bf-4292-b023-84fa7d61b368-kube-api-access-h7spx\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.766475 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.766228 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.766475 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.766259 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.766475 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.766287 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7b0c3456-82bf-4292-b023-84fa7d61b368-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.867552 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.867520 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7b0c3456-82bf-4292-b023-84fa7d61b368-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.867552 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.867557 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.867850 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.867585 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-config\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.867850 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.867607 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.867850 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.867626 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.867991 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.867956 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b0c3456-82bf-4292-b023-84fa7d61b368-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.868099 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.868006 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.868099 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.868073 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7b0c3456-82bf-4292-b023-84fa7d61b368-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.868253 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.868076 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b0c3456-82bf-4292-b023-84fa7d61b368-config-out\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.868253 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.868218 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.868349 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.868255 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.868349 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.868288 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.868349 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.868317 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.868494 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.868352 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-web-config\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.868494 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.868393 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.868494 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.868481 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.868631 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.868518 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h7spx\" (UniqueName: \"kubernetes.io/projected/7b0c3456-82bf-4292-b023-84fa7d61b368-kube-api-access-h7spx\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.868631 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.868550 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.868631 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.868583 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.868631 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.868612 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.871956 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.869456 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.871956 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.869501 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.871956 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.869795 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.872641 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.872348 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.872641 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.872625 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.872999 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.872969 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.873075 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.873054 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-config\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.873570 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.873493 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b0c3456-82bf-4292-b023-84fa7d61b368-config-out\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.873688 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.873665 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.873822 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.873762 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.873898 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.873831 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.874510 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.874482 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b0c3456-82bf-4292-b023-84fa7d61b368-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.874854 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.874807 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.875423 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.875183 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.875423 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.875382 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-web-config\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.878415 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.878393 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7spx\" (UniqueName: \"kubernetes.io/projected/7b0c3456-82bf-4292-b023-84fa7d61b368-kube-api-access-h7spx\") pod \"prometheus-k8s-0\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:18.940324 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.939597 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-798588557d-j2l74" event={"ID":"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b","Type":"ContainerStarted","Data":"cc05ad2cd60d0b32be7b6c1eb2e35ed7c36f3a713b2e7c2bedad70d26d2de660"} Jun 02 05:48:18.940324 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.939646 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-798588557d-j2l74" event={"ID":"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b","Type":"ContainerStarted","Data":"6dbf7485cb3081698a50ad37cce2e331dba2f5c8b163fdfabb41d8faf6d55051"} Jun 02 05:48:18.940324 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.939660 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-798588557d-j2l74" event={"ID":"01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b","Type":"ContainerStarted","Data":"1f06751a224525c6b59bf9c9194af72626b833cab676a28a9cc4fdcb3bdf48df"} Jun 02 05:48:18.940827 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.940379 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:18.961206 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:18.961153 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-798588557d-j2l74" podStartSLOduration=1.803559216 podStartE2EDuration="4.961137348s" podCreationTimestamp="2026-06-02 05:48:14 +0000 UTC" firstStartedPulling="2026-06-02 05:48:14.873819754 +0000 UTC m=+133.005700623" lastFinishedPulling="2026-06-02 05:48:18.031397885 +0000 UTC m=+136.163278755" observedRunningTime="2026-06-02 05:48:18.960210736 +0000 UTC m=+137.092091629" watchObservedRunningTime="2026-06-02 05:48:18.961137348 +0000 UTC m=+137.093018241" Jun 02 05:48:19.033462 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:19.033377 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:19.504066 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:19.504042 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 05:48:19.505706 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:48:19.505679 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b0c3456_82bf_4292_b023_84fa7d61b368.slice/crio-c7e2b8a24ecdb298795c0119eaf925ea53ba6b312c099451640ec767d8218282 WatchSource:0}: Error finding container c7e2b8a24ecdb298795c0119eaf925ea53ba6b312c099451640ec767d8218282: Status 404 returned error can't find the container with id c7e2b8a24ecdb298795c0119eaf925ea53ba6b312c099451640ec767d8218282 Jun 02 05:48:19.946405 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:19.946361 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-jll4k" event={"ID":"fbe941d8-3d0e-49b1-882b-a3dc66d11662","Type":"ContainerStarted","Data":"4de1e4f64992ad2f736e21dfbe81285123285072d4acb2a734bc085fe106c2ea"} Jun 02 05:48:19.946893 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:19.946685 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-jll4k" Jun 02 05:48:19.948026 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:19.947977 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b0c3456-82bf-4292-b023-84fa7d61b368","Type":"ContainerStarted","Data":"c7e2b8a24ecdb298795c0119eaf925ea53ba6b312c099451640ec767d8218282"} Jun 02 05:48:19.952447 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:19.952424 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-jll4k" Jun 02 05:48:19.963488 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:19.963428 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-jll4k" podStartSLOduration=1.206307281 podStartE2EDuration="2.963409157s" podCreationTimestamp="2026-06-02 05:48:17 +0000 UTC" firstStartedPulling="2026-06-02 05:48:17.667792924 +0000 UTC m=+135.799673792" lastFinishedPulling="2026-06-02 05:48:19.424894795 +0000 UTC m=+137.556775668" observedRunningTime="2026-06-02 05:48:19.961233628 +0000 UTC m=+138.093114520" watchObservedRunningTime="2026-06-02 05:48:19.963409157 +0000 UTC m=+138.095290049" Jun 02 05:48:20.951643 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:20.951611 2575 generic.go:358] "Generic (PLEG): container finished" podID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerID="ae10277624abb84ad2c2fd580cd5f3c66cc28801e09319f687eef7c1ce7d0764" exitCode=0 Jun 02 05:48:20.952096 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:20.951705 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b0c3456-82bf-4292-b023-84fa7d61b368","Type":"ContainerDied","Data":"ae10277624abb84ad2c2fd580cd5f3c66cc28801e09319f687eef7c1ce7d0764"} Jun 02 05:48:23.963618 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:23.963580 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b0c3456-82bf-4292-b023-84fa7d61b368","Type":"ContainerStarted","Data":"9da709ad95fe97311a3e49e2d4c84b1a76a0fbb8fc543166ec1d03a339fe2371"} Jun 02 05:48:23.964005 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:23.963628 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b0c3456-82bf-4292-b023-84fa7d61b368","Type":"ContainerStarted","Data":"dc9e988dd99716e757e9b9add579653f4e9f00ebf8d01b0bb88dcb7ec2bfae7b"} Jun 02 05:48:23.964005 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:23.963643 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b0c3456-82bf-4292-b023-84fa7d61b368","Type":"ContainerStarted","Data":"c3f330d8ba5f938fff31434db5cbcf7f625f7debbe1fa5bfeb64579afd9673f8"} Jun 02 05:48:24.953867 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:24.953838 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-798588557d-j2l74" Jun 02 05:48:24.969117 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:24.969084 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b0c3456-82bf-4292-b023-84fa7d61b368","Type":"ContainerStarted","Data":"6504f2aa496189d06cb1ddfa2bffbdb43cf433dd0f97efb4adba4cd3e84e9101"} Jun 02 05:48:24.969117 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:24.969120 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b0c3456-82bf-4292-b023-84fa7d61b368","Type":"ContainerStarted","Data":"39122b2cb69eb46a52d77790ea70feb81d9c21a9a81ae902108a509811ab1aab"} Jun 02 05:48:24.969494 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:24.969133 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b0c3456-82bf-4292-b023-84fa7d61b368","Type":"ContainerStarted","Data":"cd8b98857b10b0d646801688243bfdfd837b77440b84ebcf05f954ba763b07c3"} Jun 02 05:48:25.003253 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:25.003181 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.802006484 podStartE2EDuration="7.003159777s" podCreationTimestamp="2026-06-02 05:48:18 +0000 UTC" firstStartedPulling="2026-06-02 05:48:19.508085525 +0000 UTC m=+137.639966401" lastFinishedPulling="2026-06-02 05:48:23.709238821 +0000 UTC m=+141.841119694" observedRunningTime="2026-06-02 05:48:25.000249842 +0000 UTC m=+143.132130755" watchObservedRunningTime="2026-06-02 05:48:25.003159777 +0000 UTC m=+143.135040672" Jun 02 05:48:29.034611 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:29.034567 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:48:29.350458 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:29.350428 2575 scope.go:117] "RemoveContainer" containerID="8212413d2fbb7a8912abe7c6f78a42caba1d9860445213a068d1f3025e3790c8" Jun 02 05:48:29.984930 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:29.984895 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qqgq_b68ed6d7-9e23-4f45-a0fb-18ca25e28836/console-operator/2.log" Jun 02 05:48:29.985098 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:29.984965 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" event={"ID":"b68ed6d7-9e23-4f45-a0fb-18ca25e28836","Type":"ContainerStarted","Data":"5db59b524ee043b254162a202e41f38173e5c928c597214aba8ac32828cf5543"} Jun 02 05:48:29.985273 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:29.985254 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" Jun 02 05:48:30.034645 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:30.034578 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" podStartSLOduration=57.66605246 podStartE2EDuration="1m0.034563732s" podCreationTimestamp="2026-06-02 05:47:30 +0000 UTC" firstStartedPulling="2026-06-02 05:47:30.691181198 +0000 UTC m=+88.823062082" lastFinishedPulling="2026-06-02 05:47:33.059692481 +0000 UTC m=+91.191573354" observedRunningTime="2026-06-02 05:48:30.031581819 +0000 UTC m=+148.163462709" watchObservedRunningTime="2026-06-02 05:48:30.034563732 +0000 UTC m=+148.166444623" Jun 02 05:48:30.081128 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:30.081101 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-9qqgq" Jun 02 05:48:37.821780 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:48:37.821714 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tqr92" podUID="f0587da4-0df5-48c6-9df5-3b69cc457181" Jun 02 05:48:37.830864 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:48:37.830828 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-758p5" podUID="3e1a7f6b-52e8-4248-b043-8248779a965a" Jun 02 05:48:38.008537 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:38.008502 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-758p5" Jun 02 05:48:38.008695 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:38.008502 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tqr92" Jun 02 05:48:42.697832 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:42.697784 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls\") pod \"dns-default-tqr92\" (UID: \"f0587da4-0df5-48c6-9df5-3b69cc457181\") " pod="openshift-dns/dns-default-tqr92" Jun 02 05:48:42.698297 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:42.697878 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert\") pod \"ingress-canary-758p5\" (UID: \"3e1a7f6b-52e8-4248-b043-8248779a965a\") " pod="openshift-ingress-canary/ingress-canary-758p5" Jun 02 05:48:42.700185 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:42.700160 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0587da4-0df5-48c6-9df5-3b69cc457181-metrics-tls\") pod \"dns-default-tqr92\" (UID: \"f0587da4-0df5-48c6-9df5-3b69cc457181\") " pod="openshift-dns/dns-default-tqr92" Jun 02 05:48:42.700300 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:42.700215 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e1a7f6b-52e8-4248-b043-8248779a965a-cert\") pod \"ingress-canary-758p5\" (UID: \"3e1a7f6b-52e8-4248-b043-8248779a965a\") " pod="openshift-ingress-canary/ingress-canary-758p5" Jun 02 05:48:42.812106 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:42.812074 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jz498\"" Jun 02 05:48:42.812843 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:42.812828 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qs5xc\"" Jun 02 05:48:42.819766 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:42.819749 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-758p5" Jun 02 05:48:42.819844 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:42.819777 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tqr92" Jun 02 05:48:42.955282 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:42.955252 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-758p5"] Jun 02 05:48:42.957936 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:48:42.957895 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e1a7f6b_52e8_4248_b043_8248779a965a.slice/crio-73d9ed111c2f09da9739851bcdea34dc6fdebacf55a58e642d46f8729f4bb609 WatchSource:0}: Error finding container 73d9ed111c2f09da9739851bcdea34dc6fdebacf55a58e642d46f8729f4bb609: Status 404 returned error can't find the container with id 73d9ed111c2f09da9739851bcdea34dc6fdebacf55a58e642d46f8729f4bb609 Jun 02 05:48:42.972248 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:42.972220 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tqr92"] Jun 02 05:48:42.975549 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:48:42.975525 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0587da4_0df5_48c6_9df5_3b69cc457181.slice/crio-3c40852522907158698c46eab7fdc8bdd9858c886506612e395f023ca809a6e6 WatchSource:0}: Error finding container 3c40852522907158698c46eab7fdc8bdd9858c886506612e395f023ca809a6e6: Status 404 returned error can't find the container with id 3c40852522907158698c46eab7fdc8bdd9858c886506612e395f023ca809a6e6 Jun 02 05:48:43.022263 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:43.022231 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tqr92" event={"ID":"f0587da4-0df5-48c6-9df5-3b69cc457181","Type":"ContainerStarted","Data":"3c40852522907158698c46eab7fdc8bdd9858c886506612e395f023ca809a6e6"} Jun 02 05:48:43.023213 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:43.023191 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-758p5" event={"ID":"3e1a7f6b-52e8-4248-b043-8248779a965a","Type":"ContainerStarted","Data":"73d9ed111c2f09da9739851bcdea34dc6fdebacf55a58e642d46f8729f4bb609"} Jun 02 05:48:45.033493 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:45.033445 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tqr92" event={"ID":"f0587da4-0df5-48c6-9df5-3b69cc457181","Type":"ContainerStarted","Data":"3d76bdf516efde139339bc1def1ad22d40bd4a84d824d011d3a812750ac7cb3e"} Jun 02 05:48:45.033493 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:45.033494 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tqr92" event={"ID":"f0587da4-0df5-48c6-9df5-3b69cc457181","Type":"ContainerStarted","Data":"6a3e69a78a22ec9913b1875e33b580c164e033d8a53a529fce07014400600459"} Jun 02 05:48:45.034057 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:45.033563 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tqr92" Jun 02 05:48:45.035532 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:45.035504 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-758p5" event={"ID":"3e1a7f6b-52e8-4248-b043-8248779a965a","Type":"ContainerStarted","Data":"5a22c5e6bbec4cd1cda67195e08c1b4da1cab274ed8f9cbae85f2777214e98d2"} Jun 02 05:48:45.050912 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:45.050849 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-tqr92" podStartSLOduration=129.190152847 podStartE2EDuration="2m11.050829167s" podCreationTimestamp="2026-06-02 05:46:34 +0000 UTC" firstStartedPulling="2026-06-02 05:48:42.977309432 +0000 UTC m=+161.109190301" lastFinishedPulling="2026-06-02 05:48:44.837985748 +0000 UTC m=+162.969866621" observedRunningTime="2026-06-02 05:48:45.050396111 +0000 UTC m=+163.182277003" watchObservedRunningTime="2026-06-02 05:48:45.050829167 +0000 UTC m=+163.182710058" Jun 02 05:48:45.066338 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:45.066278 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-758p5" podStartSLOduration=129.190127593 podStartE2EDuration="2m11.066257713s" podCreationTimestamp="2026-06-02 05:46:34 +0000 UTC" firstStartedPulling="2026-06-02 05:48:42.959989702 +0000 UTC m=+161.091870571" lastFinishedPulling="2026-06-02 05:48:44.83611982 +0000 UTC m=+162.968000691" observedRunningTime="2026-06-02 05:48:45.065565907 +0000 UTC m=+163.197446799" watchObservedRunningTime="2026-06-02 05:48:45.066257713 +0000 UTC m=+163.198138605" Jun 02 05:48:55.041269 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:55.041192 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tqr92" Jun 02 05:48:58.076307 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:58.076272 2575 generic.go:358] "Generic (PLEG): container finished" podID="d1f8d560-1e9f-42d4-8518-e019c0dbede4" containerID="ef2a068d8a52a0ec140b1e970f6915ffd362db13081782730a6fb668cb3399dd" exitCode=0 Jun 02 05:48:58.076307 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:58.076313 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-xk66t" event={"ID":"d1f8d560-1e9f-42d4-8518-e019c0dbede4","Type":"ContainerDied","Data":"ef2a068d8a52a0ec140b1e970f6915ffd362db13081782730a6fb668cb3399dd"} Jun 02 05:48:58.076719 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:58.076599 2575 scope.go:117] "RemoveContainer" containerID="ef2a068d8a52a0ec140b1e970f6915ffd362db13081782730a6fb668cb3399dd" Jun 02 05:48:59.080449 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:48:59.080413 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-xk66t" event={"ID":"d1f8d560-1e9f-42d4-8518-e019c0dbede4","Type":"ContainerStarted","Data":"c8592cc59ba060452661091e5883c4b569782de72e8f9ed878404bdbe7006f28"} Jun 02 05:49:19.034550 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:19.034514 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:19.050441 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:19.050413 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:19.151955 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:19.151916 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:37.057480 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.057430 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 05:49:37.058131 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.058099 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="prometheus" containerID="cri-o://c3f330d8ba5f938fff31434db5cbcf7f625f7debbe1fa5bfeb64579afd9673f8" gracePeriod=600 Jun 02 05:49:37.058971 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.058439 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="config-reloader" containerID="cri-o://dc9e988dd99716e757e9b9add579653f4e9f00ebf8d01b0bb88dcb7ec2bfae7b" gracePeriod=600 Jun 02 05:49:37.058971 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.058535 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="kube-rbac-proxy-web" containerID="cri-o://cd8b98857b10b0d646801688243bfdfd837b77440b84ebcf05f954ba763b07c3" gracePeriod=600 Jun 02 05:49:37.058971 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.058593 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="thanos-sidecar" containerID="cri-o://9da709ad95fe97311a3e49e2d4c84b1a76a0fbb8fc543166ec1d03a339fe2371" gracePeriod=600 Jun 02 05:49:37.058971 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.058104 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="kube-rbac-proxy-thanos" containerID="cri-o://6504f2aa496189d06cb1ddfa2bffbdb43cf433dd0f97efb4adba4cd3e84e9101" gracePeriod=600 Jun 02 05:49:37.059595 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.059007 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="kube-rbac-proxy" containerID="cri-o://39122b2cb69eb46a52d77790ea70feb81d9c21a9a81ae902108a509811ab1aab" gracePeriod=600 Jun 02 05:49:37.194042 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.194012 2575 generic.go:358] "Generic (PLEG): container finished" podID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerID="6504f2aa496189d06cb1ddfa2bffbdb43cf433dd0f97efb4adba4cd3e84e9101" exitCode=0 Jun 02 05:49:37.194042 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.194037 2575 generic.go:358] "Generic (PLEG): container finished" podID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerID="39122b2cb69eb46a52d77790ea70feb81d9c21a9a81ae902108a509811ab1aab" exitCode=0 Jun 02 05:49:37.194042 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.194045 2575 generic.go:358] "Generic (PLEG): container finished" podID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerID="cd8b98857b10b0d646801688243bfdfd837b77440b84ebcf05f954ba763b07c3" exitCode=0 Jun 02 05:49:37.194245 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.194050 2575 generic.go:358] "Generic (PLEG): container finished" podID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerID="9da709ad95fe97311a3e49e2d4c84b1a76a0fbb8fc543166ec1d03a339fe2371" exitCode=0 Jun 02 05:49:37.194245 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.194057 2575 generic.go:358] "Generic (PLEG): container finished" podID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerID="dc9e988dd99716e757e9b9add579653f4e9f00ebf8d01b0bb88dcb7ec2bfae7b" exitCode=0 Jun 02 05:49:37.194245 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.194065 2575 generic.go:358] "Generic (PLEG): container finished" podID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerID="c3f330d8ba5f938fff31434db5cbcf7f625f7debbe1fa5bfeb64579afd9673f8" exitCode=0 Jun 02 05:49:37.194245 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.194083 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b0c3456-82bf-4292-b023-84fa7d61b368","Type":"ContainerDied","Data":"6504f2aa496189d06cb1ddfa2bffbdb43cf433dd0f97efb4adba4cd3e84e9101"} Jun 02 05:49:37.194245 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.194110 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b0c3456-82bf-4292-b023-84fa7d61b368","Type":"ContainerDied","Data":"39122b2cb69eb46a52d77790ea70feb81d9c21a9a81ae902108a509811ab1aab"} Jun 02 05:49:37.194245 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.194120 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b0c3456-82bf-4292-b023-84fa7d61b368","Type":"ContainerDied","Data":"cd8b98857b10b0d646801688243bfdfd837b77440b84ebcf05f954ba763b07c3"} Jun 02 05:49:37.194245 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.194129 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b0c3456-82bf-4292-b023-84fa7d61b368","Type":"ContainerDied","Data":"9da709ad95fe97311a3e49e2d4c84b1a76a0fbb8fc543166ec1d03a339fe2371"} Jun 02 05:49:37.194245 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.194139 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b0c3456-82bf-4292-b023-84fa7d61b368","Type":"ContainerDied","Data":"dc9e988dd99716e757e9b9add579653f4e9f00ebf8d01b0bb88dcb7ec2bfae7b"} Jun 02 05:49:37.194245 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.194148 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b0c3456-82bf-4292-b023-84fa7d61b368","Type":"ContainerDied","Data":"c3f330d8ba5f938fff31434db5cbcf7f625f7debbe1fa5bfeb64579afd9673f8"} Jun 02 05:49:37.321503 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.320936 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:37.460227 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.460186 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-thanos-prometheus-http-client-file\") pod \"7b0c3456-82bf-4292-b023-84fa7d61b368\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " Jun 02 05:49:37.460424 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.460245 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-web-config\") pod \"7b0c3456-82bf-4292-b023-84fa7d61b368\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " Jun 02 05:49:37.460424 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.460268 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b0c3456-82bf-4292-b023-84fa7d61b368-config-out\") pod \"7b0c3456-82bf-4292-b023-84fa7d61b368\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " Jun 02 05:49:37.460424 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.460288 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-prometheus-trusted-ca-bundle\") pod \"7b0c3456-82bf-4292-b023-84fa7d61b368\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " Jun 02 05:49:37.460424 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.460306 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-configmap-serving-certs-ca-bundle\") pod \"7b0c3456-82bf-4292-b023-84fa7d61b368\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " Jun 02 05:49:37.460424 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.460327 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-kube-rbac-proxy\") pod \"7b0c3456-82bf-4292-b023-84fa7d61b368\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " Jun 02 05:49:37.460687 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.460455 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-grpc-tls\") pod \"7b0c3456-82bf-4292-b023-84fa7d61b368\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " Jun 02 05:49:37.460687 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.460517 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"7b0c3456-82bf-4292-b023-84fa7d61b368\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " Jun 02 05:49:37.460687 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.460551 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-prometheus-k8s-tls\") pod \"7b0c3456-82bf-4292-b023-84fa7d61b368\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " Jun 02 05:49:37.460687 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.460613 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-configmap-kubelet-serving-ca-bundle\") pod \"7b0c3456-82bf-4292-b023-84fa7d61b368\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " Jun 02 05:49:37.460687 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.460640 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7b0c3456-82bf-4292-b023-84fa7d61b368-prometheus-k8s-db\") pod \"7b0c3456-82bf-4292-b023-84fa7d61b368\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " Jun 02 05:49:37.460989 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.460714 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "7b0c3456-82bf-4292-b023-84fa7d61b368" (UID: "7b0c3456-82bf-4292-b023-84fa7d61b368"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 05:49:37.460989 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.460756 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "7b0c3456-82bf-4292-b023-84fa7d61b368" (UID: "7b0c3456-82bf-4292-b023-84fa7d61b368"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 05:49:37.461670 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.461641 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b0c3456-82bf-4292-b023-84fa7d61b368-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "7b0c3456-82bf-4292-b023-84fa7d61b368" (UID: "7b0c3456-82bf-4292-b023-84fa7d61b368"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 05:49:37.462159 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.462128 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "7b0c3456-82bf-4292-b023-84fa7d61b368" (UID: "7b0c3456-82bf-4292-b023-84fa7d61b368"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 05:49:37.462255 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.462187 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-metrics-client-certs\") pod \"7b0c3456-82bf-4292-b023-84fa7d61b368\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " Jun 02 05:49:37.462255 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.462220 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"7b0c3456-82bf-4292-b023-84fa7d61b368\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " Jun 02 05:49:37.462255 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.462247 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7spx\" (UniqueName: \"kubernetes.io/projected/7b0c3456-82bf-4292-b023-84fa7d61b368-kube-api-access-h7spx\") pod \"7b0c3456-82bf-4292-b023-84fa7d61b368\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " Jun 02 05:49:37.462423 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.462292 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b0c3456-82bf-4292-b023-84fa7d61b368-tls-assets\") pod \"7b0c3456-82bf-4292-b023-84fa7d61b368\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " Jun 02 05:49:37.462423 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.462322 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-config\") pod \"7b0c3456-82bf-4292-b023-84fa7d61b368\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " Jun 02 05:49:37.462423 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.462347 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-prometheus-k8s-rulefiles-0\") pod \"7b0c3456-82bf-4292-b023-84fa7d61b368\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " Jun 02 05:49:37.462423 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.462377 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-configmap-metrics-client-ca\") pod \"7b0c3456-82bf-4292-b023-84fa7d61b368\" (UID: \"7b0c3456-82bf-4292-b023-84fa7d61b368\") " Jun 02 05:49:37.462633 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.462614 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:49:37.462633 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.462629 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7b0c3456-82bf-4292-b023-84fa7d61b368-prometheus-k8s-db\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:49:37.462773 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.462642 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:49:37.462773 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.462655 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:49:37.463056 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.463019 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "7b0c3456-82bf-4292-b023-84fa7d61b368" (UID: "7b0c3456-82bf-4292-b023-84fa7d61b368"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 05:49:37.463148 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.463061 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "7b0c3456-82bf-4292-b023-84fa7d61b368" (UID: "7b0c3456-82bf-4292-b023-84fa7d61b368"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 05:49:37.463442 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.463383 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "7b0c3456-82bf-4292-b023-84fa7d61b368" (UID: "7b0c3456-82bf-4292-b023-84fa7d61b368"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 05:49:37.463986 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.463828 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "7b0c3456-82bf-4292-b023-84fa7d61b368" (UID: "7b0c3456-82bf-4292-b023-84fa7d61b368"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 05:49:37.463986 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.463877 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "7b0c3456-82bf-4292-b023-84fa7d61b368" (UID: "7b0c3456-82bf-4292-b023-84fa7d61b368"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 05:49:37.464130 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.464056 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b0c3456-82bf-4292-b023-84fa7d61b368-config-out" (OuterVolumeSpecName: "config-out") pod "7b0c3456-82bf-4292-b023-84fa7d61b368" (UID: "7b0c3456-82bf-4292-b023-84fa7d61b368"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 05:49:37.464190 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.464151 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "7b0c3456-82bf-4292-b023-84fa7d61b368" (UID: "7b0c3456-82bf-4292-b023-84fa7d61b368"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 05:49:37.465305 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.465276 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b0c3456-82bf-4292-b023-84fa7d61b368-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7b0c3456-82bf-4292-b023-84fa7d61b368" (UID: "7b0c3456-82bf-4292-b023-84fa7d61b368"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 05:49:37.465386 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.465290 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b0c3456-82bf-4292-b023-84fa7d61b368-kube-api-access-h7spx" (OuterVolumeSpecName: "kube-api-access-h7spx") pod "7b0c3456-82bf-4292-b023-84fa7d61b368" (UID: "7b0c3456-82bf-4292-b023-84fa7d61b368"). InnerVolumeSpecName "kube-api-access-h7spx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 05:49:37.465473 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.465446 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "7b0c3456-82bf-4292-b023-84fa7d61b368" (UID: "7b0c3456-82bf-4292-b023-84fa7d61b368"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 05:49:37.465515 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.465462 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-config" (OuterVolumeSpecName: "config") pod "7b0c3456-82bf-4292-b023-84fa7d61b368" (UID: "7b0c3456-82bf-4292-b023-84fa7d61b368"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 05:49:37.466107 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.466089 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "7b0c3456-82bf-4292-b023-84fa7d61b368" (UID: "7b0c3456-82bf-4292-b023-84fa7d61b368"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 05:49:37.466201 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.466185 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "7b0c3456-82bf-4292-b023-84fa7d61b368" (UID: "7b0c3456-82bf-4292-b023-84fa7d61b368"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 05:49:37.474664 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.474638 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-web-config" (OuterVolumeSpecName: "web-config") pod "7b0c3456-82bf-4292-b023-84fa7d61b368" (UID: "7b0c3456-82bf-4292-b023-84fa7d61b368"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 05:49:37.563389 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.563298 2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-grpc-tls\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:49:37.563389 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.563339 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:49:37.563389 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.563357 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:49:37.563389 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.563373 2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-metrics-client-certs\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:49:37.563389 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.563388 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:49:37.563655 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.563403 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7spx\" (UniqueName: \"kubernetes.io/projected/7b0c3456-82bf-4292-b023-84fa7d61b368-kube-api-access-h7spx\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:49:37.563655 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.563436 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b0c3456-82bf-4292-b023-84fa7d61b368-tls-assets\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:49:37.563655 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.563452 2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-config\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:49:37.563655 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.563466 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:49:37.563655 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.563480 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b0c3456-82bf-4292-b023-84fa7d61b368-configmap-metrics-client-ca\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:49:37.563655 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.563495 2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:49:37.563655 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.563511 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-web-config\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:49:37.563655 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.563524 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b0c3456-82bf-4292-b023-84fa7d61b368-config-out\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:49:37.563655 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:37.563537 2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b0c3456-82bf-4292-b023-84fa7d61b368-secret-kube-rbac-proxy\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:49:38.199501 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.199466 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b0c3456-82bf-4292-b023-84fa7d61b368","Type":"ContainerDied","Data":"c7e2b8a24ecdb298795c0119eaf925ea53ba6b312c099451640ec767d8218282"} Jun 02 05:49:38.199934 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.199514 2575 scope.go:117] "RemoveContainer" containerID="6504f2aa496189d06cb1ddfa2bffbdb43cf433dd0f97efb4adba4cd3e84e9101" Jun 02 05:49:38.199934 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.199581 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.208154 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.207983 2575 scope.go:117] "RemoveContainer" containerID="39122b2cb69eb46a52d77790ea70feb81d9c21a9a81ae902108a509811ab1aab" Jun 02 05:49:38.215064 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.215046 2575 scope.go:117] "RemoveContainer" containerID="cd8b98857b10b0d646801688243bfdfd837b77440b84ebcf05f954ba763b07c3" Jun 02 05:49:38.222803 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.222776 2575 scope.go:117] "RemoveContainer" containerID="9da709ad95fe97311a3e49e2d4c84b1a76a0fbb8fc543166ec1d03a339fe2371" Jun 02 05:49:38.223765 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.223712 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 05:49:38.228784 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.228761 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 05:49:38.230157 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.230131 2575 scope.go:117] "RemoveContainer" containerID="dc9e988dd99716e757e9b9add579653f4e9f00ebf8d01b0bb88dcb7ec2bfae7b" Jun 02 05:49:38.236768 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.236749 2575 scope.go:117] "RemoveContainer" containerID="c3f330d8ba5f938fff31434db5cbcf7f625f7debbe1fa5bfeb64579afd9673f8" Jun 02 05:49:38.243920 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.243894 2575 scope.go:117] "RemoveContainer" containerID="ae10277624abb84ad2c2fd580cd5f3c66cc28801e09319f687eef7c1ce7d0764" Jun 02 05:49:38.252187 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.252166 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 05:49:38.252482 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.252471 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="config-reloader" Jun 02 05:49:38.252532 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.252484 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="config-reloader" Jun 02 05:49:38.252532 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.252494 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="init-config-reloader" Jun 02 05:49:38.252532 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.252500 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="init-config-reloader" Jun 02 05:49:38.252532 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.252511 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="prometheus" Jun 02 05:49:38.252532 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.252517 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="prometheus" Jun 02 05:49:38.252532 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.252525 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="thanos-sidecar" Jun 02 05:49:38.252532 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.252530 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="thanos-sidecar" Jun 02 05:49:38.252766 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.252538 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="kube-rbac-proxy" Jun 02 05:49:38.252766 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.252543 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="kube-rbac-proxy" Jun 02 05:49:38.252766 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.252556 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="kube-rbac-proxy-web" Jun 02 05:49:38.252766 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.252561 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="kube-rbac-proxy-web" Jun 02 05:49:38.252766 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.252567 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="kube-rbac-proxy-thanos" Jun 02 05:49:38.252766 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.252571 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="kube-rbac-proxy-thanos" Jun 02 05:49:38.252766 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.252629 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="prometheus" Jun 02 05:49:38.252766 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.252636 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="kube-rbac-proxy" Jun 02 05:49:38.252766 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.252644 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="config-reloader" Jun 02 05:49:38.252766 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.252650 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="kube-rbac-proxy-thanos" Jun 02 05:49:38.252766 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.252657 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="kube-rbac-proxy-web" Jun 02 05:49:38.252766 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.252664 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" containerName="thanos-sidecar" Jun 02 05:49:38.258119 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.258101 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.260563 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.260536 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 05:49:38.260686 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.260664 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 05:49:38.260850 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.260827 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2hpb5\"" Jun 02 05:49:38.260970 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.260911 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 05:49:38.261193 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.261175 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 05:49:38.261291 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.261217 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 05:49:38.261466 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.261448 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 05:49:38.261581 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.261482 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 05:49:38.261581 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.261529 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 05:49:38.262102 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.262073 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 05:49:38.262220 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.262183 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 05:49:38.262669 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.262649 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cosk3in9lhtc6\"" Jun 02 05:49:38.262781 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.262761 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 05:49:38.264534 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.264517 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 05:49:38.267167 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.267149 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 05:49:38.271077 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.271054 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 05:49:38.354445 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.354351 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b0c3456-82bf-4292-b023-84fa7d61b368" path="/var/lib/kubelet/pods/7b0c3456-82bf-4292-b023-84fa7d61b368/volumes" Jun 02 05:49:38.370053 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.370016 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.370220 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.370059 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.370220 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.370084 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.370220 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.370124 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.370220 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.370162 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-config-out\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.370220 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.370180 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.370220 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.370205 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-web-config\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.370445 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.370231 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.370445 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.370254 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.370445 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.370271 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.370445 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.370286 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92289\" (UniqueName: \"kubernetes.io/projected/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-kube-api-access-92289\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.370445 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.370347 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.370445 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.370373 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.370445 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.370394 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-config\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.370445 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.370412 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.370445 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.370428 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.370715 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.370499 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.370715 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.370531 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.471468 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.471430 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.471581 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.471473 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.471581 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.471505 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.471581 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.471548 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.471581 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.471578 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.471822 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.471602 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.471822 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.471631 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-config-out\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.471822 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.471657 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.471822 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.471687 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-web-config\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.471822 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.471760 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.471822 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.471791 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.471822 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.471819 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.472144 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.471843 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-92289\" (UniqueName: \"kubernetes.io/projected/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-kube-api-access-92289\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.472144 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.471891 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.472144 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.471920 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.472144 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.471948 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-config\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.472144 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.471978 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.472144 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.472001 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.472800 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.472770 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.473207 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.473184 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.474938 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.474910 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.475039 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.474948 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-config-out\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.475039 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.474908 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.475039 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.474947 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.475197 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.475050 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.475549 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.475516 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.475756 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.475706 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.476059 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.476035 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-web-config\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.476545 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.476513 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.476993 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.476954 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.477183 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.477155 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.477380 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.477359 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-config\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.477499 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.477483 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.477596 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.477578 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.478000 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.477984 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.482464 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.482440 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92289\" (UniqueName: \"kubernetes.io/projected/8f9dd3bc-c1c5-4251-8c23-e90f94cad43f-kube-api-access-92289\") pod \"prometheus-k8s-0\" (UID: \"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.569564 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.569511 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:49:38.703853 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:38.703825 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 05:49:38.706453 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:49:38.706422 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f9dd3bc_c1c5_4251_8c23_e90f94cad43f.slice/crio-79b180186b9e058de1c7439bd24f6a6194176c1ccbfd26ccf4ea8eab02d134de WatchSource:0}: Error finding container 79b180186b9e058de1c7439bd24f6a6194176c1ccbfd26ccf4ea8eab02d134de: Status 404 returned error can't find the container with id 79b180186b9e058de1c7439bd24f6a6194176c1ccbfd26ccf4ea8eab02d134de Jun 02 05:49:39.204179 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:39.204144 2575 generic.go:358] "Generic (PLEG): container finished" podID="8f9dd3bc-c1c5-4251-8c23-e90f94cad43f" containerID="fa2e628943ed798ab3724f1eb4e9ef106bba9a5c6d69fcb0b8e11ba223843f61" exitCode=0 Jun 02 05:49:39.204567 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:39.204201 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f","Type":"ContainerDied","Data":"fa2e628943ed798ab3724f1eb4e9ef106bba9a5c6d69fcb0b8e11ba223843f61"} Jun 02 05:49:39.204567 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:39.204222 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f","Type":"ContainerStarted","Data":"79b180186b9e058de1c7439bd24f6a6194176c1ccbfd26ccf4ea8eab02d134de"} Jun 02 05:49:40.210301 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:40.210261 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f","Type":"ContainerStarted","Data":"e39fe437be6564dd1cd36a2355625e1c56910bbc6d17c80c5e63a5eb09abef89"} Jun 02 05:49:40.210301 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:40.210299 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f","Type":"ContainerStarted","Data":"bb9954862d69e2322502616346cd16bd0755f03dd3939c8c460b25bee7245e75"} Jun 02 05:49:40.210301 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:40.210309 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f","Type":"ContainerStarted","Data":"c8e26d49e63ac62a5f1c11a2c257bf6dea68c0d209c7cbb97bf32ecb184f4696"} Jun 02 05:49:40.210825 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:40.210317 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f","Type":"ContainerStarted","Data":"14a08350bbe727c99787a132992ff12c7f13c2797f5f2e9086233708691e52bc"} Jun 02 05:49:40.210825 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:40.210325 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f","Type":"ContainerStarted","Data":"e9cac9a0fe778475129ebfcf95fcf75e04dc2935cbf195a54b46b271f40b40a2"} Jun 02 05:49:40.210825 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:40.210333 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f9dd3bc-c1c5-4251-8c23-e90f94cad43f","Type":"ContainerStarted","Data":"286a6132245cc81dd67cdcd2351d114715e4ef33d570d8c16ab2bbbcf4d0ad1c"} Jun 02 05:49:40.235569 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:40.235511 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.235496724 podStartE2EDuration="2.235496724s" podCreationTimestamp="2026-06-02 05:49:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 05:49:40.234290817 +0000 UTC m=+218.366171723" watchObservedRunningTime="2026-06-02 05:49:40.235496724 +0000 UTC m=+218.367377609" Jun 02 05:49:43.570675 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:49:43.570631 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:50:38.570344 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:50:38.570241 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:50:38.587616 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:50:38.587580 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:50:39.415588 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:50:39.415498 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 05:51:02.238874 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:02.238830 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qqgq_b68ed6d7-9e23-4f45-a0fb-18ca25e28836/console-operator/2.log" Jun 02 05:51:02.239418 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:02.239076 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qqgq_b68ed6d7-9e23-4f45-a0fb-18ca25e28836/console-operator/2.log" Jun 02 05:51:02.249592 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:02.249561 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j46gm_e7d6b49b-7faa-4b7d-b3ba-2398141c920d/ovn-acl-logging/0.log" Jun 02 05:51:02.249804 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:02.249595 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j46gm_e7d6b49b-7faa-4b7d-b3ba-2398141c920d/ovn-acl-logging/0.log" Jun 02 05:51:02.255915 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:02.255893 2575 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 05:51:19.509287 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.509253 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh"] Jun 02 05:51:19.512613 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.512595 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh" Jun 02 05:51:19.516067 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.516044 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 05:51:19.516365 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.516342 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 05:51:19.516778 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.516758 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-d2dbt\"" Jun 02 05:51:19.517261 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.517241 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 05:51:19.517672 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.517657 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 05:51:19.532113 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.532083 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh"] Jun 02 05:51:19.612350 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.612309 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da47eba2-31e0-46fe-bda5-05a987883567-tmp\") pod \"opendatahub-operator-controller-manager-74d9c7f795-njkbh\" (UID: \"da47eba2-31e0-46fe-bda5-05a987883567\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh" Jun 02 05:51:19.612350 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.612360 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/da47eba2-31e0-46fe-bda5-05a987883567-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74d9c7f795-njkbh\" (UID: \"da47eba2-31e0-46fe-bda5-05a987883567\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh" Jun 02 05:51:19.612617 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.612407 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgrl6\" (UniqueName: \"kubernetes.io/projected/da47eba2-31e0-46fe-bda5-05a987883567-kube-api-access-bgrl6\") pod \"opendatahub-operator-controller-manager-74d9c7f795-njkbh\" (UID: \"da47eba2-31e0-46fe-bda5-05a987883567\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh" Jun 02 05:51:19.612617 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.612443 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/da47eba2-31e0-46fe-bda5-05a987883567-manifests\") pod \"opendatahub-operator-controller-manager-74d9c7f795-njkbh\" (UID: \"da47eba2-31e0-46fe-bda5-05a987883567\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh" Jun 02 05:51:19.612617 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.612475 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da47eba2-31e0-46fe-bda5-05a987883567-webhook-cert\") pod \"opendatahub-operator-controller-manager-74d9c7f795-njkbh\" (UID: \"da47eba2-31e0-46fe-bda5-05a987883567\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh" Jun 02 05:51:19.713063 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.713021 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da47eba2-31e0-46fe-bda5-05a987883567-webhook-cert\") pod \"opendatahub-operator-controller-manager-74d9c7f795-njkbh\" (UID: \"da47eba2-31e0-46fe-bda5-05a987883567\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh" Jun 02 05:51:19.713245 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.713199 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da47eba2-31e0-46fe-bda5-05a987883567-tmp\") pod \"opendatahub-operator-controller-manager-74d9c7f795-njkbh\" (UID: \"da47eba2-31e0-46fe-bda5-05a987883567\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh" Jun 02 05:51:19.713294 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.713244 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/da47eba2-31e0-46fe-bda5-05a987883567-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74d9c7f795-njkbh\" (UID: \"da47eba2-31e0-46fe-bda5-05a987883567\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh" Jun 02 05:51:19.713328 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.713296 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bgrl6\" (UniqueName: \"kubernetes.io/projected/da47eba2-31e0-46fe-bda5-05a987883567-kube-api-access-bgrl6\") pod \"opendatahub-operator-controller-manager-74d9c7f795-njkbh\" (UID: \"da47eba2-31e0-46fe-bda5-05a987883567\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh" Jun 02 05:51:19.713366 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.713332 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/da47eba2-31e0-46fe-bda5-05a987883567-manifests\") pod \"opendatahub-operator-controller-manager-74d9c7f795-njkbh\" (UID: \"da47eba2-31e0-46fe-bda5-05a987883567\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh" Jun 02 05:51:19.713700 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.713669 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/da47eba2-31e0-46fe-bda5-05a987883567-manifests\") pod \"opendatahub-operator-controller-manager-74d9c7f795-njkbh\" (UID: \"da47eba2-31e0-46fe-bda5-05a987883567\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh" Jun 02 05:51:19.715542 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.715522 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da47eba2-31e0-46fe-bda5-05a987883567-tmp\") pod \"opendatahub-operator-controller-manager-74d9c7f795-njkbh\" (UID: \"da47eba2-31e0-46fe-bda5-05a987883567\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh" Jun 02 05:51:19.715678 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.715661 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/da47eba2-31e0-46fe-bda5-05a987883567-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74d9c7f795-njkbh\" (UID: \"da47eba2-31e0-46fe-bda5-05a987883567\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh" Jun 02 05:51:19.715780 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.715762 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da47eba2-31e0-46fe-bda5-05a987883567-webhook-cert\") pod \"opendatahub-operator-controller-manager-74d9c7f795-njkbh\" (UID: \"da47eba2-31e0-46fe-bda5-05a987883567\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh" Jun 02 05:51:19.721145 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.721112 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgrl6\" (UniqueName: \"kubernetes.io/projected/da47eba2-31e0-46fe-bda5-05a987883567-kube-api-access-bgrl6\") pod \"opendatahub-operator-controller-manager-74d9c7f795-njkbh\" (UID: \"da47eba2-31e0-46fe-bda5-05a987883567\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh" Jun 02 05:51:19.824534 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.824498 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh" Jun 02 05:51:19.955702 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.955665 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh"] Jun 02 05:51:19.959879 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:51:19.959846 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda47eba2_31e0_46fe_bda5_05a987883567.slice/crio-54b15f16dd56b3f3149c716b10c0d658baf8cc550736ddf02195ecf6b62b2d8c WatchSource:0}: Error finding container 54b15f16dd56b3f3149c716b10c0d658baf8cc550736ddf02195ecf6b62b2d8c: Status 404 returned error can't find the container with id 54b15f16dd56b3f3149c716b10c0d658baf8cc550736ddf02195ecf6b62b2d8c Jun 02 05:51:19.961565 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:19.961549 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 05:51:20.522416 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:20.522376 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh" event={"ID":"da47eba2-31e0-46fe-bda5-05a987883567","Type":"ContainerStarted","Data":"54b15f16dd56b3f3149c716b10c0d658baf8cc550736ddf02195ecf6b62b2d8c"} Jun 02 05:51:23.536076 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:23.536038 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh" event={"ID":"da47eba2-31e0-46fe-bda5-05a987883567","Type":"ContainerStarted","Data":"aa49c37094f71cdd57d201c59a2379def1eb0239c58985f633e7184e0dfff747"} Jun 02 05:51:24.540898 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:24.540857 2575 generic.go:358] "Generic (PLEG): container finished" podID="da47eba2-31e0-46fe-bda5-05a987883567" containerID="aa49c37094f71cdd57d201c59a2379def1eb0239c58985f633e7184e0dfff747" exitCode=0 Jun 02 05:51:24.541396 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:24.540937 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh" event={"ID":"da47eba2-31e0-46fe-bda5-05a987883567","Type":"ContainerDied","Data":"aa49c37094f71cdd57d201c59a2379def1eb0239c58985f633e7184e0dfff747"} Jun 02 05:51:25.546406 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:25.546366 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh" event={"ID":"da47eba2-31e0-46fe-bda5-05a987883567","Type":"ContainerStarted","Data":"a36c3e570b03ffd011c612ce55c19bf6a59cda7e9630ddec6c7f600062ed6e5e"} Jun 02 05:51:25.546832 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:25.546465 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh" Jun 02 05:51:25.568371 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:25.568281 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh" podStartSLOduration=1.68305124 podStartE2EDuration="6.568262829s" podCreationTimestamp="2026-06-02 05:51:19 +0000 UTC" firstStartedPulling="2026-06-02 05:51:19.961666841 +0000 UTC m=+318.093547714" lastFinishedPulling="2026-06-02 05:51:24.846878431 +0000 UTC m=+322.978759303" observedRunningTime="2026-06-02 05:51:25.565795055 +0000 UTC m=+323.697675939" watchObservedRunningTime="2026-06-02 05:51:25.568262829 +0000 UTC m=+323.700143722" Jun 02 05:51:36.553679 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:36.553644 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-njkbh" Jun 02 05:51:39.652980 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:39.652943 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5989bfd89f-gj8lz"] Jun 02 05:51:39.671765 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:39.671714 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5989bfd89f-gj8lz"] Jun 02 05:51:39.671977 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:39.671867 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5989bfd89f-gj8lz" Jun 02 05:51:39.674951 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:39.674930 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 05:51:39.676113 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:39.675860 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mv5qw\"" Jun 02 05:51:39.676113 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:39.675907 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 02 05:51:39.676113 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:39.675971 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 02 05:51:39.676113 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:39.675910 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 02 05:51:39.676113 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:39.676001 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 05:51:39.789182 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:39.789143 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0803f8a6-24cc-4253-9a44-e52660ce9f63-metrics-cert\") pod \"lws-controller-manager-5989bfd89f-gj8lz\" (UID: \"0803f8a6-24cc-4253-9a44-e52660ce9f63\") " pod="openshift-lws-operator/lws-controller-manager-5989bfd89f-gj8lz" Jun 02 05:51:39.789182 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:39.789188 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0803f8a6-24cc-4253-9a44-e52660ce9f63-cert\") pod \"lws-controller-manager-5989bfd89f-gj8lz\" (UID: \"0803f8a6-24cc-4253-9a44-e52660ce9f63\") " pod="openshift-lws-operator/lws-controller-manager-5989bfd89f-gj8lz" Jun 02 05:51:39.789401 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:39.789210 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0803f8a6-24cc-4253-9a44-e52660ce9f63-manager-config\") pod \"lws-controller-manager-5989bfd89f-gj8lz\" (UID: \"0803f8a6-24cc-4253-9a44-e52660ce9f63\") " pod="openshift-lws-operator/lws-controller-manager-5989bfd89f-gj8lz" Jun 02 05:51:39.789401 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:39.789232 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj8vf\" (UniqueName: \"kubernetes.io/projected/0803f8a6-24cc-4253-9a44-e52660ce9f63-kube-api-access-bj8vf\") pod \"lws-controller-manager-5989bfd89f-gj8lz\" (UID: \"0803f8a6-24cc-4253-9a44-e52660ce9f63\") " pod="openshift-lws-operator/lws-controller-manager-5989bfd89f-gj8lz" Jun 02 05:51:39.890051 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:39.890006 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0803f8a6-24cc-4253-9a44-e52660ce9f63-metrics-cert\") pod \"lws-controller-manager-5989bfd89f-gj8lz\" (UID: \"0803f8a6-24cc-4253-9a44-e52660ce9f63\") " pod="openshift-lws-operator/lws-controller-manager-5989bfd89f-gj8lz" Jun 02 05:51:39.890243 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:39.890066 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0803f8a6-24cc-4253-9a44-e52660ce9f63-cert\") pod \"lws-controller-manager-5989bfd89f-gj8lz\" (UID: \"0803f8a6-24cc-4253-9a44-e52660ce9f63\") " pod="openshift-lws-operator/lws-controller-manager-5989bfd89f-gj8lz" Jun 02 05:51:39.890243 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:39.890098 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0803f8a6-24cc-4253-9a44-e52660ce9f63-manager-config\") pod \"lws-controller-manager-5989bfd89f-gj8lz\" (UID: \"0803f8a6-24cc-4253-9a44-e52660ce9f63\") " pod="openshift-lws-operator/lws-controller-manager-5989bfd89f-gj8lz" Jun 02 05:51:39.890243 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:39.890121 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bj8vf\" (UniqueName: \"kubernetes.io/projected/0803f8a6-24cc-4253-9a44-e52660ce9f63-kube-api-access-bj8vf\") pod \"lws-controller-manager-5989bfd89f-gj8lz\" (UID: \"0803f8a6-24cc-4253-9a44-e52660ce9f63\") " pod="openshift-lws-operator/lws-controller-manager-5989bfd89f-gj8lz" Jun 02 05:51:39.890868 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:39.890840 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0803f8a6-24cc-4253-9a44-e52660ce9f63-manager-config\") pod \"lws-controller-manager-5989bfd89f-gj8lz\" (UID: \"0803f8a6-24cc-4253-9a44-e52660ce9f63\") " pod="openshift-lws-operator/lws-controller-manager-5989bfd89f-gj8lz" Jun 02 05:51:39.892642 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:39.892620 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0803f8a6-24cc-4253-9a44-e52660ce9f63-metrics-cert\") pod \"lws-controller-manager-5989bfd89f-gj8lz\" (UID: \"0803f8a6-24cc-4253-9a44-e52660ce9f63\") " pod="openshift-lws-operator/lws-controller-manager-5989bfd89f-gj8lz" Jun 02 05:51:39.892751 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:39.892702 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0803f8a6-24cc-4253-9a44-e52660ce9f63-cert\") pod \"lws-controller-manager-5989bfd89f-gj8lz\" (UID: \"0803f8a6-24cc-4253-9a44-e52660ce9f63\") " pod="openshift-lws-operator/lws-controller-manager-5989bfd89f-gj8lz" Jun 02 05:51:39.901678 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:39.901644 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj8vf\" (UniqueName: \"kubernetes.io/projected/0803f8a6-24cc-4253-9a44-e52660ce9f63-kube-api-access-bj8vf\") pod \"lws-controller-manager-5989bfd89f-gj8lz\" (UID: \"0803f8a6-24cc-4253-9a44-e52660ce9f63\") " pod="openshift-lws-operator/lws-controller-manager-5989bfd89f-gj8lz" Jun 02 05:51:39.985050 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:39.984960 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5989bfd89f-gj8lz" Jun 02 05:51:40.113250 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:40.113224 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5989bfd89f-gj8lz"] Jun 02 05:51:40.115907 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:51:40.115878 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0803f8a6_24cc_4253_9a44_e52660ce9f63.slice/crio-4eec3c850ebc0c84acd6fc9fe30df3d095f8bd2d51e6e589f4ea75e230924cf5 WatchSource:0}: Error finding container 4eec3c850ebc0c84acd6fc9fe30df3d095f8bd2d51e6e589f4ea75e230924cf5: Status 404 returned error can't find the container with id 4eec3c850ebc0c84acd6fc9fe30df3d095f8bd2d51e6e589f4ea75e230924cf5 Jun 02 05:51:40.596455 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:40.596417 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5989bfd89f-gj8lz" event={"ID":"0803f8a6-24cc-4253-9a44-e52660ce9f63","Type":"ContainerStarted","Data":"4eec3c850ebc0c84acd6fc9fe30df3d095f8bd2d51e6e589f4ea75e230924cf5"} Jun 02 05:51:43.609915 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:43.609875 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5989bfd89f-gj8lz" event={"ID":"0803f8a6-24cc-4253-9a44-e52660ce9f63","Type":"ContainerStarted","Data":"7e0377d8f730cd258f00dc46a4187c3ad7586067d11b969a918347c9906c264d"} Jun 02 05:51:43.610315 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:43.610021 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5989bfd89f-gj8lz" Jun 02 05:51:43.625279 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:43.625233 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5989bfd89f-gj8lz" podStartSLOduration=1.7278099089999999 podStartE2EDuration="4.625217978s" podCreationTimestamp="2026-06-02 05:51:39 +0000 UTC" firstStartedPulling="2026-06-02 05:51:40.117584796 +0000 UTC m=+338.249465665" lastFinishedPulling="2026-06-02 05:51:43.01499286 +0000 UTC m=+341.146873734" observedRunningTime="2026-06-02 05:51:43.623812619 +0000 UTC m=+341.755693507" watchObservedRunningTime="2026-06-02 05:51:43.625217978 +0000 UTC m=+341.757098868" Jun 02 05:51:49.415433 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:49.415346 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d6fbd88fb-lk8hw"] Jun 02 05:51:49.419136 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:49.419110 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-lk8hw" Jun 02 05:51:49.422223 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:49.422198 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 05:51:49.422223 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:49.422211 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 05:51:49.422700 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:49.422686 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-qwt59\"" Jun 02 05:51:49.428574 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:49.428546 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d6fbd88fb-lk8hw"] Jun 02 05:51:49.477393 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:49.477348 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpgpc\" (UniqueName: \"kubernetes.io/projected/f15142ca-6fa0-4840-a708-52badee8efff-kube-api-access-lpgpc\") pod \"kube-auth-proxy-7d6fbd88fb-lk8hw\" (UID: \"f15142ca-6fa0-4840-a708-52badee8efff\") " pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-lk8hw" Jun 02 05:51:49.477544 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:49.477455 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f15142ca-6fa0-4840-a708-52badee8efff-tls-certs\") pod \"kube-auth-proxy-7d6fbd88fb-lk8hw\" (UID: \"f15142ca-6fa0-4840-a708-52badee8efff\") " pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-lk8hw" Jun 02 05:51:49.477544 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:49.477521 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f15142ca-6fa0-4840-a708-52badee8efff-tmp\") pod \"kube-auth-proxy-7d6fbd88fb-lk8hw\" (UID: \"f15142ca-6fa0-4840-a708-52badee8efff\") " pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-lk8hw" Jun 02 05:51:49.577955 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:49.577914 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lpgpc\" (UniqueName: \"kubernetes.io/projected/f15142ca-6fa0-4840-a708-52badee8efff-kube-api-access-lpgpc\") pod \"kube-auth-proxy-7d6fbd88fb-lk8hw\" (UID: \"f15142ca-6fa0-4840-a708-52badee8efff\") " pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-lk8hw" Jun 02 05:51:49.578185 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:49.577995 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f15142ca-6fa0-4840-a708-52badee8efff-tls-certs\") pod \"kube-auth-proxy-7d6fbd88fb-lk8hw\" (UID: \"f15142ca-6fa0-4840-a708-52badee8efff\") " pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-lk8hw" Jun 02 05:51:49.578185 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:49.578038 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f15142ca-6fa0-4840-a708-52badee8efff-tmp\") pod \"kube-auth-proxy-7d6fbd88fb-lk8hw\" (UID: \"f15142ca-6fa0-4840-a708-52badee8efff\") " pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-lk8hw" Jun 02 05:51:49.580427 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:49.580400 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f15142ca-6fa0-4840-a708-52badee8efff-tmp\") pod \"kube-auth-proxy-7d6fbd88fb-lk8hw\" (UID: \"f15142ca-6fa0-4840-a708-52badee8efff\") " pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-lk8hw" Jun 02 05:51:49.580604 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:49.580587 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f15142ca-6fa0-4840-a708-52badee8efff-tls-certs\") pod \"kube-auth-proxy-7d6fbd88fb-lk8hw\" (UID: \"f15142ca-6fa0-4840-a708-52badee8efff\") " pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-lk8hw" Jun 02 05:51:49.594953 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:49.594921 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpgpc\" (UniqueName: \"kubernetes.io/projected/f15142ca-6fa0-4840-a708-52badee8efff-kube-api-access-lpgpc\") pod \"kube-auth-proxy-7d6fbd88fb-lk8hw\" (UID: \"f15142ca-6fa0-4840-a708-52badee8efff\") " pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-lk8hw" Jun 02 05:51:49.731548 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:49.731452 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-lk8hw" Jun 02 05:51:49.861973 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:49.861797 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d6fbd88fb-lk8hw"] Jun 02 05:51:49.864199 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:51:49.864169 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf15142ca_6fa0_4840_a708_52badee8efff.slice/crio-5e2ed5f9779cb084126b21ed6aee0f48225a8d336a46c22aa67db2818be4c86d WatchSource:0}: Error finding container 5e2ed5f9779cb084126b21ed6aee0f48225a8d336a46c22aa67db2818be4c86d: Status 404 returned error can't find the container with id 5e2ed5f9779cb084126b21ed6aee0f48225a8d336a46c22aa67db2818be4c86d Jun 02 05:51:50.635209 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:50.635145 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-lk8hw" event={"ID":"f15142ca-6fa0-4840-a708-52badee8efff","Type":"ContainerStarted","Data":"5e2ed5f9779cb084126b21ed6aee0f48225a8d336a46c22aa67db2818be4c86d"} Jun 02 05:51:53.651384 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:53.651344 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-lk8hw" event={"ID":"f15142ca-6fa0-4840-a708-52badee8efff","Type":"ContainerStarted","Data":"b4c580eb45c119cf7e99092f5ce479842ffbff42f90335e40008e1c943835c17"} Jun 02 05:51:53.670173 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:53.670113 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-lk8hw" podStartSLOduration=1.7360521819999999 podStartE2EDuration="4.670096756s" podCreationTimestamp="2026-06-02 05:51:49 +0000 UTC" firstStartedPulling="2026-06-02 05:51:49.865891852 +0000 UTC m=+347.997772721" lastFinishedPulling="2026-06-02 05:51:52.799936422 +0000 UTC m=+350.931817295" observedRunningTime="2026-06-02 05:51:53.669052044 +0000 UTC m=+351.800932935" watchObservedRunningTime="2026-06-02 05:51:53.670096756 +0000 UTC m=+351.801977647" Jun 02 05:51:54.616208 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:51:54.616178 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5989bfd89f-gj8lz" Jun 02 05:53:19.201681 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:19.201589 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbtpw"] Jun 02 05:53:19.204929 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:19.204910 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbtpw" Jun 02 05:53:19.207789 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:19.207769 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 05:53:19.208635 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:19.208614 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-796gw\"" Jun 02 05:53:19.208744 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:19.208644 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 02 05:53:19.208744 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:19.208665 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 05:53:19.216854 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:19.216825 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbtpw"] Jun 02 05:53:19.368302 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:19.368264 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5wtj\" (UniqueName: \"kubernetes.io/projected/37d4f7cb-7c83-46ce-9b19-f6a97658cd76-kube-api-access-t5wtj\") pod \"dns-operator-controller-manager-648d5c98bc-nbtpw\" (UID: \"37d4f7cb-7c83-46ce-9b19-f6a97658cd76\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbtpw" Jun 02 05:53:19.469794 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:19.469681 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t5wtj\" (UniqueName: \"kubernetes.io/projected/37d4f7cb-7c83-46ce-9b19-f6a97658cd76-kube-api-access-t5wtj\") pod \"dns-operator-controller-manager-648d5c98bc-nbtpw\" (UID: \"37d4f7cb-7c83-46ce-9b19-f6a97658cd76\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbtpw" Jun 02 05:53:19.479565 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:19.479524 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5wtj\" (UniqueName: \"kubernetes.io/projected/37d4f7cb-7c83-46ce-9b19-f6a97658cd76-kube-api-access-t5wtj\") pod \"dns-operator-controller-manager-648d5c98bc-nbtpw\" (UID: \"37d4f7cb-7c83-46ce-9b19-f6a97658cd76\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbtpw" Jun 02 05:53:19.516543 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:19.516509 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbtpw" Jun 02 05:53:19.651585 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:19.651558 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbtpw"] Jun 02 05:53:19.654311 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:53:19.654283 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37d4f7cb_7c83_46ce_9b19_f6a97658cd76.slice/crio-1cda5fbefd1b7afdc247c44823a420bda3bce2ed54bb8626ea93e2d8bac9b69f WatchSource:0}: Error finding container 1cda5fbefd1b7afdc247c44823a420bda3bce2ed54bb8626ea93e2d8bac9b69f: Status 404 returned error can't find the container with id 1cda5fbefd1b7afdc247c44823a420bda3bce2ed54bb8626ea93e2d8bac9b69f Jun 02 05:53:19.951819 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:19.951776 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbtpw" event={"ID":"37d4f7cb-7c83-46ce-9b19-f6a97658cd76","Type":"ContainerStarted","Data":"1cda5fbefd1b7afdc247c44823a420bda3bce2ed54bb8626ea93e2d8bac9b69f"} Jun 02 05:53:21.963381 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:21.963345 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbtpw" event={"ID":"37d4f7cb-7c83-46ce-9b19-f6a97658cd76","Type":"ContainerStarted","Data":"a9950786ba59484d6b4d2da68ee81a97a00e1d68ad784b9a5c74443b74ae9195"} Jun 02 05:53:21.963801 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:21.963402 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbtpw" Jun 02 05:53:21.990668 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:21.985738 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbtpw" podStartSLOduration=1.160293337 podStartE2EDuration="2.985703254s" podCreationTimestamp="2026-06-02 05:53:19 +0000 UTC" firstStartedPulling="2026-06-02 05:53:19.659288046 +0000 UTC m=+437.791168916" lastFinishedPulling="2026-06-02 05:53:21.48469796 +0000 UTC m=+439.616578833" observedRunningTime="2026-06-02 05:53:21.982675703 +0000 UTC m=+440.114556593" watchObservedRunningTime="2026-06-02 05:53:21.985703254 +0000 UTC m=+440.117584147" Jun 02 05:53:23.716204 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:23.716166 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q"] Jun 02 05:53:23.719749 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:23.719710 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" Jun 02 05:53:23.722372 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:23.722350 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nkj4p\"" Jun 02 05:53:23.733932 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:23.733899 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q"] Jun 02 05:53:23.807912 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:23.807865 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e34c9d2-be1e-45dd-942a-1d96caee121f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lxk2q\" (UID: \"0e34c9d2-be1e-45dd-942a-1d96caee121f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" Jun 02 05:53:23.808096 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:23.807925 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plkqn\" (UniqueName: \"kubernetes.io/projected/0e34c9d2-be1e-45dd-942a-1d96caee121f-kube-api-access-plkqn\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lxk2q\" (UID: \"0e34c9d2-be1e-45dd-942a-1d96caee121f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" Jun 02 05:53:23.908853 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:23.908816 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e34c9d2-be1e-45dd-942a-1d96caee121f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lxk2q\" (UID: \"0e34c9d2-be1e-45dd-942a-1d96caee121f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" Jun 02 05:53:23.908996 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:23.908868 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-plkqn\" (UniqueName: \"kubernetes.io/projected/0e34c9d2-be1e-45dd-942a-1d96caee121f-kube-api-access-plkqn\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lxk2q\" (UID: \"0e34c9d2-be1e-45dd-942a-1d96caee121f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" Jun 02 05:53:23.909195 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:23.909171 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e34c9d2-be1e-45dd-942a-1d96caee121f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lxk2q\" (UID: \"0e34c9d2-be1e-45dd-942a-1d96caee121f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" Jun 02 05:53:23.917058 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:23.917037 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plkqn\" (UniqueName: \"kubernetes.io/projected/0e34c9d2-be1e-45dd-942a-1d96caee121f-kube-api-access-plkqn\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lxk2q\" (UID: \"0e34c9d2-be1e-45dd-942a-1d96caee121f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" Jun 02 05:53:24.030145 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:24.030051 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" Jun 02 05:53:24.164469 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:24.164444 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q"] Jun 02 05:53:24.166714 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:53:24.166687 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e34c9d2_be1e_45dd_942a_1d96caee121f.slice/crio-2b636f411460c5af035440eb886d8a50d8d9ac99fede3d530d8e19183e21f22b WatchSource:0}: Error finding container 2b636f411460c5af035440eb886d8a50d8d9ac99fede3d530d8e19183e21f22b: Status 404 returned error can't find the container with id 2b636f411460c5af035440eb886d8a50d8d9ac99fede3d530d8e19183e21f22b Jun 02 05:53:24.973809 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:24.973766 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" event={"ID":"0e34c9d2-be1e-45dd-942a-1d96caee121f","Type":"ContainerStarted","Data":"2b636f411460c5af035440eb886d8a50d8d9ac99fede3d530d8e19183e21f22b"} Jun 02 05:53:29.994049 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:29.993997 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" event={"ID":"0e34c9d2-be1e-45dd-942a-1d96caee121f","Type":"ContainerStarted","Data":"d77e58dc86c91b35a558b7c1abfb72c39c3d687c3ad81cac2f7fe296e0360b01"} Jun 02 05:53:29.994435 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:29.994096 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" Jun 02 05:53:30.018219 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:30.018159 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" podStartSLOduration=1.2923941110000001 podStartE2EDuration="7.018139108s" podCreationTimestamp="2026-06-02 05:53:23 +0000 UTC" firstStartedPulling="2026-06-02 05:53:24.169199779 +0000 UTC m=+442.301080653" lastFinishedPulling="2026-06-02 05:53:29.894944781 +0000 UTC m=+448.026825650" observedRunningTime="2026-06-02 05:53:30.016264554 +0000 UTC m=+448.148145444" watchObservedRunningTime="2026-06-02 05:53:30.018139108 +0000 UTC m=+448.150020000" Jun 02 05:53:32.968896 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:32.968863 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nbtpw" Jun 02 05:53:41.000131 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:41.000094 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" Jun 02 05:53:42.163115 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.163075 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lljk"] Jun 02 05:53:42.166931 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.166912 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lljk" Jun 02 05:53:42.179254 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.179226 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lljk"] Jun 02 05:53:42.251748 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.251693 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cbb70e6a-a45d-4c49-a6f5-49158eb4239e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-2lljk\" (UID: \"cbb70e6a-a45d-4c49-a6f5-49158eb4239e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lljk" Jun 02 05:53:42.251927 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.251846 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv4cx\" (UniqueName: \"kubernetes.io/projected/cbb70e6a-a45d-4c49-a6f5-49158eb4239e-kube-api-access-dv4cx\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-2lljk\" (UID: \"cbb70e6a-a45d-4c49-a6f5-49158eb4239e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lljk" Jun 02 05:53:42.254836 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.254807 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lljk"] Jun 02 05:53:42.255031 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:53:42.255009 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-dv4cx], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lljk" podUID="cbb70e6a-a45d-4c49-a6f5-49158eb4239e" Jun 02 05:53:42.289147 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.289112 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dnnbz"] Jun 02 05:53:42.292630 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.292609 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dnnbz" Jun 02 05:53:42.306002 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.305978 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dnnbz"] Jun 02 05:53:42.352641 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.352606 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g22f\" (UniqueName: \"kubernetes.io/projected/a8cb9db8-d86d-4702-a275-c3dc154b6566-kube-api-access-8g22f\") pod \"kuadrant-operator-controller-manager-84b657d985-dnnbz\" (UID: \"a8cb9db8-d86d-4702-a275-c3dc154b6566\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dnnbz" Jun 02 05:53:42.352641 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.352642 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8cb9db8-d86d-4702-a275-c3dc154b6566-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-dnnbz\" (UID: \"a8cb9db8-d86d-4702-a275-c3dc154b6566\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dnnbz" Jun 02 05:53:42.352907 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.352685 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dv4cx\" (UniqueName: \"kubernetes.io/projected/cbb70e6a-a45d-4c49-a6f5-49158eb4239e-kube-api-access-dv4cx\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-2lljk\" (UID: \"cbb70e6a-a45d-4c49-a6f5-49158eb4239e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lljk" Jun 02 05:53:42.352907 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.352751 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cbb70e6a-a45d-4c49-a6f5-49158eb4239e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-2lljk\" (UID: \"cbb70e6a-a45d-4c49-a6f5-49158eb4239e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lljk" Jun 02 05:53:42.353098 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.353080 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cbb70e6a-a45d-4c49-a6f5-49158eb4239e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-2lljk\" (UID: \"cbb70e6a-a45d-4c49-a6f5-49158eb4239e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lljk" Jun 02 05:53:42.362616 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.362590 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv4cx\" (UniqueName: \"kubernetes.io/projected/cbb70e6a-a45d-4c49-a6f5-49158eb4239e-kube-api-access-dv4cx\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-2lljk\" (UID: \"cbb70e6a-a45d-4c49-a6f5-49158eb4239e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lljk" Jun 02 05:53:42.454141 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.454044 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8g22f\" (UniqueName: \"kubernetes.io/projected/a8cb9db8-d86d-4702-a275-c3dc154b6566-kube-api-access-8g22f\") pod \"kuadrant-operator-controller-manager-84b657d985-dnnbz\" (UID: \"a8cb9db8-d86d-4702-a275-c3dc154b6566\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dnnbz" Jun 02 05:53:42.454141 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.454085 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8cb9db8-d86d-4702-a275-c3dc154b6566-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-dnnbz\" (UID: \"a8cb9db8-d86d-4702-a275-c3dc154b6566\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dnnbz" Jun 02 05:53:42.454461 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.454444 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8cb9db8-d86d-4702-a275-c3dc154b6566-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-dnnbz\" (UID: \"a8cb9db8-d86d-4702-a275-c3dc154b6566\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dnnbz" Jun 02 05:53:42.462287 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.462254 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g22f\" (UniqueName: \"kubernetes.io/projected/a8cb9db8-d86d-4702-a275-c3dc154b6566-kube-api-access-8g22f\") pod \"kuadrant-operator-controller-manager-84b657d985-dnnbz\" (UID: \"a8cb9db8-d86d-4702-a275-c3dc154b6566\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dnnbz" Jun 02 05:53:42.603557 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.603519 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dnnbz" Jun 02 05:53:42.714776 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.714678 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q"] Jun 02 05:53:42.714984 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.714956 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" podUID="0e34c9d2-be1e-45dd-942a-1d96caee121f" containerName="manager" containerID="cri-o://d77e58dc86c91b35a558b7c1abfb72c39c3d687c3ad81cac2f7fe296e0360b01" gracePeriod=2 Jun 02 05:53:42.727972 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.727940 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q"] Jun 02 05:53:42.736466 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.736439 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8mtx6"] Jun 02 05:53:42.736858 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.736845 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e34c9d2-be1e-45dd-942a-1d96caee121f" containerName="manager" Jun 02 05:53:42.736906 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.736861 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e34c9d2-be1e-45dd-942a-1d96caee121f" containerName="manager" Jun 02 05:53:42.736957 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.736945 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e34c9d2-be1e-45dd-942a-1d96caee121f" containerName="manager" Jun 02 05:53:42.740049 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.740032 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8mtx6" Jun 02 05:53:42.742357 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.742319 2575 status_manager.go:895] "Failed to get status for pod" podUID="0e34c9d2-be1e-45dd-942a-1d96caee121f" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lxk2q\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:42.744756 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.744615 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dnnbz"] Jun 02 05:53:42.746745 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.746694 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lljk"] Jun 02 05:53:42.754101 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.754075 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8mtx6"] Jun 02 05:53:42.755948 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.755923 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/443f5c33-df39-4d67-99f4-a72728da4e6b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8mtx6\" (UID: \"443f5c33-df39-4d67-99f4-a72728da4e6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8mtx6" Jun 02 05:53:42.756063 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.755973 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjj95\" (UniqueName: \"kubernetes.io/projected/443f5c33-df39-4d67-99f4-a72728da4e6b-kube-api-access-sjj95\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8mtx6\" (UID: \"443f5c33-df39-4d67-99f4-a72728da4e6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8mtx6" Jun 02 05:53:42.759977 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.759953 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lljk"] Jun 02 05:53:42.776569 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.776538 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dnnbz"] Jun 02 05:53:42.777641 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:53:42.777616 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8cb9db8_d86d_4702_a275_c3dc154b6566.slice/crio-946488e457f1b6dd3c0bb515c038fd59a3ea09dbb72498f4c390f0092de3a26c WatchSource:0}: Error finding container 946488e457f1b6dd3c0bb515c038fd59a3ea09dbb72498f4c390f0092de3a26c: Status 404 returned error can't find the container with id 946488e457f1b6dd3c0bb515c038fd59a3ea09dbb72498f4c390f0092de3a26c Jun 02 05:53:42.784757 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.784712 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dnnbz"] Jun 02 05:53:42.800940 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.800913 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8z9ns"] Jun 02 05:53:42.804617 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.804592 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8z9ns" Jun 02 05:53:42.806889 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.806863 2575 status_manager.go:895] "Failed to get status for pod" podUID="0e34c9d2-be1e-45dd-942a-1d96caee121f" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lxk2q\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:42.814848 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.814817 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8z9ns"] Jun 02 05:53:42.857077 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.857033 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-8z9ns\" (UID: \"bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8z9ns" Jun 02 05:53:42.857230 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.857092 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sjj95\" (UniqueName: \"kubernetes.io/projected/443f5c33-df39-4d67-99f4-a72728da4e6b-kube-api-access-sjj95\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8mtx6\" (UID: \"443f5c33-df39-4d67-99f4-a72728da4e6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8mtx6" Jun 02 05:53:42.857230 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.857150 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkd6n\" (UniqueName: \"kubernetes.io/projected/bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd-kube-api-access-bkd6n\") pod \"kuadrant-operator-controller-manager-84b657d985-8z9ns\" (UID: \"bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8z9ns" Jun 02 05:53:42.857335 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.857239 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/443f5c33-df39-4d67-99f4-a72728da4e6b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8mtx6\" (UID: \"443f5c33-df39-4d67-99f4-a72728da4e6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8mtx6" Jun 02 05:53:42.857659 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.857636 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/443f5c33-df39-4d67-99f4-a72728da4e6b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8mtx6\" (UID: \"443f5c33-df39-4d67-99f4-a72728da4e6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8mtx6" Jun 02 05:53:42.871115 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.871081 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjj95\" (UniqueName: \"kubernetes.io/projected/443f5c33-df39-4d67-99f4-a72728da4e6b-kube-api-access-sjj95\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8mtx6\" (UID: \"443f5c33-df39-4d67-99f4-a72728da4e6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8mtx6" Jun 02 05:53:42.952778 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.952754 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" Jun 02 05:53:42.954931 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.954906 2575 status_manager.go:895] "Failed to get status for pod" podUID="0e34c9d2-be1e-45dd-942a-1d96caee121f" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lxk2q\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:42.958238 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.958221 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e34c9d2-be1e-45dd-942a-1d96caee121f-extensions-socket-volume\") pod \"0e34c9d2-be1e-45dd-942a-1d96caee121f\" (UID: \"0e34c9d2-be1e-45dd-942a-1d96caee121f\") " Jun 02 05:53:42.958316 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.958305 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plkqn\" (UniqueName: \"kubernetes.io/projected/0e34c9d2-be1e-45dd-942a-1d96caee121f-kube-api-access-plkqn\") pod \"0e34c9d2-be1e-45dd-942a-1d96caee121f\" (UID: \"0e34c9d2-be1e-45dd-942a-1d96caee121f\") " Jun 02 05:53:42.958394 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.958381 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-8z9ns\" (UID: \"bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8z9ns" Jun 02 05:53:42.958440 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.958416 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bkd6n\" (UniqueName: \"kubernetes.io/projected/bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd-kube-api-access-bkd6n\") pod \"kuadrant-operator-controller-manager-84b657d985-8z9ns\" (UID: \"bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8z9ns" Jun 02 05:53:42.958782 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.958754 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e34c9d2-be1e-45dd-942a-1d96caee121f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0e34c9d2-be1e-45dd-942a-1d96caee121f" (UID: "0e34c9d2-be1e-45dd-942a-1d96caee121f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 05:53:42.958865 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.958802 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-8z9ns\" (UID: \"bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8z9ns" Jun 02 05:53:42.960386 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.960362 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e34c9d2-be1e-45dd-942a-1d96caee121f-kube-api-access-plkqn" (OuterVolumeSpecName: "kube-api-access-plkqn") pod "0e34c9d2-be1e-45dd-942a-1d96caee121f" (UID: "0e34c9d2-be1e-45dd-942a-1d96caee121f"). InnerVolumeSpecName "kube-api-access-plkqn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 05:53:42.966567 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:42.966515 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkd6n\" (UniqueName: \"kubernetes.io/projected/bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd-kube-api-access-bkd6n\") pod \"kuadrant-operator-controller-manager-84b657d985-8z9ns\" (UID: \"bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8z9ns" Jun 02 05:53:43.043887 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.043840 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dnnbz" podUID="a8cb9db8-d86d-4702-a275-c3dc154b6566" containerName="manager" containerID="cri-o://b8a2324a650f0a7c7981001f29d3d0c4f95f2419e55aa7836f13ce949c308c96" gracePeriod=2 Jun 02 05:53:43.045155 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.045126 2575 generic.go:358] "Generic (PLEG): container finished" podID="0e34c9d2-be1e-45dd-942a-1d96caee121f" containerID="d77e58dc86c91b35a558b7c1abfb72c39c3d687c3ad81cac2f7fe296e0360b01" exitCode=0 Jun 02 05:53:43.045285 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.045171 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" Jun 02 05:53:43.045285 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.045237 2575 scope.go:117] "RemoveContainer" containerID="d77e58dc86c91b35a558b7c1abfb72c39c3d687c3ad81cac2f7fe296e0360b01" Jun 02 05:53:43.045464 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.045394 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lljk" Jun 02 05:53:43.046633 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.046532 2575 status_manager.go:895] "Failed to get status for pod" podUID="a8cb9db8-d86d-4702-a275-c3dc154b6566" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dnnbz" err="pods \"kuadrant-operator-controller-manager-84b657d985-dnnbz\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:43.048424 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.048397 2575 status_manager.go:895] "Failed to get status for pod" podUID="0e34c9d2-be1e-45dd-942a-1d96caee121f" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lxk2q\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:43.050238 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.050216 2575 status_manager.go:895] "Failed to get status for pod" podUID="a8cb9db8-d86d-4702-a275-c3dc154b6566" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dnnbz" err="pods \"kuadrant-operator-controller-manager-84b657d985-dnnbz\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:43.052092 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.052068 2575 status_manager.go:895] "Failed to get status for pod" podUID="0e34c9d2-be1e-45dd-942a-1d96caee121f" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lxk2q\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:43.052979 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.052961 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lljk" Jun 02 05:53:43.053890 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.053867 2575 status_manager.go:895] "Failed to get status for pod" podUID="cbb70e6a-a45d-4c49-a6f5-49158eb4239e" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lljk" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-2lljk\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:43.054846 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.054812 2575 scope.go:117] "RemoveContainer" containerID="d77e58dc86c91b35a558b7c1abfb72c39c3d687c3ad81cac2f7fe296e0360b01" Jun 02 05:53:43.055141 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:53:43.055120 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d77e58dc86c91b35a558b7c1abfb72c39c3d687c3ad81cac2f7fe296e0360b01\": container with ID starting with d77e58dc86c91b35a558b7c1abfb72c39c3d687c3ad81cac2f7fe296e0360b01 not found: ID does not exist" containerID="d77e58dc86c91b35a558b7c1abfb72c39c3d687c3ad81cac2f7fe296e0360b01" Jun 02 05:53:43.055207 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.055150 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d77e58dc86c91b35a558b7c1abfb72c39c3d687c3ad81cac2f7fe296e0360b01"} err="failed to get container status \"d77e58dc86c91b35a558b7c1abfb72c39c3d687c3ad81cac2f7fe296e0360b01\": rpc error: code = NotFound desc = could not find container \"d77e58dc86c91b35a558b7c1abfb72c39c3d687c3ad81cac2f7fe296e0360b01\": container with ID starting with d77e58dc86c91b35a558b7c1abfb72c39c3d687c3ad81cac2f7fe296e0360b01 not found: ID does not exist" Jun 02 05:53:43.055796 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.055772 2575 status_manager.go:895] "Failed to get status for pod" podUID="a8cb9db8-d86d-4702-a275-c3dc154b6566" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dnnbz" err="pods \"kuadrant-operator-controller-manager-84b657d985-dnnbz\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:43.057537 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.057515 2575 status_manager.go:895] "Failed to get status for pod" podUID="0e34c9d2-be1e-45dd-942a-1d96caee121f" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lxk2q\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:43.058808 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.058791 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cbb70e6a-a45d-4c49-a6f5-49158eb4239e-extensions-socket-volume\") pod \"cbb70e6a-a45d-4c49-a6f5-49158eb4239e\" (UID: \"cbb70e6a-a45d-4c49-a6f5-49158eb4239e\") " Jun 02 05:53:43.058875 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.058843 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dv4cx\" (UniqueName: \"kubernetes.io/projected/cbb70e6a-a45d-4c49-a6f5-49158eb4239e-kube-api-access-dv4cx\") pod \"cbb70e6a-a45d-4c49-a6f5-49158eb4239e\" (UID: \"cbb70e6a-a45d-4c49-a6f5-49158eb4239e\") " Jun 02 05:53:43.059004 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.058992 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plkqn\" (UniqueName: \"kubernetes.io/projected/0e34c9d2-be1e-45dd-942a-1d96caee121f-kube-api-access-plkqn\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:53:43.059040 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.059007 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e34c9d2-be1e-45dd-942a-1d96caee121f-extensions-socket-volume\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:53:43.059040 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.059003 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbb70e6a-a45d-4c49-a6f5-49158eb4239e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cbb70e6a-a45d-4c49-a6f5-49158eb4239e" (UID: "cbb70e6a-a45d-4c49-a6f5-49158eb4239e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 05:53:43.059305 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.059285 2575 status_manager.go:895] "Failed to get status for pod" podUID="cbb70e6a-a45d-4c49-a6f5-49158eb4239e" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lljk" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-2lljk\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:43.060685 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.060667 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbb70e6a-a45d-4c49-a6f5-49158eb4239e-kube-api-access-dv4cx" (OuterVolumeSpecName: "kube-api-access-dv4cx") pod "cbb70e6a-a45d-4c49-a6f5-49158eb4239e" (UID: "cbb70e6a-a45d-4c49-a6f5-49158eb4239e"). InnerVolumeSpecName "kube-api-access-dv4cx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 05:53:43.060964 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.060940 2575 status_manager.go:895] "Failed to get status for pod" podUID="0e34c9d2-be1e-45dd-942a-1d96caee121f" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lxk2q\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:43.062913 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.062893 2575 status_manager.go:895] "Failed to get status for pod" podUID="cbb70e6a-a45d-4c49-a6f5-49158eb4239e" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lljk" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-2lljk\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:43.064610 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.064591 2575 status_manager.go:895] "Failed to get status for pod" podUID="a8cb9db8-d86d-4702-a275-c3dc154b6566" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dnnbz" err="pods \"kuadrant-operator-controller-manager-84b657d985-dnnbz\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:43.116883 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.116850 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8mtx6" Jun 02 05:53:43.126704 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.126677 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8z9ns" Jun 02 05:53:43.159475 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.159441 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dv4cx\" (UniqueName: \"kubernetes.io/projected/cbb70e6a-a45d-4c49-a6f5-49158eb4239e-kube-api-access-dv4cx\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:53:43.159475 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.159470 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cbb70e6a-a45d-4c49-a6f5-49158eb4239e-extensions-socket-volume\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:53:43.274621 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.274589 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8mtx6"] Jun 02 05:53:43.277527 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:53:43.277495 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod443f5c33_df39_4d67_99f4_a72728da4e6b.slice/crio-494fefbddb1b7553ff73fb4a7d31b01155b3093df575e0c3e293f9757ae6f51d WatchSource:0}: Error finding container 494fefbddb1b7553ff73fb4a7d31b01155b3093df575e0c3e293f9757ae6f51d: Status 404 returned error can't find the container with id 494fefbddb1b7553ff73fb4a7d31b01155b3093df575e0c3e293f9757ae6f51d Jun 02 05:53:43.290359 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.290333 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8z9ns"] Jun 02 05:53:43.292107 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:53:43.292077 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdeb2bd5_3b57_46e0_b475_cb1f8c61f5dd.slice/crio-4c916fc1a0431311b3d3e3b92bb82fc1b2705f4c37b06ce818ab5b576455185a WatchSource:0}: Error finding container 4c916fc1a0431311b3d3e3b92bb82fc1b2705f4c37b06ce818ab5b576455185a: Status 404 returned error can't find the container with id 4c916fc1a0431311b3d3e3b92bb82fc1b2705f4c37b06ce818ab5b576455185a Jun 02 05:53:43.295264 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.295240 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dnnbz" Jun 02 05:53:43.297296 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.297268 2575 status_manager.go:895] "Failed to get status for pod" podUID="0e34c9d2-be1e-45dd-942a-1d96caee121f" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lxk2q\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:43.299118 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.299090 2575 status_manager.go:895] "Failed to get status for pod" podUID="cbb70e6a-a45d-4c49-a6f5-49158eb4239e" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lljk" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-2lljk\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:43.300881 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.300857 2575 status_manager.go:895] "Failed to get status for pod" podUID="a8cb9db8-d86d-4702-a275-c3dc154b6566" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dnnbz" err="pods \"kuadrant-operator-controller-manager-84b657d985-dnnbz\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:43.364508 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.361409 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8cb9db8-d86d-4702-a275-c3dc154b6566-extensions-socket-volume\") pod \"a8cb9db8-d86d-4702-a275-c3dc154b6566\" (UID: \"a8cb9db8-d86d-4702-a275-c3dc154b6566\") " Jun 02 05:53:43.364508 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.361516 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8g22f\" (UniqueName: \"kubernetes.io/projected/a8cb9db8-d86d-4702-a275-c3dc154b6566-kube-api-access-8g22f\") pod \"a8cb9db8-d86d-4702-a275-c3dc154b6566\" (UID: \"a8cb9db8-d86d-4702-a275-c3dc154b6566\") " Jun 02 05:53:43.364508 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.362669 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8cb9db8-d86d-4702-a275-c3dc154b6566-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a8cb9db8-d86d-4702-a275-c3dc154b6566" (UID: "a8cb9db8-d86d-4702-a275-c3dc154b6566"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 05:53:43.364508 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.364967 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8cb9db8-d86d-4702-a275-c3dc154b6566-kube-api-access-8g22f" (OuterVolumeSpecName: "kube-api-access-8g22f") pod "a8cb9db8-d86d-4702-a275-c3dc154b6566" (UID: "a8cb9db8-d86d-4702-a275-c3dc154b6566"). InnerVolumeSpecName "kube-api-access-8g22f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 05:53:43.463088 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.463048 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8cb9db8-d86d-4702-a275-c3dc154b6566-extensions-socket-volume\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:53:43.463088 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:43.463078 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8g22f\" (UniqueName: \"kubernetes.io/projected/a8cb9db8-d86d-4702-a275-c3dc154b6566-kube-api-access-8g22f\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:53:44.052152 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.052112 2575 generic.go:358] "Generic (PLEG): container finished" podID="a8cb9db8-d86d-4702-a275-c3dc154b6566" containerID="b8a2324a650f0a7c7981001f29d3d0c4f95f2419e55aa7836f13ce949c308c96" exitCode=2 Jun 02 05:53:44.052335 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.052185 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dnnbz" Jun 02 05:53:44.052335 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.052215 2575 scope.go:117] "RemoveContainer" containerID="b8a2324a650f0a7c7981001f29d3d0c4f95f2419e55aa7836f13ce949c308c96" Jun 02 05:53:44.054683 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.054648 2575 status_manager.go:895] "Failed to get status for pod" podUID="a8cb9db8-d86d-4702-a275-c3dc154b6566" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dnnbz" err="pods \"kuadrant-operator-controller-manager-84b657d985-dnnbz\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:44.054961 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.054817 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8mtx6" event={"ID":"443f5c33-df39-4d67-99f4-a72728da4e6b","Type":"ContainerStarted","Data":"549ee8d94278d151eb1b5249fd8c9db91331d09a2e45d711e07e84395957c467"} Jun 02 05:53:44.054961 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.054958 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8mtx6" Jun 02 05:53:44.055118 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.054973 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8mtx6" event={"ID":"443f5c33-df39-4d67-99f4-a72728da4e6b","Type":"ContainerStarted","Data":"494fefbddb1b7553ff73fb4a7d31b01155b3093df575e0c3e293f9757ae6f51d"} Jun 02 05:53:44.056320 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.056303 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lljk" Jun 02 05:53:44.056417 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.056316 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8z9ns" event={"ID":"bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd","Type":"ContainerStarted","Data":"914313fe8fcf22a093cfcb33b901cdb46debfb23acc6ab2e391e9cca44921dd5"} Jun 02 05:53:44.056417 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.056341 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8z9ns" event={"ID":"bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd","Type":"ContainerStarted","Data":"4c916fc1a0431311b3d3e3b92bb82fc1b2705f4c37b06ce818ab5b576455185a"} Jun 02 05:53:44.056417 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.056382 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8z9ns" Jun 02 05:53:44.057008 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.056985 2575 status_manager.go:895] "Failed to get status for pod" podUID="0e34c9d2-be1e-45dd-942a-1d96caee121f" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lxk2q\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:44.058926 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.058903 2575 status_manager.go:895] "Failed to get status for pod" podUID="cbb70e6a-a45d-4c49-a6f5-49158eb4239e" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lljk" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-2lljk\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:44.060926 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.060892 2575 status_manager.go:895] "Failed to get status for pod" podUID="a8cb9db8-d86d-4702-a275-c3dc154b6566" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dnnbz" err="pods \"kuadrant-operator-controller-manager-84b657d985-dnnbz\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:44.062977 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.062950 2575 scope.go:117] "RemoveContainer" containerID="b8a2324a650f0a7c7981001f29d3d0c4f95f2419e55aa7836f13ce949c308c96" Jun 02 05:53:44.063412 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:53:44.063277 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8a2324a650f0a7c7981001f29d3d0c4f95f2419e55aa7836f13ce949c308c96\": container with ID starting with b8a2324a650f0a7c7981001f29d3d0c4f95f2419e55aa7836f13ce949c308c96 not found: ID does not exist" containerID="b8a2324a650f0a7c7981001f29d3d0c4f95f2419e55aa7836f13ce949c308c96" Jun 02 05:53:44.063412 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.063312 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8a2324a650f0a7c7981001f29d3d0c4f95f2419e55aa7836f13ce949c308c96"} err="failed to get container status \"b8a2324a650f0a7c7981001f29d3d0c4f95f2419e55aa7836f13ce949c308c96\": rpc error: code = NotFound desc = could not find container \"b8a2324a650f0a7c7981001f29d3d0c4f95f2419e55aa7836f13ce949c308c96\": container with ID starting with b8a2324a650f0a7c7981001f29d3d0c4f95f2419e55aa7836f13ce949c308c96 not found: ID does not exist" Jun 02 05:53:44.083776 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.083709 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8z9ns" podStartSLOduration=2.083690881 podStartE2EDuration="2.083690881s" podCreationTimestamp="2026-06-02 05:53:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 05:53:44.081787632 +0000 UTC m=+462.213668520" watchObservedRunningTime="2026-06-02 05:53:44.083690881 +0000 UTC m=+462.215571774" Jun 02 05:53:44.083916 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.083836 2575 status_manager.go:895] "Failed to get status for pod" podUID="0e34c9d2-be1e-45dd-942a-1d96caee121f" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lxk2q\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:44.085814 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.085793 2575 status_manager.go:895] "Failed to get status for pod" podUID="cbb70e6a-a45d-4c49-a6f5-49158eb4239e" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lljk" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-2lljk\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:44.108452 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.108402 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8mtx6" podStartSLOduration=2.108387835 podStartE2EDuration="2.108387835s" podCreationTimestamp="2026-06-02 05:53:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 05:53:44.107457054 +0000 UTC m=+462.239337945" watchObservedRunningTime="2026-06-02 05:53:44.108387835 +0000 UTC m=+462.240268725" Jun 02 05:53:44.109609 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.109585 2575 status_manager.go:895] "Failed to get status for pod" podUID="0e34c9d2-be1e-45dd-942a-1d96caee121f" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lxk2q" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lxk2q\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:44.111412 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.111388 2575 status_manager.go:895] "Failed to get status for pod" podUID="cbb70e6a-a45d-4c49-a6f5-49158eb4239e" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lljk" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-2lljk\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:44.113185 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.113164 2575 status_manager.go:895] "Failed to get status for pod" podUID="a8cb9db8-d86d-4702-a275-c3dc154b6566" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dnnbz" err="pods \"kuadrant-operator-controller-manager-84b657d985-dnnbz\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" Jun 02 05:53:44.354375 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.354293 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e34c9d2-be1e-45dd-942a-1d96caee121f" path="/var/lib/kubelet/pods/0e34c9d2-be1e-45dd-942a-1d96caee121f/volumes" Jun 02 05:53:44.354748 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.354650 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8cb9db8-d86d-4702-a275-c3dc154b6566" path="/var/lib/kubelet/pods/a8cb9db8-d86d-4702-a275-c3dc154b6566/volumes" Jun 02 05:53:44.354986 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:44.354972 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbb70e6a-a45d-4c49-a6f5-49158eb4239e" path="/var/lib/kubelet/pods/cbb70e6a-a45d-4c49-a6f5-49158eb4239e/volumes" Jun 02 05:53:55.062314 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.062279 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8mtx6" Jun 02 05:53:55.062823 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.062333 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8z9ns" Jun 02 05:53:55.127093 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.127060 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8mtx6"] Jun 02 05:53:55.127287 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.127265 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8mtx6" podUID="443f5c33-df39-4d67-99f4-a72728da4e6b" containerName="manager" containerID="cri-o://549ee8d94278d151eb1b5249fd8c9db91331d09a2e45d711e07e84395957c467" gracePeriod=10 Jun 02 05:53:55.375355 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.375332 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8mtx6" Jun 02 05:53:55.441612 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.441567 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5zcn8"] Jun 02 05:53:55.442161 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.442140 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="443f5c33-df39-4d67-99f4-a72728da4e6b" containerName="manager" Jun 02 05:53:55.442245 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.442165 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="443f5c33-df39-4d67-99f4-a72728da4e6b" containerName="manager" Jun 02 05:53:55.442245 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.442200 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8cb9db8-d86d-4702-a275-c3dc154b6566" containerName="manager" Jun 02 05:53:55.442245 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.442208 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8cb9db8-d86d-4702-a275-c3dc154b6566" containerName="manager" Jun 02 05:53:55.442349 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.442283 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="a8cb9db8-d86d-4702-a275-c3dc154b6566" containerName="manager" Jun 02 05:53:55.442349 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.442296 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="443f5c33-df39-4d67-99f4-a72728da4e6b" containerName="manager" Jun 02 05:53:55.446045 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.446028 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5zcn8" Jun 02 05:53:55.472534 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.472505 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5zcn8"] Jun 02 05:53:55.472758 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.472740 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjj95\" (UniqueName: \"kubernetes.io/projected/443f5c33-df39-4d67-99f4-a72728da4e6b-kube-api-access-sjj95\") pod \"443f5c33-df39-4d67-99f4-a72728da4e6b\" (UID: \"443f5c33-df39-4d67-99f4-a72728da4e6b\") " Jun 02 05:53:55.472885 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.472866 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/443f5c33-df39-4d67-99f4-a72728da4e6b-extensions-socket-volume\") pod \"443f5c33-df39-4d67-99f4-a72728da4e6b\" (UID: \"443f5c33-df39-4d67-99f4-a72728da4e6b\") " Jun 02 05:53:55.473258 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.473234 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/443f5c33-df39-4d67-99f4-a72728da4e6b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "443f5c33-df39-4d67-99f4-a72728da4e6b" (UID: "443f5c33-df39-4d67-99f4-a72728da4e6b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 05:53:55.474835 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.474804 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/443f5c33-df39-4d67-99f4-a72728da4e6b-kube-api-access-sjj95" (OuterVolumeSpecName: "kube-api-access-sjj95") pod "443f5c33-df39-4d67-99f4-a72728da4e6b" (UID: "443f5c33-df39-4d67-99f4-a72728da4e6b"). InnerVolumeSpecName "kube-api-access-sjj95". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 05:53:55.574283 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.574243 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8eb4d682-ea2f-4921-8db1-4a21868e214b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-5zcn8\" (UID: \"8eb4d682-ea2f-4921-8db1-4a21868e214b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5zcn8" Jun 02 05:53:55.574283 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.574295 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq4lk\" (UniqueName: \"kubernetes.io/projected/8eb4d682-ea2f-4921-8db1-4a21868e214b-kube-api-access-hq4lk\") pod \"kuadrant-operator-controller-manager-55c7f4c975-5zcn8\" (UID: \"8eb4d682-ea2f-4921-8db1-4a21868e214b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5zcn8" Jun 02 05:53:55.574515 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.574325 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/443f5c33-df39-4d67-99f4-a72728da4e6b-extensions-socket-volume\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:53:55.574515 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.574336 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjj95\" (UniqueName: \"kubernetes.io/projected/443f5c33-df39-4d67-99f4-a72728da4e6b-kube-api-access-sjj95\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:53:55.675855 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.675753 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8eb4d682-ea2f-4921-8db1-4a21868e214b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-5zcn8\" (UID: \"8eb4d682-ea2f-4921-8db1-4a21868e214b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5zcn8" Jun 02 05:53:55.675855 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.675813 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hq4lk\" (UniqueName: \"kubernetes.io/projected/8eb4d682-ea2f-4921-8db1-4a21868e214b-kube-api-access-hq4lk\") pod \"kuadrant-operator-controller-manager-55c7f4c975-5zcn8\" (UID: \"8eb4d682-ea2f-4921-8db1-4a21868e214b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5zcn8" Jun 02 05:53:55.676157 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.676131 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8eb4d682-ea2f-4921-8db1-4a21868e214b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-5zcn8\" (UID: \"8eb4d682-ea2f-4921-8db1-4a21868e214b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5zcn8" Jun 02 05:53:55.684932 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.684907 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq4lk\" (UniqueName: \"kubernetes.io/projected/8eb4d682-ea2f-4921-8db1-4a21868e214b-kube-api-access-hq4lk\") pod \"kuadrant-operator-controller-manager-55c7f4c975-5zcn8\" (UID: \"8eb4d682-ea2f-4921-8db1-4a21868e214b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5zcn8" Jun 02 05:53:55.756605 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.756568 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5zcn8" Jun 02 05:53:55.898696 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:55.898668 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5zcn8"] Jun 02 05:53:55.900817 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:53:55.900787 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eb4d682_ea2f_4921_8db1_4a21868e214b.slice/crio-794f0cbb469c8c93932ff3856293b9214b89674be828db4343c382e1687068b3 WatchSource:0}: Error finding container 794f0cbb469c8c93932ff3856293b9214b89674be828db4343c382e1687068b3: Status 404 returned error can't find the container with id 794f0cbb469c8c93932ff3856293b9214b89674be828db4343c382e1687068b3 Jun 02 05:53:56.102590 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:56.102533 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5zcn8" event={"ID":"8eb4d682-ea2f-4921-8db1-4a21868e214b","Type":"ContainerStarted","Data":"097966d226043ad5923d373005ff33212eac95b23fc34f241a04cada00c3b6f7"} Jun 02 05:53:56.102590 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:56.102585 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5zcn8" event={"ID":"8eb4d682-ea2f-4921-8db1-4a21868e214b","Type":"ContainerStarted","Data":"794f0cbb469c8c93932ff3856293b9214b89674be828db4343c382e1687068b3"} Jun 02 05:53:56.103146 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:56.102625 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5zcn8" Jun 02 05:53:56.103774 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:56.103754 2575 generic.go:358] "Generic (PLEG): container finished" podID="443f5c33-df39-4d67-99f4-a72728da4e6b" containerID="549ee8d94278d151eb1b5249fd8c9db91331d09a2e45d711e07e84395957c467" exitCode=0 Jun 02 05:53:56.103886 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:56.103794 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8mtx6" event={"ID":"443f5c33-df39-4d67-99f4-a72728da4e6b","Type":"ContainerDied","Data":"549ee8d94278d151eb1b5249fd8c9db91331d09a2e45d711e07e84395957c467"} Jun 02 05:53:56.103886 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:56.103810 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8mtx6" event={"ID":"443f5c33-df39-4d67-99f4-a72728da4e6b","Type":"ContainerDied","Data":"494fefbddb1b7553ff73fb4a7d31b01155b3093df575e0c3e293f9757ae6f51d"} Jun 02 05:53:56.103886 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:56.103826 2575 scope.go:117] "RemoveContainer" containerID="549ee8d94278d151eb1b5249fd8c9db91331d09a2e45d711e07e84395957c467" Jun 02 05:53:56.103886 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:56.103860 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8mtx6" Jun 02 05:53:56.113137 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:56.113107 2575 scope.go:117] "RemoveContainer" containerID="549ee8d94278d151eb1b5249fd8c9db91331d09a2e45d711e07e84395957c467" Jun 02 05:53:56.113496 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:53:56.113475 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"549ee8d94278d151eb1b5249fd8c9db91331d09a2e45d711e07e84395957c467\": container with ID starting with 549ee8d94278d151eb1b5249fd8c9db91331d09a2e45d711e07e84395957c467 not found: ID does not exist" containerID="549ee8d94278d151eb1b5249fd8c9db91331d09a2e45d711e07e84395957c467" Jun 02 05:53:56.113553 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:56.113503 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"549ee8d94278d151eb1b5249fd8c9db91331d09a2e45d711e07e84395957c467"} err="failed to get container status \"549ee8d94278d151eb1b5249fd8c9db91331d09a2e45d711e07e84395957c467\": rpc error: code = NotFound desc = could not find container \"549ee8d94278d151eb1b5249fd8c9db91331d09a2e45d711e07e84395957c467\": container with ID starting with 549ee8d94278d151eb1b5249fd8c9db91331d09a2e45d711e07e84395957c467 not found: ID does not exist" Jun 02 05:53:56.124892 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:56.124850 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5zcn8" podStartSLOduration=1.124837688 podStartE2EDuration="1.124837688s" podCreationTimestamp="2026-06-02 05:53:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 05:53:56.122678589 +0000 UTC m=+474.254559494" watchObservedRunningTime="2026-06-02 05:53:56.124837688 +0000 UTC m=+474.256718634" Jun 02 05:53:56.136521 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:56.136497 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8mtx6"] Jun 02 05:53:56.143020 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:56.142997 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8mtx6"] Jun 02 05:53:56.354547 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:53:56.354505 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="443f5c33-df39-4d67-99f4-a72728da4e6b" path="/var/lib/kubelet/pods/443f5c33-df39-4d67-99f4-a72728da4e6b/volumes" Jun 02 05:54:07.111703 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:07.111671 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5zcn8" Jun 02 05:54:07.159525 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:07.159487 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8z9ns"] Jun 02 05:54:07.159788 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:07.159762 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8z9ns" podUID="bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd" containerName="manager" containerID="cri-o://914313fe8fcf22a093cfcb33b901cdb46debfb23acc6ab2e391e9cca44921dd5" gracePeriod=10 Jun 02 05:54:07.401818 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:07.401794 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8z9ns" Jun 02 05:54:07.484885 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:07.484829 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd-extensions-socket-volume\") pod \"bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd\" (UID: \"bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd\") " Jun 02 05:54:07.484885 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:07.484894 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkd6n\" (UniqueName: \"kubernetes.io/projected/bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd-kube-api-access-bkd6n\") pod \"bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd\" (UID: \"bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd\") " Jun 02 05:54:07.485219 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:07.485196 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd" (UID: "bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 05:54:07.487008 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:07.486982 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd-kube-api-access-bkd6n" (OuterVolumeSpecName: "kube-api-access-bkd6n") pod "bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd" (UID: "bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd"). InnerVolumeSpecName "kube-api-access-bkd6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 05:54:07.586020 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:07.585958 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd-extensions-socket-volume\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:54:07.586020 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:07.586013 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkd6n\" (UniqueName: \"kubernetes.io/projected/bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd-kube-api-access-bkd6n\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:54:08.152204 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:08.152170 2575 generic.go:358] "Generic (PLEG): container finished" podID="bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd" containerID="914313fe8fcf22a093cfcb33b901cdb46debfb23acc6ab2e391e9cca44921dd5" exitCode=0 Jun 02 05:54:08.152619 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:08.152236 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8z9ns" Jun 02 05:54:08.152619 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:08.152254 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8z9ns" event={"ID":"bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd","Type":"ContainerDied","Data":"914313fe8fcf22a093cfcb33b901cdb46debfb23acc6ab2e391e9cca44921dd5"} Jun 02 05:54:08.152619 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:08.152289 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8z9ns" event={"ID":"bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd","Type":"ContainerDied","Data":"4c916fc1a0431311b3d3e3b92bb82fc1b2705f4c37b06ce818ab5b576455185a"} Jun 02 05:54:08.152619 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:08.152304 2575 scope.go:117] "RemoveContainer" containerID="914313fe8fcf22a093cfcb33b901cdb46debfb23acc6ab2e391e9cca44921dd5" Jun 02 05:54:08.161689 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:08.161571 2575 scope.go:117] "RemoveContainer" containerID="914313fe8fcf22a093cfcb33b901cdb46debfb23acc6ab2e391e9cca44921dd5" Jun 02 05:54:08.161916 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:54:08.161897 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"914313fe8fcf22a093cfcb33b901cdb46debfb23acc6ab2e391e9cca44921dd5\": container with ID starting with 914313fe8fcf22a093cfcb33b901cdb46debfb23acc6ab2e391e9cca44921dd5 not found: ID does not exist" containerID="914313fe8fcf22a093cfcb33b901cdb46debfb23acc6ab2e391e9cca44921dd5" Jun 02 05:54:08.161960 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:08.161925 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"914313fe8fcf22a093cfcb33b901cdb46debfb23acc6ab2e391e9cca44921dd5"} err="failed to get container status \"914313fe8fcf22a093cfcb33b901cdb46debfb23acc6ab2e391e9cca44921dd5\": rpc error: code = NotFound desc = could not find container \"914313fe8fcf22a093cfcb33b901cdb46debfb23acc6ab2e391e9cca44921dd5\": container with ID starting with 914313fe8fcf22a093cfcb33b901cdb46debfb23acc6ab2e391e9cca44921dd5 not found: ID does not exist" Jun 02 05:54:08.174375 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:08.174168 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8z9ns"] Jun 02 05:54:08.180005 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:08.179977 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-8z9ns"] Jun 02 05:54:08.354444 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:08.354404 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd" path="/var/lib/kubelet/pods/bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd/volumes" Jun 02 05:54:26.202781 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.202743 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dpr6w"] Jun 02 05:54:26.203306 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.203272 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd" containerName="manager" Jun 02 05:54:26.203306 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.203291 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd" containerName="manager" Jun 02 05:54:26.203427 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.203399 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="bdeb2bd5-3b57-46e0-b475-cb1f8c61f5dd" containerName="manager" Jun 02 05:54:26.206240 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.206215 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-dpr6w" Jun 02 05:54:26.208533 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.208515 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rk4mv\"" Jun 02 05:54:26.208618 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.208515 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 05:54:26.212248 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.212222 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dpr6w"] Jun 02 05:54:26.235578 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.235544 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dpr6w"] Jun 02 05:54:26.248575 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.248545 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5rjd\" (UniqueName: \"kubernetes.io/projected/68ae814d-d9a1-4725-9909-c7b70a423e33-kube-api-access-l5rjd\") pod \"limitador-limitador-78c99df468-dpr6w\" (UID: \"68ae814d-d9a1-4725-9909-c7b70a423e33\") " pod="kuadrant-system/limitador-limitador-78c99df468-dpr6w" Jun 02 05:54:26.248767 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.248582 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/68ae814d-d9a1-4725-9909-c7b70a423e33-config-file\") pod \"limitador-limitador-78c99df468-dpr6w\" (UID: \"68ae814d-d9a1-4725-9909-c7b70a423e33\") " pod="kuadrant-system/limitador-limitador-78c99df468-dpr6w" Jun 02 05:54:26.350034 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.349982 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5rjd\" (UniqueName: \"kubernetes.io/projected/68ae814d-d9a1-4725-9909-c7b70a423e33-kube-api-access-l5rjd\") pod \"limitador-limitador-78c99df468-dpr6w\" (UID: \"68ae814d-d9a1-4725-9909-c7b70a423e33\") " pod="kuadrant-system/limitador-limitador-78c99df468-dpr6w" Jun 02 05:54:26.350034 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.350034 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/68ae814d-d9a1-4725-9909-c7b70a423e33-config-file\") pod \"limitador-limitador-78c99df468-dpr6w\" (UID: \"68ae814d-d9a1-4725-9909-c7b70a423e33\") " pod="kuadrant-system/limitador-limitador-78c99df468-dpr6w" Jun 02 05:54:26.350613 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.350589 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/68ae814d-d9a1-4725-9909-c7b70a423e33-config-file\") pod \"limitador-limitador-78c99df468-dpr6w\" (UID: \"68ae814d-d9a1-4725-9909-c7b70a423e33\") " pod="kuadrant-system/limitador-limitador-78c99df468-dpr6w" Jun 02 05:54:26.358184 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.358160 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5rjd\" (UniqueName: \"kubernetes.io/projected/68ae814d-d9a1-4725-9909-c7b70a423e33-kube-api-access-l5rjd\") pod \"limitador-limitador-78c99df468-dpr6w\" (UID: \"68ae814d-d9a1-4725-9909-c7b70a423e33\") " pod="kuadrant-system/limitador-limitador-78c99df468-dpr6w" Jun 02 05:54:26.518012 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.517903 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-dpr6w" Jun 02 05:54:26.614198 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.614166 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-skvfv"] Jun 02 05:54:26.619608 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.619581 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-skvfv" Jun 02 05:54:26.619792 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.619657 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-skvfv"] Jun 02 05:54:26.622319 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.622294 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2fhxv\"" Jun 02 05:54:26.653039 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.653005 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltrdr\" (UniqueName: \"kubernetes.io/projected/a185f9de-ad4c-42f2-9b0d-4c0433df240e-kube-api-access-ltrdr\") pod \"authorino-f99f4b5cd-skvfv\" (UID: \"a185f9de-ad4c-42f2-9b0d-4c0433df240e\") " pod="kuadrant-system/authorino-f99f4b5cd-skvfv" Jun 02 05:54:26.655303 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.655282 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dpr6w"] Jun 02 05:54:26.657634 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:54:26.657606 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68ae814d_d9a1_4725_9909_c7b70a423e33.slice/crio-e2b41c5c1a0355d53019259adfb685f55aa36e9c68dc3f5cb7a9844040172c91 WatchSource:0}: Error finding container e2b41c5c1a0355d53019259adfb685f55aa36e9c68dc3f5cb7a9844040172c91: Status 404 returned error can't find the container with id e2b41c5c1a0355d53019259adfb685f55aa36e9c68dc3f5cb7a9844040172c91 Jun 02 05:54:26.754201 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.754158 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ltrdr\" (UniqueName: \"kubernetes.io/projected/a185f9de-ad4c-42f2-9b0d-4c0433df240e-kube-api-access-ltrdr\") pod \"authorino-f99f4b5cd-skvfv\" (UID: \"a185f9de-ad4c-42f2-9b0d-4c0433df240e\") " pod="kuadrant-system/authorino-f99f4b5cd-skvfv" Jun 02 05:54:26.762328 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.762303 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltrdr\" (UniqueName: \"kubernetes.io/projected/a185f9de-ad4c-42f2-9b0d-4c0433df240e-kube-api-access-ltrdr\") pod \"authorino-f99f4b5cd-skvfv\" (UID: \"a185f9de-ad4c-42f2-9b0d-4c0433df240e\") " pod="kuadrant-system/authorino-f99f4b5cd-skvfv" Jun 02 05:54:26.818297 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.818261 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-c5ll2"] Jun 02 05:54:26.821844 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.821823 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-c5ll2" Jun 02 05:54:26.827709 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.827682 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-c5ll2"] Jun 02 05:54:26.854974 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.854941 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcmlq\" (UniqueName: \"kubernetes.io/projected/d37ad4e7-6923-4822-ba91-b5a38e9435e2-kube-api-access-zcmlq\") pod \"authorino-7498df8756-c5ll2\" (UID: \"d37ad4e7-6923-4822-ba91-b5a38e9435e2\") " pod="kuadrant-system/authorino-7498df8756-c5ll2" Jun 02 05:54:26.940842 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.940801 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-skvfv" Jun 02 05:54:26.956058 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.956026 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zcmlq\" (UniqueName: \"kubernetes.io/projected/d37ad4e7-6923-4822-ba91-b5a38e9435e2-kube-api-access-zcmlq\") pod \"authorino-7498df8756-c5ll2\" (UID: \"d37ad4e7-6923-4822-ba91-b5a38e9435e2\") " pod="kuadrant-system/authorino-7498df8756-c5ll2" Jun 02 05:54:26.964647 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:26.964622 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcmlq\" (UniqueName: \"kubernetes.io/projected/d37ad4e7-6923-4822-ba91-b5a38e9435e2-kube-api-access-zcmlq\") pod \"authorino-7498df8756-c5ll2\" (UID: \"d37ad4e7-6923-4822-ba91-b5a38e9435e2\") " pod="kuadrant-system/authorino-7498df8756-c5ll2" Jun 02 05:54:27.067283 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:27.067254 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-skvfv"] Jun 02 05:54:27.069451 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:54:27.069391 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda185f9de_ad4c_42f2_9b0d_4c0433df240e.slice/crio-a870900a6fc6a0b5ed555ec6d082bb067aea2bd8c1583759154a2363799ea62d WatchSource:0}: Error finding container a870900a6fc6a0b5ed555ec6d082bb067aea2bd8c1583759154a2363799ea62d: Status 404 returned error can't find the container with id a870900a6fc6a0b5ed555ec6d082bb067aea2bd8c1583759154a2363799ea62d Jun 02 05:54:27.132512 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:27.132473 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-c5ll2" Jun 02 05:54:27.232348 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:27.232289 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-dpr6w" event={"ID":"68ae814d-d9a1-4725-9909-c7b70a423e33","Type":"ContainerStarted","Data":"e2b41c5c1a0355d53019259adfb685f55aa36e9c68dc3f5cb7a9844040172c91"} Jun 02 05:54:27.233790 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:27.233759 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-skvfv" event={"ID":"a185f9de-ad4c-42f2-9b0d-4c0433df240e","Type":"ContainerStarted","Data":"a870900a6fc6a0b5ed555ec6d082bb067aea2bd8c1583759154a2363799ea62d"} Jun 02 05:54:27.307460 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:27.307363 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-c5ll2"] Jun 02 05:54:27.312570 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:54:27.312539 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd37ad4e7_6923_4822_ba91_b5a38e9435e2.slice/crio-fd7a0f695e0e17e1ac36735d770e4720b169d0d326a4b21178cdbaf61c10cc7a WatchSource:0}: Error finding container fd7a0f695e0e17e1ac36735d770e4720b169d0d326a4b21178cdbaf61c10cc7a: Status 404 returned error can't find the container with id fd7a0f695e0e17e1ac36735d770e4720b169d0d326a4b21178cdbaf61c10cc7a Jun 02 05:54:28.257851 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:28.257808 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-c5ll2" event={"ID":"d37ad4e7-6923-4822-ba91-b5a38e9435e2","Type":"ContainerStarted","Data":"fd7a0f695e0e17e1ac36735d770e4720b169d0d326a4b21178cdbaf61c10cc7a"} Jun 02 05:54:32.276302 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:32.276264 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-skvfv" event={"ID":"a185f9de-ad4c-42f2-9b0d-4c0433df240e","Type":"ContainerStarted","Data":"abf9a2161fb1bc469b6c3d8f810d6d34ab7d481fcd8e2b635256fb72fd8303a0"} Jun 02 05:54:32.277693 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:32.277663 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-c5ll2" event={"ID":"d37ad4e7-6923-4822-ba91-b5a38e9435e2","Type":"ContainerStarted","Data":"dbeaed43f0d85c926109d05760ea03c5876e47fbd8abb810d1b7b67340013f0f"} Jun 02 05:54:32.279052 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:32.279030 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-dpr6w" event={"ID":"68ae814d-d9a1-4725-9909-c7b70a423e33","Type":"ContainerStarted","Data":"7757a534aaf419758aba16e1604d8bb3b91fd100f47731747e6cf6fa682beae0"} Jun 02 05:54:32.279170 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:32.279148 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-dpr6w" Jun 02 05:54:32.294028 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:32.293973 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-skvfv" podStartSLOduration=1.766264916 podStartE2EDuration="6.293959502s" podCreationTimestamp="2026-06-02 05:54:26 +0000 UTC" firstStartedPulling="2026-06-02 05:54:27.070770392 +0000 UTC m=+505.202651264" lastFinishedPulling="2026-06-02 05:54:31.598464977 +0000 UTC m=+509.730345850" observedRunningTime="2026-06-02 05:54:32.291971448 +0000 UTC m=+510.423852340" watchObservedRunningTime="2026-06-02 05:54:32.293959502 +0000 UTC m=+510.425840392" Jun 02 05:54:32.309609 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:32.309550 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-dpr6w" podStartSLOduration=1.327158621 podStartE2EDuration="6.309528428s" podCreationTimestamp="2026-06-02 05:54:26 +0000 UTC" firstStartedPulling="2026-06-02 05:54:26.659382634 +0000 UTC m=+504.791263502" lastFinishedPulling="2026-06-02 05:54:31.641752435 +0000 UTC m=+509.773633309" observedRunningTime="2026-06-02 05:54:32.308597636 +0000 UTC m=+510.440478529" watchObservedRunningTime="2026-06-02 05:54:32.309528428 +0000 UTC m=+510.441409321" Jun 02 05:54:32.323049 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:32.323001 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-c5ll2" podStartSLOduration=2.049825028 podStartE2EDuration="6.322986632s" podCreationTimestamp="2026-06-02 05:54:26 +0000 UTC" firstStartedPulling="2026-06-02 05:54:27.314276998 +0000 UTC m=+505.446157873" lastFinishedPulling="2026-06-02 05:54:31.587438599 +0000 UTC m=+509.719319477" observedRunningTime="2026-06-02 05:54:32.320920095 +0000 UTC m=+510.452800986" watchObservedRunningTime="2026-06-02 05:54:32.322986632 +0000 UTC m=+510.454867549" Jun 02 05:54:32.345743 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:32.345703 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-skvfv"] Jun 02 05:54:34.286273 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:34.286228 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-skvfv" podUID="a185f9de-ad4c-42f2-9b0d-4c0433df240e" containerName="authorino" containerID="cri-o://abf9a2161fb1bc469b6c3d8f810d6d34ab7d481fcd8e2b635256fb72fd8303a0" gracePeriod=30 Jun 02 05:54:34.527708 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:34.527685 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-skvfv" Jun 02 05:54:34.637333 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:34.637301 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltrdr\" (UniqueName: \"kubernetes.io/projected/a185f9de-ad4c-42f2-9b0d-4c0433df240e-kube-api-access-ltrdr\") pod \"a185f9de-ad4c-42f2-9b0d-4c0433df240e\" (UID: \"a185f9de-ad4c-42f2-9b0d-4c0433df240e\") " Jun 02 05:54:34.639399 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:34.639366 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a185f9de-ad4c-42f2-9b0d-4c0433df240e-kube-api-access-ltrdr" (OuterVolumeSpecName: "kube-api-access-ltrdr") pod "a185f9de-ad4c-42f2-9b0d-4c0433df240e" (UID: "a185f9de-ad4c-42f2-9b0d-4c0433df240e"). InnerVolumeSpecName "kube-api-access-ltrdr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 05:54:34.738954 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:34.738913 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltrdr\" (UniqueName: \"kubernetes.io/projected/a185f9de-ad4c-42f2-9b0d-4c0433df240e-kube-api-access-ltrdr\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:54:35.290256 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:35.290222 2575 generic.go:358] "Generic (PLEG): container finished" podID="a185f9de-ad4c-42f2-9b0d-4c0433df240e" containerID="abf9a2161fb1bc469b6c3d8f810d6d34ab7d481fcd8e2b635256fb72fd8303a0" exitCode=0 Jun 02 05:54:35.290714 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:35.290264 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-skvfv" Jun 02 05:54:35.290714 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:35.290307 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-skvfv" event={"ID":"a185f9de-ad4c-42f2-9b0d-4c0433df240e","Type":"ContainerDied","Data":"abf9a2161fb1bc469b6c3d8f810d6d34ab7d481fcd8e2b635256fb72fd8303a0"} Jun 02 05:54:35.290714 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:35.290344 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-skvfv" event={"ID":"a185f9de-ad4c-42f2-9b0d-4c0433df240e","Type":"ContainerDied","Data":"a870900a6fc6a0b5ed555ec6d082bb067aea2bd8c1583759154a2363799ea62d"} Jun 02 05:54:35.290714 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:35.290364 2575 scope.go:117] "RemoveContainer" containerID="abf9a2161fb1bc469b6c3d8f810d6d34ab7d481fcd8e2b635256fb72fd8303a0" Jun 02 05:54:35.299082 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:35.299067 2575 scope.go:117] "RemoveContainer" containerID="abf9a2161fb1bc469b6c3d8f810d6d34ab7d481fcd8e2b635256fb72fd8303a0" Jun 02 05:54:35.299323 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:54:35.299304 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abf9a2161fb1bc469b6c3d8f810d6d34ab7d481fcd8e2b635256fb72fd8303a0\": container with ID starting with abf9a2161fb1bc469b6c3d8f810d6d34ab7d481fcd8e2b635256fb72fd8303a0 not found: ID does not exist" containerID="abf9a2161fb1bc469b6c3d8f810d6d34ab7d481fcd8e2b635256fb72fd8303a0" Jun 02 05:54:35.299369 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:35.299331 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abf9a2161fb1bc469b6c3d8f810d6d34ab7d481fcd8e2b635256fb72fd8303a0"} err="failed to get container status \"abf9a2161fb1bc469b6c3d8f810d6d34ab7d481fcd8e2b635256fb72fd8303a0\": rpc error: code = NotFound desc = could not find container \"abf9a2161fb1bc469b6c3d8f810d6d34ab7d481fcd8e2b635256fb72fd8303a0\": container with ID starting with abf9a2161fb1bc469b6c3d8f810d6d34ab7d481fcd8e2b635256fb72fd8303a0 not found: ID does not exist" Jun 02 05:54:35.310369 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:35.310345 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-skvfv"] Jun 02 05:54:35.313910 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:35.313888 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-skvfv"] Jun 02 05:54:36.354606 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:36.354569 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a185f9de-ad4c-42f2-9b0d-4c0433df240e" path="/var/lib/kubelet/pods/a185f9de-ad4c-42f2-9b0d-4c0433df240e/volumes" Jun 02 05:54:43.284751 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:54:43.284696 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-dpr6w" Jun 02 05:55:49.899678 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:49.899641 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-dsdc7"] Jun 02 05:55:49.900162 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:49.900033 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a185f9de-ad4c-42f2-9b0d-4c0433df240e" containerName="authorino" Jun 02 05:55:49.900162 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:49.900046 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a185f9de-ad4c-42f2-9b0d-4c0433df240e" containerName="authorino" Jun 02 05:55:49.900162 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:49.900100 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="a185f9de-ad4c-42f2-9b0d-4c0433df240e" containerName="authorino" Jun 02 05:55:49.903037 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:49.903016 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-dsdc7" Jun 02 05:55:49.906677 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:49.906649 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-dsdc7"] Jun 02 05:55:50.004484 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.004446 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh5xl\" (UniqueName: \"kubernetes.io/projected/18b813d9-9d47-491d-a3d2-7c02e73a3bbb-kube-api-access-zh5xl\") pod \"authorino-8b475cf9f-dsdc7\" (UID: \"18b813d9-9d47-491d-a3d2-7c02e73a3bbb\") " pod="kuadrant-system/authorino-8b475cf9f-dsdc7" Jun 02 05:55:50.105538 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.105490 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zh5xl\" (UniqueName: \"kubernetes.io/projected/18b813d9-9d47-491d-a3d2-7c02e73a3bbb-kube-api-access-zh5xl\") pod \"authorino-8b475cf9f-dsdc7\" (UID: \"18b813d9-9d47-491d-a3d2-7c02e73a3bbb\") " pod="kuadrant-system/authorino-8b475cf9f-dsdc7" Jun 02 05:55:50.114130 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.114098 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh5xl\" (UniqueName: \"kubernetes.io/projected/18b813d9-9d47-491d-a3d2-7c02e73a3bbb-kube-api-access-zh5xl\") pod \"authorino-8b475cf9f-dsdc7\" (UID: \"18b813d9-9d47-491d-a3d2-7c02e73a3bbb\") " pod="kuadrant-system/authorino-8b475cf9f-dsdc7" Jun 02 05:55:50.138581 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.138546 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-dsdc7"] Jun 02 05:55:50.138836 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.138820 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-dsdc7" Jun 02 05:55:50.161258 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.161189 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-84bf45dc9b-v26s9"] Jun 02 05:55:50.166050 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.165745 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84bf45dc9b-v26s9" Jun 02 05:55:50.169756 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.169327 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84bf45dc9b-v26s9"] Jun 02 05:55:50.242657 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.242618 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84bf45dc9b-v26s9"] Jun 02 05:55:50.242991 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:55:50.242965 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-cs4pv], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-84bf45dc9b-v26s9" podUID="d63a4986-9b7d-4e0b-9ba5-5b3b3ad2ceab" Jun 02 05:55:50.263239 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.263206 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f78c46976-p2z2b"] Jun 02 05:55:50.266818 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.266790 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f78c46976-p2z2b" Jun 02 05:55:50.269516 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.269403 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 02 05:55:50.272074 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.272036 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f78c46976-p2z2b"] Jun 02 05:55:50.279762 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.279702 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-dsdc7"] Jun 02 05:55:50.283648 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:55:50.283607 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18b813d9_9d47_491d_a3d2_7c02e73a3bbb.slice/crio-168bc1656a58a386e0376e2bbc7737346890a5bf76e0759e8fc6927153f976a5 WatchSource:0}: Error finding container 168bc1656a58a386e0376e2bbc7737346890a5bf76e0759e8fc6927153f976a5: Status 404 returned error can't find the container with id 168bc1656a58a386e0376e2bbc7737346890a5bf76e0759e8fc6927153f976a5 Jun 02 05:55:50.307908 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.307873 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs4pv\" (UniqueName: \"kubernetes.io/projected/d63a4986-9b7d-4e0b-9ba5-5b3b3ad2ceab-kube-api-access-cs4pv\") pod \"authorino-84bf45dc9b-v26s9\" (UID: \"d63a4986-9b7d-4e0b-9ba5-5b3b3ad2ceab\") " pod="kuadrant-system/authorino-84bf45dc9b-v26s9" Jun 02 05:55:50.409328 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.409284 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0d384a5f-fa8a-49f3-977f-ae12ad03b5c0-tls-cert\") pod \"authorino-7f78c46976-p2z2b\" (UID: \"0d384a5f-fa8a-49f3-977f-ae12ad03b5c0\") " pod="kuadrant-system/authorino-7f78c46976-p2z2b" Jun 02 05:55:50.409506 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.409407 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnf7n\" (UniqueName: \"kubernetes.io/projected/0d384a5f-fa8a-49f3-977f-ae12ad03b5c0-kube-api-access-rnf7n\") pod \"authorino-7f78c46976-p2z2b\" (UID: \"0d384a5f-fa8a-49f3-977f-ae12ad03b5c0\") " pod="kuadrant-system/authorino-7f78c46976-p2z2b" Jun 02 05:55:50.409506 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.409477 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cs4pv\" (UniqueName: \"kubernetes.io/projected/d63a4986-9b7d-4e0b-9ba5-5b3b3ad2ceab-kube-api-access-cs4pv\") pod \"authorino-84bf45dc9b-v26s9\" (UID: \"d63a4986-9b7d-4e0b-9ba5-5b3b3ad2ceab\") " pod="kuadrant-system/authorino-84bf45dc9b-v26s9" Jun 02 05:55:50.417068 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.417009 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs4pv\" (UniqueName: \"kubernetes.io/projected/d63a4986-9b7d-4e0b-9ba5-5b3b3ad2ceab-kube-api-access-cs4pv\") pod \"authorino-84bf45dc9b-v26s9\" (UID: \"d63a4986-9b7d-4e0b-9ba5-5b3b3ad2ceab\") " pod="kuadrant-system/authorino-84bf45dc9b-v26s9" Jun 02 05:55:50.510380 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.510335 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0d384a5f-fa8a-49f3-977f-ae12ad03b5c0-tls-cert\") pod \"authorino-7f78c46976-p2z2b\" (UID: \"0d384a5f-fa8a-49f3-977f-ae12ad03b5c0\") " pod="kuadrant-system/authorino-7f78c46976-p2z2b" Jun 02 05:55:50.510563 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.510407 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rnf7n\" (UniqueName: \"kubernetes.io/projected/0d384a5f-fa8a-49f3-977f-ae12ad03b5c0-kube-api-access-rnf7n\") pod \"authorino-7f78c46976-p2z2b\" (UID: \"0d384a5f-fa8a-49f3-977f-ae12ad03b5c0\") " pod="kuadrant-system/authorino-7f78c46976-p2z2b" Jun 02 05:55:50.512798 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.512763 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0d384a5f-fa8a-49f3-977f-ae12ad03b5c0-tls-cert\") pod \"authorino-7f78c46976-p2z2b\" (UID: \"0d384a5f-fa8a-49f3-977f-ae12ad03b5c0\") " pod="kuadrant-system/authorino-7f78c46976-p2z2b" Jun 02 05:55:50.518430 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.518410 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnf7n\" (UniqueName: \"kubernetes.io/projected/0d384a5f-fa8a-49f3-977f-ae12ad03b5c0-kube-api-access-rnf7n\") pod \"authorino-7f78c46976-p2z2b\" (UID: \"0d384a5f-fa8a-49f3-977f-ae12ad03b5c0\") " pod="kuadrant-system/authorino-7f78c46976-p2z2b" Jun 02 05:55:50.552539 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.552506 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-dsdc7" event={"ID":"18b813d9-9d47-491d-a3d2-7c02e73a3bbb","Type":"ContainerStarted","Data":"168bc1656a58a386e0376e2bbc7737346890a5bf76e0759e8fc6927153f976a5"} Jun 02 05:55:50.552539 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.552532 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84bf45dc9b-v26s9" Jun 02 05:55:50.557568 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.557550 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84bf45dc9b-v26s9" Jun 02 05:55:50.578939 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.578911 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f78c46976-p2z2b" Jun 02 05:55:50.710136 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.710112 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f78c46976-p2z2b"] Jun 02 05:55:50.712847 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.712825 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs4pv\" (UniqueName: \"kubernetes.io/projected/d63a4986-9b7d-4e0b-9ba5-5b3b3ad2ceab-kube-api-access-cs4pv\") pod \"d63a4986-9b7d-4e0b-9ba5-5b3b3ad2ceab\" (UID: \"d63a4986-9b7d-4e0b-9ba5-5b3b3ad2ceab\") " Jun 02 05:55:50.714691 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.714670 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d63a4986-9b7d-4e0b-9ba5-5b3b3ad2ceab-kube-api-access-cs4pv" (OuterVolumeSpecName: "kube-api-access-cs4pv") pod "d63a4986-9b7d-4e0b-9ba5-5b3b3ad2ceab" (UID: "d63a4986-9b7d-4e0b-9ba5-5b3b3ad2ceab"). InnerVolumeSpecName "kube-api-access-cs4pv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 05:55:50.716916 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:55:50.716892 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d384a5f_fa8a_49f3_977f_ae12ad03b5c0.slice/crio-db8b245942375065a5d61ce8bf1ad58293adc7b9878fe8cfdec5f6daa517a2a3 WatchSource:0}: Error finding container db8b245942375065a5d61ce8bf1ad58293adc7b9878fe8cfdec5f6daa517a2a3: Status 404 returned error can't find the container with id db8b245942375065a5d61ce8bf1ad58293adc7b9878fe8cfdec5f6daa517a2a3 Jun 02 05:55:50.814325 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:50.814286 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs4pv\" (UniqueName: \"kubernetes.io/projected/d63a4986-9b7d-4e0b-9ba5-5b3b3ad2ceab-kube-api-access-cs4pv\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:55:51.557799 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:51.557757 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-dsdc7" event={"ID":"18b813d9-9d47-491d-a3d2-7c02e73a3bbb","Type":"ContainerStarted","Data":"5163640a1af79fd71ac304851ba92fac25fcf9d24619c9dc16c49bb615672042"} Jun 02 05:55:51.558241 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:51.557800 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-dsdc7" podUID="18b813d9-9d47-491d-a3d2-7c02e73a3bbb" containerName="authorino" containerID="cri-o://5163640a1af79fd71ac304851ba92fac25fcf9d24619c9dc16c49bb615672042" gracePeriod=30 Jun 02 05:55:51.559200 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:51.559177 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84bf45dc9b-v26s9" Jun 02 05:55:51.559298 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:51.559215 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f78c46976-p2z2b" event={"ID":"0d384a5f-fa8a-49f3-977f-ae12ad03b5c0","Type":"ContainerStarted","Data":"67c79cfc3a30791abf1ca1c394d16487f982ba469de40adce166e90a8a62a82a"} Jun 02 05:55:51.559298 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:51.559249 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f78c46976-p2z2b" event={"ID":"0d384a5f-fa8a-49f3-977f-ae12ad03b5c0","Type":"ContainerStarted","Data":"db8b245942375065a5d61ce8bf1ad58293adc7b9878fe8cfdec5f6daa517a2a3"} Jun 02 05:55:51.572191 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:51.572144 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-dsdc7" podStartSLOduration=2.16866564 podStartE2EDuration="2.572128569s" podCreationTimestamp="2026-06-02 05:55:49 +0000 UTC" firstStartedPulling="2026-06-02 05:55:50.285694733 +0000 UTC m=+588.417575620" lastFinishedPulling="2026-06-02 05:55:50.689157681 +0000 UTC m=+588.821038549" observedRunningTime="2026-06-02 05:55:51.570909228 +0000 UTC m=+589.702790118" watchObservedRunningTime="2026-06-02 05:55:51.572128569 +0000 UTC m=+589.704009461" Jun 02 05:55:51.585294 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:51.585252 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7f78c46976-p2z2b" podStartSLOduration=1.307496325 podStartE2EDuration="1.585240553s" podCreationTimestamp="2026-06-02 05:55:50 +0000 UTC" firstStartedPulling="2026-06-02 05:55:50.718193185 +0000 UTC m=+588.850074055" lastFinishedPulling="2026-06-02 05:55:50.995937411 +0000 UTC m=+589.127818283" observedRunningTime="2026-06-02 05:55:51.584330733 +0000 UTC m=+589.716211623" watchObservedRunningTime="2026-06-02 05:55:51.585240553 +0000 UTC m=+589.717121423" Jun 02 05:55:51.607924 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:51.607891 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84bf45dc9b-v26s9"] Jun 02 05:55:51.613125 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:51.613093 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-c5ll2"] Jun 02 05:55:51.613355 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:51.613311 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-c5ll2" podUID="d37ad4e7-6923-4822-ba91-b5a38e9435e2" containerName="authorino" containerID="cri-o://dbeaed43f0d85c926109d05760ea03c5876e47fbd8abb810d1b7b67340013f0f" gracePeriod=30 Jun 02 05:55:51.615620 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:51.615597 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-84bf45dc9b-v26s9"] Jun 02 05:55:51.877631 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:51.877603 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-dsdc7" Jun 02 05:55:51.881079 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:51.881060 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-c5ll2" Jun 02 05:55:52.026183 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:52.026145 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zh5xl\" (UniqueName: \"kubernetes.io/projected/18b813d9-9d47-491d-a3d2-7c02e73a3bbb-kube-api-access-zh5xl\") pod \"18b813d9-9d47-491d-a3d2-7c02e73a3bbb\" (UID: \"18b813d9-9d47-491d-a3d2-7c02e73a3bbb\") " Jun 02 05:55:52.026355 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:52.026200 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcmlq\" (UniqueName: \"kubernetes.io/projected/d37ad4e7-6923-4822-ba91-b5a38e9435e2-kube-api-access-zcmlq\") pod \"d37ad4e7-6923-4822-ba91-b5a38e9435e2\" (UID: \"d37ad4e7-6923-4822-ba91-b5a38e9435e2\") " Jun 02 05:55:52.028292 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:52.028267 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18b813d9-9d47-491d-a3d2-7c02e73a3bbb-kube-api-access-zh5xl" (OuterVolumeSpecName: "kube-api-access-zh5xl") pod "18b813d9-9d47-491d-a3d2-7c02e73a3bbb" (UID: "18b813d9-9d47-491d-a3d2-7c02e73a3bbb"). InnerVolumeSpecName "kube-api-access-zh5xl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 05:55:52.028386 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:52.028315 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d37ad4e7-6923-4822-ba91-b5a38e9435e2-kube-api-access-zcmlq" (OuterVolumeSpecName: "kube-api-access-zcmlq") pod "d37ad4e7-6923-4822-ba91-b5a38e9435e2" (UID: "d37ad4e7-6923-4822-ba91-b5a38e9435e2"). InnerVolumeSpecName "kube-api-access-zcmlq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 05:55:52.127690 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:52.127659 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zh5xl\" (UniqueName: \"kubernetes.io/projected/18b813d9-9d47-491d-a3d2-7c02e73a3bbb-kube-api-access-zh5xl\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:55:52.127690 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:52.127688 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcmlq\" (UniqueName: \"kubernetes.io/projected/d37ad4e7-6923-4822-ba91-b5a38e9435e2-kube-api-access-zcmlq\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:55:52.354214 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:52.354179 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d63a4986-9b7d-4e0b-9ba5-5b3b3ad2ceab" path="/var/lib/kubelet/pods/d63a4986-9b7d-4e0b-9ba5-5b3b3ad2ceab/volumes" Jun 02 05:55:52.563662 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:52.563629 2575 generic.go:358] "Generic (PLEG): container finished" podID="18b813d9-9d47-491d-a3d2-7c02e73a3bbb" containerID="5163640a1af79fd71ac304851ba92fac25fcf9d24619c9dc16c49bb615672042" exitCode=0 Jun 02 05:55:52.564136 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:52.563678 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-dsdc7" Jun 02 05:55:52.564136 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:52.563711 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-dsdc7" event={"ID":"18b813d9-9d47-491d-a3d2-7c02e73a3bbb","Type":"ContainerDied","Data":"5163640a1af79fd71ac304851ba92fac25fcf9d24619c9dc16c49bb615672042"} Jun 02 05:55:52.564136 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:52.563769 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-dsdc7" event={"ID":"18b813d9-9d47-491d-a3d2-7c02e73a3bbb","Type":"ContainerDied","Data":"168bc1656a58a386e0376e2bbc7737346890a5bf76e0759e8fc6927153f976a5"} Jun 02 05:55:52.564136 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:52.563786 2575 scope.go:117] "RemoveContainer" containerID="5163640a1af79fd71ac304851ba92fac25fcf9d24619c9dc16c49bb615672042" Jun 02 05:55:52.565274 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:52.565252 2575 generic.go:358] "Generic (PLEG): container finished" podID="d37ad4e7-6923-4822-ba91-b5a38e9435e2" containerID="dbeaed43f0d85c926109d05760ea03c5876e47fbd8abb810d1b7b67340013f0f" exitCode=0 Jun 02 05:55:52.565378 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:52.565297 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-c5ll2" event={"ID":"d37ad4e7-6923-4822-ba91-b5a38e9435e2","Type":"ContainerDied","Data":"dbeaed43f0d85c926109d05760ea03c5876e47fbd8abb810d1b7b67340013f0f"} Jun 02 05:55:52.565378 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:52.565320 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-c5ll2" event={"ID":"d37ad4e7-6923-4822-ba91-b5a38e9435e2","Type":"ContainerDied","Data":"fd7a0f695e0e17e1ac36735d770e4720b169d0d326a4b21178cdbaf61c10cc7a"} Jun 02 05:55:52.565378 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:52.565301 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-c5ll2" Jun 02 05:55:52.577832 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:52.577811 2575 scope.go:117] "RemoveContainer" containerID="5163640a1af79fd71ac304851ba92fac25fcf9d24619c9dc16c49bb615672042" Jun 02 05:55:52.578163 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:55:52.578139 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5163640a1af79fd71ac304851ba92fac25fcf9d24619c9dc16c49bb615672042\": container with ID starting with 5163640a1af79fd71ac304851ba92fac25fcf9d24619c9dc16c49bb615672042 not found: ID does not exist" containerID="5163640a1af79fd71ac304851ba92fac25fcf9d24619c9dc16c49bb615672042" Jun 02 05:55:52.578241 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:52.578176 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5163640a1af79fd71ac304851ba92fac25fcf9d24619c9dc16c49bb615672042"} err="failed to get container status \"5163640a1af79fd71ac304851ba92fac25fcf9d24619c9dc16c49bb615672042\": rpc error: code = NotFound desc = could not find container \"5163640a1af79fd71ac304851ba92fac25fcf9d24619c9dc16c49bb615672042\": container with ID starting with 5163640a1af79fd71ac304851ba92fac25fcf9d24619c9dc16c49bb615672042 not found: ID does not exist" Jun 02 05:55:52.578241 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:52.578200 2575 scope.go:117] "RemoveContainer" containerID="dbeaed43f0d85c926109d05760ea03c5876e47fbd8abb810d1b7b67340013f0f" Jun 02 05:55:52.583510 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:52.583489 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-c5ll2"] Jun 02 05:55:52.586394 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:52.586373 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-c5ll2"] Jun 02 05:55:52.586458 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:52.586401 2575 scope.go:117] "RemoveContainer" containerID="dbeaed43f0d85c926109d05760ea03c5876e47fbd8abb810d1b7b67340013f0f" Jun 02 05:55:52.586654 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:55:52.586636 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbeaed43f0d85c926109d05760ea03c5876e47fbd8abb810d1b7b67340013f0f\": container with ID starting with dbeaed43f0d85c926109d05760ea03c5876e47fbd8abb810d1b7b67340013f0f not found: ID does not exist" containerID="dbeaed43f0d85c926109d05760ea03c5876e47fbd8abb810d1b7b67340013f0f" Jun 02 05:55:52.586696 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:52.586670 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbeaed43f0d85c926109d05760ea03c5876e47fbd8abb810d1b7b67340013f0f"} err="failed to get container status \"dbeaed43f0d85c926109d05760ea03c5876e47fbd8abb810d1b7b67340013f0f\": rpc error: code = NotFound desc = could not find container \"dbeaed43f0d85c926109d05760ea03c5876e47fbd8abb810d1b7b67340013f0f\": container with ID starting with dbeaed43f0d85c926109d05760ea03c5876e47fbd8abb810d1b7b67340013f0f not found: ID does not exist" Jun 02 05:55:52.595695 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:52.595669 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-dsdc7"] Jun 02 05:55:52.597580 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:52.597558 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-dsdc7"] Jun 02 05:55:54.354999 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:54.354964 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18b813d9-9d47-491d-a3d2-7c02e73a3bbb" path="/var/lib/kubelet/pods/18b813d9-9d47-491d-a3d2-7c02e73a3bbb/volumes" Jun 02 05:55:54.355344 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:55:54.355288 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d37ad4e7-6923-4822-ba91-b5a38e9435e2" path="/var/lib/kubelet/pods/d37ad4e7-6923-4822-ba91-b5a38e9435e2/volumes" Jun 02 05:56:02.274307 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:56:02.274271 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qqgq_b68ed6d7-9e23-4f45-a0fb-18ca25e28836/console-operator/2.log" Jun 02 05:56:02.275624 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:56:02.275601 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qqgq_b68ed6d7-9e23-4f45-a0fb-18ca25e28836/console-operator/2.log" Jun 02 05:56:02.277660 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:56:02.277641 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j46gm_e7d6b49b-7faa-4b7d-b3ba-2398141c920d/ovn-acl-logging/0.log" Jun 02 05:56:02.278710 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:56:02.278694 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j46gm_e7d6b49b-7faa-4b7d-b3ba-2398141c920d/ovn-acl-logging/0.log" Jun 02 05:56:30.293468 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:56:30.293423 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dpr6w"] Jun 02 05:57:18.615716 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:18.615681 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5454666cd4-gs4km"] Jun 02 05:57:18.616344 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:18.616048 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d37ad4e7-6923-4822-ba91-b5a38e9435e2" containerName="authorino" Jun 02 05:57:18.616344 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:18.616059 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d37ad4e7-6923-4822-ba91-b5a38e9435e2" containerName="authorino" Jun 02 05:57:18.616344 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:18.616070 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18b813d9-9d47-491d-a3d2-7c02e73a3bbb" containerName="authorino" Jun 02 05:57:18.616344 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:18.616076 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="18b813d9-9d47-491d-a3d2-7c02e73a3bbb" containerName="authorino" Jun 02 05:57:18.616344 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:18.616146 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="18b813d9-9d47-491d-a3d2-7c02e73a3bbb" containerName="authorino" Jun 02 05:57:18.616344 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:18.616156 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="d37ad4e7-6923-4822-ba91-b5a38e9435e2" containerName="authorino" Jun 02 05:57:18.619313 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:18.619296 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5454666cd4-gs4km" Jun 02 05:57:18.621837 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:18.621812 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 02 05:57:18.627190 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:18.627166 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5454666cd4-gs4km"] Jun 02 05:57:18.698738 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:18.698700 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2c267dac-7838-429f-a7c5-fea59fb94fd8-oidc-ca\") pod \"authorino-5454666cd4-gs4km\" (UID: \"2c267dac-7838-429f-a7c5-fea59fb94fd8\") " pod="kuadrant-system/authorino-5454666cd4-gs4km" Jun 02 05:57:18.698901 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:18.698802 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2c267dac-7838-429f-a7c5-fea59fb94fd8-tls-cert\") pod \"authorino-5454666cd4-gs4km\" (UID: \"2c267dac-7838-429f-a7c5-fea59fb94fd8\") " pod="kuadrant-system/authorino-5454666cd4-gs4km" Jun 02 05:57:18.698901 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:18.698861 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vg85\" (UniqueName: \"kubernetes.io/projected/2c267dac-7838-429f-a7c5-fea59fb94fd8-kube-api-access-8vg85\") pod \"authorino-5454666cd4-gs4km\" (UID: \"2c267dac-7838-429f-a7c5-fea59fb94fd8\") " pod="kuadrant-system/authorino-5454666cd4-gs4km" Jun 02 05:57:18.800347 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:18.800308 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2c267dac-7838-429f-a7c5-fea59fb94fd8-tls-cert\") pod \"authorino-5454666cd4-gs4km\" (UID: \"2c267dac-7838-429f-a7c5-fea59fb94fd8\") " pod="kuadrant-system/authorino-5454666cd4-gs4km" Jun 02 05:57:18.800531 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:18.800388 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8vg85\" (UniqueName: \"kubernetes.io/projected/2c267dac-7838-429f-a7c5-fea59fb94fd8-kube-api-access-8vg85\") pod \"authorino-5454666cd4-gs4km\" (UID: \"2c267dac-7838-429f-a7c5-fea59fb94fd8\") " pod="kuadrant-system/authorino-5454666cd4-gs4km" Jun 02 05:57:18.800601 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:18.800560 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2c267dac-7838-429f-a7c5-fea59fb94fd8-oidc-ca\") pod \"authorino-5454666cd4-gs4km\" (UID: \"2c267dac-7838-429f-a7c5-fea59fb94fd8\") " pod="kuadrant-system/authorino-5454666cd4-gs4km" Jun 02 05:57:18.801286 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:18.801264 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2c267dac-7838-429f-a7c5-fea59fb94fd8-oidc-ca\") pod \"authorino-5454666cd4-gs4km\" (UID: \"2c267dac-7838-429f-a7c5-fea59fb94fd8\") " pod="kuadrant-system/authorino-5454666cd4-gs4km" Jun 02 05:57:18.802854 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:18.802824 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2c267dac-7838-429f-a7c5-fea59fb94fd8-tls-cert\") pod \"authorino-5454666cd4-gs4km\" (UID: \"2c267dac-7838-429f-a7c5-fea59fb94fd8\") " pod="kuadrant-system/authorino-5454666cd4-gs4km" Jun 02 05:57:18.813596 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:18.813569 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vg85\" (UniqueName: \"kubernetes.io/projected/2c267dac-7838-429f-a7c5-fea59fb94fd8-kube-api-access-8vg85\") pod \"authorino-5454666cd4-gs4km\" (UID: \"2c267dac-7838-429f-a7c5-fea59fb94fd8\") " pod="kuadrant-system/authorino-5454666cd4-gs4km" Jun 02 05:57:18.929622 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:18.929535 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5454666cd4-gs4km" Jun 02 05:57:19.058154 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:19.058127 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5454666cd4-gs4km"] Jun 02 05:57:19.060588 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:57:19.060557 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c267dac_7838_429f_a7c5_fea59fb94fd8.slice/crio-a9eb281ac19df9f60207b6dbb00f2307412deb24a13c181b5b8711656ff5a669 WatchSource:0}: Error finding container a9eb281ac19df9f60207b6dbb00f2307412deb24a13c181b5b8711656ff5a669: Status 404 returned error can't find the container with id a9eb281ac19df9f60207b6dbb00f2307412deb24a13c181b5b8711656ff5a669 Jun 02 05:57:19.062172 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:19.062152 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 05:57:19.870346 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:19.870311 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5454666cd4-gs4km" event={"ID":"2c267dac-7838-429f-a7c5-fea59fb94fd8","Type":"ContainerStarted","Data":"21b1a30c58ce4af089500fb1dc52c624b3a98339fd988d2d3ee5ab7749bb0fbc"} Jun 02 05:57:19.870346 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:19.870352 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5454666cd4-gs4km" event={"ID":"2c267dac-7838-429f-a7c5-fea59fb94fd8","Type":"ContainerStarted","Data":"a9eb281ac19df9f60207b6dbb00f2307412deb24a13c181b5b8711656ff5a669"} Jun 02 05:57:19.888293 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:19.888246 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5454666cd4-gs4km" podStartSLOduration=1.440221561 podStartE2EDuration="1.888233249s" podCreationTimestamp="2026-06-02 05:57:18 +0000 UTC" firstStartedPulling="2026-06-02 05:57:19.06228728 +0000 UTC m=+677.194168149" lastFinishedPulling="2026-06-02 05:57:19.510298962 +0000 UTC m=+677.642179837" observedRunningTime="2026-06-02 05:57:19.886129944 +0000 UTC m=+678.018010837" watchObservedRunningTime="2026-06-02 05:57:19.888233249 +0000 UTC m=+678.020114139" Jun 02 05:57:19.918844 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:19.918808 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f78c46976-p2z2b"] Jun 02 05:57:19.919122 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:19.919098 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7f78c46976-p2z2b" podUID="0d384a5f-fa8a-49f3-977f-ae12ad03b5c0" containerName="authorino" containerID="cri-o://67c79cfc3a30791abf1ca1c394d16487f982ba469de40adce166e90a8a62a82a" gracePeriod=30 Jun 02 05:57:20.171637 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:20.171614 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f78c46976-p2z2b" Jun 02 05:57:20.316685 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:20.316652 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0d384a5f-fa8a-49f3-977f-ae12ad03b5c0-tls-cert\") pod \"0d384a5f-fa8a-49f3-977f-ae12ad03b5c0\" (UID: \"0d384a5f-fa8a-49f3-977f-ae12ad03b5c0\") " Jun 02 05:57:20.316895 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:20.316764 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnf7n\" (UniqueName: \"kubernetes.io/projected/0d384a5f-fa8a-49f3-977f-ae12ad03b5c0-kube-api-access-rnf7n\") pod \"0d384a5f-fa8a-49f3-977f-ae12ad03b5c0\" (UID: \"0d384a5f-fa8a-49f3-977f-ae12ad03b5c0\") " Jun 02 05:57:20.318939 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:20.318910 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d384a5f-fa8a-49f3-977f-ae12ad03b5c0-kube-api-access-rnf7n" (OuterVolumeSpecName: "kube-api-access-rnf7n") pod "0d384a5f-fa8a-49f3-977f-ae12ad03b5c0" (UID: "0d384a5f-fa8a-49f3-977f-ae12ad03b5c0"). InnerVolumeSpecName "kube-api-access-rnf7n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 05:57:20.328211 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:20.328187 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d384a5f-fa8a-49f3-977f-ae12ad03b5c0-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "0d384a5f-fa8a-49f3-977f-ae12ad03b5c0" (UID: "0d384a5f-fa8a-49f3-977f-ae12ad03b5c0"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 05:57:20.417705 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:20.417621 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnf7n\" (UniqueName: \"kubernetes.io/projected/0d384a5f-fa8a-49f3-977f-ae12ad03b5c0-kube-api-access-rnf7n\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:57:20.417705 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:20.417658 2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0d384a5f-fa8a-49f3-977f-ae12ad03b5c0-tls-cert\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 05:57:20.875151 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:20.875118 2575 generic.go:358] "Generic (PLEG): container finished" podID="0d384a5f-fa8a-49f3-977f-ae12ad03b5c0" containerID="67c79cfc3a30791abf1ca1c394d16487f982ba469de40adce166e90a8a62a82a" exitCode=0 Jun 02 05:57:20.875593 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:20.875165 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f78c46976-p2z2b" Jun 02 05:57:20.875593 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:20.875195 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f78c46976-p2z2b" event={"ID":"0d384a5f-fa8a-49f3-977f-ae12ad03b5c0","Type":"ContainerDied","Data":"67c79cfc3a30791abf1ca1c394d16487f982ba469de40adce166e90a8a62a82a"} Jun 02 05:57:20.875593 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:20.875237 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f78c46976-p2z2b" event={"ID":"0d384a5f-fa8a-49f3-977f-ae12ad03b5c0","Type":"ContainerDied","Data":"db8b245942375065a5d61ce8bf1ad58293adc7b9878fe8cfdec5f6daa517a2a3"} Jun 02 05:57:20.875593 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:20.875258 2575 scope.go:117] "RemoveContainer" containerID="67c79cfc3a30791abf1ca1c394d16487f982ba469de40adce166e90a8a62a82a" Jun 02 05:57:20.883321 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:20.883302 2575 scope.go:117] "RemoveContainer" containerID="67c79cfc3a30791abf1ca1c394d16487f982ba469de40adce166e90a8a62a82a" Jun 02 05:57:20.883596 ip-10-0-134-52 kubenswrapper[2575]: E0602 05:57:20.883570 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67c79cfc3a30791abf1ca1c394d16487f982ba469de40adce166e90a8a62a82a\": container with ID starting with 67c79cfc3a30791abf1ca1c394d16487f982ba469de40adce166e90a8a62a82a not found: ID does not exist" containerID="67c79cfc3a30791abf1ca1c394d16487f982ba469de40adce166e90a8a62a82a" Jun 02 05:57:20.883639 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:20.883600 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67c79cfc3a30791abf1ca1c394d16487f982ba469de40adce166e90a8a62a82a"} err="failed to get container status \"67c79cfc3a30791abf1ca1c394d16487f982ba469de40adce166e90a8a62a82a\": rpc error: code = NotFound desc = could not find container \"67c79cfc3a30791abf1ca1c394d16487f982ba469de40adce166e90a8a62a82a\": container with ID starting with 67c79cfc3a30791abf1ca1c394d16487f982ba469de40adce166e90a8a62a82a not found: ID does not exist" Jun 02 05:57:20.890322 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:20.890294 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f78c46976-p2z2b"] Jun 02 05:57:20.893393 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:20.893372 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7f78c46976-p2z2b"] Jun 02 05:57:22.354387 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:22.354355 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d384a5f-fa8a-49f3-977f-ae12ad03b5c0" path="/var/lib/kubelet/pods/0d384a5f-fa8a-49f3-977f-ae12ad03b5c0/volumes" Jun 02 05:57:40.319194 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:40.319143 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dpr6w"] Jun 02 05:57:48.482631 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:48.482533 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dpr6w"] Jun 02 05:57:59.966374 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:59.966342 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv"] Jun 02 05:57:59.966879 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:59.966756 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d384a5f-fa8a-49f3-977f-ae12ad03b5c0" containerName="authorino" Jun 02 05:57:59.966879 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:59.966775 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d384a5f-fa8a-49f3-977f-ae12ad03b5c0" containerName="authorino" Jun 02 05:57:59.966973 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:59.966901 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="0d384a5f-fa8a-49f3-977f-ae12ad03b5c0" containerName="authorino" Jun 02 05:57:59.970489 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:59.970469 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" Jun 02 05:57:59.973073 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:59.973046 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 05:57:59.974400 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:59.974379 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mbvq6\"" Jun 02 05:57:59.974525 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:59.974433 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 02 05:57:59.974592 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:59.974544 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 05:57:59.979621 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:57:59.979596 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv"] Jun 02 05:58:00.065334 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:00.065300 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65a8bf5a-7b07-49d3-bb60-54d5b1686245-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv\" (UID: \"65a8bf5a-7b07-49d3-bb60-54d5b1686245\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" Jun 02 05:58:00.065514 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:00.065341 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f85qd\" (UniqueName: \"kubernetes.io/projected/65a8bf5a-7b07-49d3-bb60-54d5b1686245-kube-api-access-f85qd\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv\" (UID: \"65a8bf5a-7b07-49d3-bb60-54d5b1686245\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" Jun 02 05:58:00.065514 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:00.065372 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65a8bf5a-7b07-49d3-bb60-54d5b1686245-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv\" (UID: \"65a8bf5a-7b07-49d3-bb60-54d5b1686245\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" Jun 02 05:58:00.065514 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:00.065439 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/65a8bf5a-7b07-49d3-bb60-54d5b1686245-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv\" (UID: \"65a8bf5a-7b07-49d3-bb60-54d5b1686245\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" Jun 02 05:58:00.065514 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:00.065486 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65a8bf5a-7b07-49d3-bb60-54d5b1686245-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv\" (UID: \"65a8bf5a-7b07-49d3-bb60-54d5b1686245\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" Jun 02 05:58:00.065514 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:00.065507 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65a8bf5a-7b07-49d3-bb60-54d5b1686245-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv\" (UID: \"65a8bf5a-7b07-49d3-bb60-54d5b1686245\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" Jun 02 05:58:00.166801 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:00.166752 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65a8bf5a-7b07-49d3-bb60-54d5b1686245-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv\" (UID: \"65a8bf5a-7b07-49d3-bb60-54d5b1686245\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" Jun 02 05:58:00.166801 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:00.166806 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f85qd\" (UniqueName: \"kubernetes.io/projected/65a8bf5a-7b07-49d3-bb60-54d5b1686245-kube-api-access-f85qd\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv\" (UID: \"65a8bf5a-7b07-49d3-bb60-54d5b1686245\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" Jun 02 05:58:00.167066 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:00.166835 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65a8bf5a-7b07-49d3-bb60-54d5b1686245-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv\" (UID: \"65a8bf5a-7b07-49d3-bb60-54d5b1686245\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" Jun 02 05:58:00.167066 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:00.166854 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/65a8bf5a-7b07-49d3-bb60-54d5b1686245-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv\" (UID: \"65a8bf5a-7b07-49d3-bb60-54d5b1686245\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" Jun 02 05:58:00.167066 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:00.166887 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65a8bf5a-7b07-49d3-bb60-54d5b1686245-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv\" (UID: \"65a8bf5a-7b07-49d3-bb60-54d5b1686245\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" Jun 02 05:58:00.167066 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:00.166906 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65a8bf5a-7b07-49d3-bb60-54d5b1686245-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv\" (UID: \"65a8bf5a-7b07-49d3-bb60-54d5b1686245\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" Jun 02 05:58:00.167337 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:00.167303 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/65a8bf5a-7b07-49d3-bb60-54d5b1686245-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv\" (UID: \"65a8bf5a-7b07-49d3-bb60-54d5b1686245\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" Jun 02 05:58:00.167454 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:00.167344 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65a8bf5a-7b07-49d3-bb60-54d5b1686245-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv\" (UID: \"65a8bf5a-7b07-49d3-bb60-54d5b1686245\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" Jun 02 05:58:00.167501 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:00.167468 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65a8bf5a-7b07-49d3-bb60-54d5b1686245-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv\" (UID: \"65a8bf5a-7b07-49d3-bb60-54d5b1686245\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" Jun 02 05:58:00.169192 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:00.169165 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65a8bf5a-7b07-49d3-bb60-54d5b1686245-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv\" (UID: \"65a8bf5a-7b07-49d3-bb60-54d5b1686245\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" Jun 02 05:58:00.169329 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:00.169308 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65a8bf5a-7b07-49d3-bb60-54d5b1686245-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv\" (UID: \"65a8bf5a-7b07-49d3-bb60-54d5b1686245\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" Jun 02 05:58:00.174560 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:00.174539 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f85qd\" (UniqueName: \"kubernetes.io/projected/65a8bf5a-7b07-49d3-bb60-54d5b1686245-kube-api-access-f85qd\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv\" (UID: \"65a8bf5a-7b07-49d3-bb60-54d5b1686245\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" Jun 02 05:58:00.283447 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:00.283360 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" Jun 02 05:58:00.417952 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:00.417921 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv"] Jun 02 05:58:00.420545 ip-10-0-134-52 kubenswrapper[2575]: W0602 05:58:00.420512 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65a8bf5a_7b07_49d3_bb60_54d5b1686245.slice/crio-db8437134b308d729d586bc03c95cb47ccb467c197e37ba8e59a42870f57fc33 WatchSource:0}: Error finding container db8437134b308d729d586bc03c95cb47ccb467c197e37ba8e59a42870f57fc33: Status 404 returned error can't find the container with id db8437134b308d729d586bc03c95cb47ccb467c197e37ba8e59a42870f57fc33 Jun 02 05:58:00.890803 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:00.890767 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dpr6w"] Jun 02 05:58:01.019843 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:01.019807 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" event={"ID":"65a8bf5a-7b07-49d3-bb60-54d5b1686245","Type":"ContainerStarted","Data":"db8437134b308d729d586bc03c95cb47ccb467c197e37ba8e59a42870f57fc33"} Jun 02 05:58:04.032775 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:04.032704 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" event={"ID":"65a8bf5a-7b07-49d3-bb60-54d5b1686245","Type":"ContainerStarted","Data":"5981e560dbbfab9f9bb7239be9bf54162ad7b428c6d7f4ad516dd8b01542b804"} Jun 02 05:58:06.042231 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:06.042195 2575 generic.go:358] "Generic (PLEG): container finished" podID="65a8bf5a-7b07-49d3-bb60-54d5b1686245" containerID="5981e560dbbfab9f9bb7239be9bf54162ad7b428c6d7f4ad516dd8b01542b804" exitCode=0 Jun 02 05:58:06.042932 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:06.042273 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" event={"ID":"65a8bf5a-7b07-49d3-bb60-54d5b1686245","Type":"ContainerDied","Data":"5981e560dbbfab9f9bb7239be9bf54162ad7b428c6d7f4ad516dd8b01542b804"} Jun 02 05:58:08.056686 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:08.056646 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" event={"ID":"65a8bf5a-7b07-49d3-bb60-54d5b1686245","Type":"ContainerStarted","Data":"d9283ad41dbacbeaeda94d968ea59056cd4f14561b291f01c526678dda32410e"} Jun 02 05:58:08.074936 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:08.074878 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" podStartSLOduration=2.367481609 podStartE2EDuration="9.074859083s" podCreationTimestamp="2026-06-02 05:57:59 +0000 UTC" firstStartedPulling="2026-06-02 05:58:00.422357366 +0000 UTC m=+718.554238235" lastFinishedPulling="2026-06-02 05:58:07.129734825 +0000 UTC m=+725.261615709" observedRunningTime="2026-06-02 05:58:08.0742251 +0000 UTC m=+726.206105985" watchObservedRunningTime="2026-06-02 05:58:08.074859083 +0000 UTC m=+726.206739971" Jun 02 05:58:10.284011 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:10.283973 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" Jun 02 05:58:10.284471 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:10.284057 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" Jun 02 05:58:10.296447 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:10.296416 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" Jun 02 05:58:11.080961 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:11.080931 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv" Jun 02 05:58:13.997073 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:13.997032 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dpr6w"] Jun 02 05:58:19.396181 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:19.396143 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dpr6w"] Jun 02 05:58:31.385661 ip-10-0-134-52 kubenswrapper[2575]: I0602 05:58:31.385613 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-dpr6w"] Jun 02 06:00:00.142416 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:00:00.142377 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29673000-fqhtz"] Jun 02 06:00:00.145861 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:00:00.145840 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673000-fqhtz" Jun 02 06:00:00.153713 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:00:00.149530 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-tttq5\"" Jun 02 06:00:00.153713 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:00:00.152389 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29673000-fqhtz"] Jun 02 06:00:00.238078 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:00:00.238031 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5m96\" (UniqueName: \"kubernetes.io/projected/8d5c86af-ea7d-4d4c-81da-608e51f88d3d-kube-api-access-n5m96\") pod \"maas-api-key-cleanup-29673000-fqhtz\" (UID: \"8d5c86af-ea7d-4d4c-81da-608e51f88d3d\") " pod="opendatahub/maas-api-key-cleanup-29673000-fqhtz" Jun 02 06:00:00.339366 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:00:00.339323 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n5m96\" (UniqueName: \"kubernetes.io/projected/8d5c86af-ea7d-4d4c-81da-608e51f88d3d-kube-api-access-n5m96\") pod \"maas-api-key-cleanup-29673000-fqhtz\" (UID: \"8d5c86af-ea7d-4d4c-81da-608e51f88d3d\") " pod="opendatahub/maas-api-key-cleanup-29673000-fqhtz" Jun 02 06:00:00.350353 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:00:00.350316 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5m96\" (UniqueName: \"kubernetes.io/projected/8d5c86af-ea7d-4d4c-81da-608e51f88d3d-kube-api-access-n5m96\") pod \"maas-api-key-cleanup-29673000-fqhtz\" (UID: \"8d5c86af-ea7d-4d4c-81da-608e51f88d3d\") " pod="opendatahub/maas-api-key-cleanup-29673000-fqhtz" Jun 02 06:00:00.464121 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:00:00.464025 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673000-fqhtz" Jun 02 06:00:00.595959 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:00:00.595934 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29673000-fqhtz"] Jun 02 06:00:00.598149 ip-10-0-134-52 kubenswrapper[2575]: W0602 06:00:00.598118 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d5c86af_ea7d_4d4c_81da_608e51f88d3d.slice/crio-efd44a8cffca68dbf97c01961678057d2254217600eb71c29da8873648edd393 WatchSource:0}: Error finding container efd44a8cffca68dbf97c01961678057d2254217600eb71c29da8873648edd393: Status 404 returned error can't find the container with id efd44a8cffca68dbf97c01961678057d2254217600eb71c29da8873648edd393 Jun 02 06:00:01.472297 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:00:01.472258 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673000-fqhtz" event={"ID":"8d5c86af-ea7d-4d4c-81da-608e51f88d3d","Type":"ContainerStarted","Data":"efd44a8cffca68dbf97c01961678057d2254217600eb71c29da8873648edd393"} Jun 02 06:00:06.491881 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:00:06.491843 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673000-fqhtz" event={"ID":"8d5c86af-ea7d-4d4c-81da-608e51f88d3d","Type":"ContainerStarted","Data":"ead3ab6140383340bde9b190387fe4991aaa5d6185f12c63cd51b4497a04dd53"} Jun 02 06:00:06.507280 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:00:06.507234 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29673000-fqhtz" podStartSLOduration=0.917258639 podStartE2EDuration="6.507220499s" podCreationTimestamp="2026-06-02 06:00:00 +0000 UTC" firstStartedPulling="2026-06-02 06:00:00.599867714 +0000 UTC m=+838.731748583" lastFinishedPulling="2026-06-02 06:00:06.189829574 +0000 UTC m=+844.321710443" observedRunningTime="2026-06-02 06:00:06.506331818 +0000 UTC m=+844.638212710" watchObservedRunningTime="2026-06-02 06:00:06.507220499 +0000 UTC m=+844.639101390" Jun 02 06:00:07.496202 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:00:07.496107 2575 generic.go:358] "Generic (PLEG): container finished" podID="8d5c86af-ea7d-4d4c-81da-608e51f88d3d" containerID="ead3ab6140383340bde9b190387fe4991aaa5d6185f12c63cd51b4497a04dd53" exitCode=0 Jun 02 06:00:07.496202 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:00:07.496187 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673000-fqhtz" event={"ID":"8d5c86af-ea7d-4d4c-81da-608e51f88d3d","Type":"ContainerDied","Data":"ead3ab6140383340bde9b190387fe4991aaa5d6185f12c63cd51b4497a04dd53"} Jun 02 06:00:08.631308 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:00:08.631283 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673000-fqhtz" Jun 02 06:00:08.703899 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:00:08.703868 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5m96\" (UniqueName: \"kubernetes.io/projected/8d5c86af-ea7d-4d4c-81da-608e51f88d3d-kube-api-access-n5m96\") pod \"8d5c86af-ea7d-4d4c-81da-608e51f88d3d\" (UID: \"8d5c86af-ea7d-4d4c-81da-608e51f88d3d\") " Jun 02 06:00:08.706041 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:00:08.706016 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d5c86af-ea7d-4d4c-81da-608e51f88d3d-kube-api-access-n5m96" (OuterVolumeSpecName: "kube-api-access-n5m96") pod "8d5c86af-ea7d-4d4c-81da-608e51f88d3d" (UID: "8d5c86af-ea7d-4d4c-81da-608e51f88d3d"). InnerVolumeSpecName "kube-api-access-n5m96". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 06:00:08.804716 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:00:08.804678 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5m96\" (UniqueName: \"kubernetes.io/projected/8d5c86af-ea7d-4d4c-81da-608e51f88d3d-kube-api-access-n5m96\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jun 02 06:00:09.503547 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:00:09.503511 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673000-fqhtz" event={"ID":"8d5c86af-ea7d-4d4c-81da-608e51f88d3d","Type":"ContainerDied","Data":"efd44a8cffca68dbf97c01961678057d2254217600eb71c29da8873648edd393"} Jun 02 06:00:09.503547 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:00:09.503536 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673000-fqhtz" Jun 02 06:00:09.503765 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:00:09.503545 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="efd44a8cffca68dbf97c01961678057d2254217600eb71c29da8873648edd393" Jun 02 06:01:02.304155 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:01:02.304078 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qqgq_b68ed6d7-9e23-4f45-a0fb-18ca25e28836/console-operator/2.log" Jun 02 06:01:02.305650 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:01:02.305628 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qqgq_b68ed6d7-9e23-4f45-a0fb-18ca25e28836/console-operator/2.log" Jun 02 06:01:02.307180 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:01:02.307159 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j46gm_e7d6b49b-7faa-4b7d-b3ba-2398141c920d/ovn-acl-logging/0.log" Jun 02 06:01:02.308687 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:01:02.308666 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j46gm_e7d6b49b-7faa-4b7d-b3ba-2398141c920d/ovn-acl-logging/0.log" Jun 02 06:04:14.559890 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:14.559799 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5454666cd4-gs4km_2c267dac-7838-429f-a7c5-fea59fb94fd8/authorino/0.log" Jun 02 06:04:19.777635 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:19.777586 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29673000-fqhtz_8d5c86af-ea7d-4d4c-81da-608e51f88d3d/cleanup/0.log" Jun 02 06:04:20.459164 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:20.459135 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74d9c7f795-njkbh_da47eba2-31e0-46fe-bda5-05a987883567/copy-manifests/0.log" Jun 02 06:04:20.482589 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:20.482561 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74d9c7f795-njkbh_da47eba2-31e0-46fe-bda5-05a987883567/manager/0.log" Jun 02 06:04:22.176284 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:22.176255 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5454666cd4-gs4km_2c267dac-7838-429f-a7c5-fea59fb94fd8/authorino/0.log" Jun 02 06:04:22.469011 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:22.468933 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-nbtpw_37d4f7cb-7c83-46ce-9b19-f6a97658cd76/manager/0.log" Jun 02 06:04:22.908975 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:22.908943 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-5zcn8_8eb4d682-ea2f-4921-8db1-4a21868e214b/manager/0.log" Jun 02 06:04:23.062896 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:23.062863 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-dpr6w_68ae814d-d9a1-4725-9909-c7b70a423e33/limitador/0.log" Jun 02 06:04:24.145418 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:24.145385 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d6fbd88fb-lk8hw_f15142ca-6fa0-4840-a708-52badee8efff/kube-auth-proxy/0.log" Jun 02 06:04:24.556816 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:24.556778 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bb468cc95-h6d4x_3c4d7e14-ce85-4a4a-b566-3afbab8fc451/router/0.log" Jun 02 06:04:25.237311 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:25.237271 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv_65a8bf5a-7b07-49d3-bb60-54d5b1686245/storage-initializer/0.log" Jun 02 06:04:25.260342 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:25.260312 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-rwjdv_65a8bf5a-7b07-49d3-bb60-54d5b1686245/main/0.log" Jun 02 06:04:29.617929 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:29.617894 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nbsm2/must-gather-r6ktd"] Jun 02 06:04:29.618297 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:29.618271 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d5c86af-ea7d-4d4c-81da-608e51f88d3d" containerName="cleanup" Jun 02 06:04:29.618297 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:29.618283 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d5c86af-ea7d-4d4c-81da-608e51f88d3d" containerName="cleanup" Jun 02 06:04:29.618381 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:29.618349 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d5c86af-ea7d-4d4c-81da-608e51f88d3d" containerName="cleanup" Jun 02 06:04:29.621504 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:29.621486 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nbsm2/must-gather-r6ktd" Jun 02 06:04:29.626018 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:29.625993 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nbsm2\"/\"default-dockercfg-snjcw\"" Jun 02 06:04:29.626143 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:29.626126 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nbsm2\"/\"kube-root-ca.crt\"" Jun 02 06:04:29.637509 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:29.637489 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nbsm2\"/\"openshift-service-ca.crt\"" Jun 02 06:04:29.720964 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:29.720924 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nbsm2/must-gather-r6ktd"] Jun 02 06:04:29.758301 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:29.758269 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/983adb60-4888-4f35-8ea7-94afa40b14c5-must-gather-output\") pod \"must-gather-r6ktd\" (UID: \"983adb60-4888-4f35-8ea7-94afa40b14c5\") " pod="openshift-must-gather-nbsm2/must-gather-r6ktd" Jun 02 06:04:29.758481 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:29.758383 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvndj\" (UniqueName: \"kubernetes.io/projected/983adb60-4888-4f35-8ea7-94afa40b14c5-kube-api-access-tvndj\") pod \"must-gather-r6ktd\" (UID: \"983adb60-4888-4f35-8ea7-94afa40b14c5\") " pod="openshift-must-gather-nbsm2/must-gather-r6ktd" Jun 02 06:04:29.859766 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:29.859713 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tvndj\" (UniqueName: \"kubernetes.io/projected/983adb60-4888-4f35-8ea7-94afa40b14c5-kube-api-access-tvndj\") pod \"must-gather-r6ktd\" (UID: \"983adb60-4888-4f35-8ea7-94afa40b14c5\") " pod="openshift-must-gather-nbsm2/must-gather-r6ktd" Jun 02 06:04:29.859945 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:29.859822 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/983adb60-4888-4f35-8ea7-94afa40b14c5-must-gather-output\") pod \"must-gather-r6ktd\" (UID: \"983adb60-4888-4f35-8ea7-94afa40b14c5\") " pod="openshift-must-gather-nbsm2/must-gather-r6ktd" Jun 02 06:04:29.860243 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:29.860224 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/983adb60-4888-4f35-8ea7-94afa40b14c5-must-gather-output\") pod \"must-gather-r6ktd\" (UID: \"983adb60-4888-4f35-8ea7-94afa40b14c5\") " pod="openshift-must-gather-nbsm2/must-gather-r6ktd" Jun 02 06:04:29.882233 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:29.882163 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvndj\" (UniqueName: \"kubernetes.io/projected/983adb60-4888-4f35-8ea7-94afa40b14c5-kube-api-access-tvndj\") pod \"must-gather-r6ktd\" (UID: \"983adb60-4888-4f35-8ea7-94afa40b14c5\") " pod="openshift-must-gather-nbsm2/must-gather-r6ktd" Jun 02 06:04:29.930542 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:29.930493 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nbsm2/must-gather-r6ktd" Jun 02 06:04:30.102011 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:30.101977 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nbsm2/must-gather-r6ktd"] Jun 02 06:04:30.102783 ip-10-0-134-52 kubenswrapper[2575]: W0602 06:04:30.102756 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod983adb60_4888_4f35_8ea7_94afa40b14c5.slice/crio-5f6429d280ff7980b96ebf487d04c83a552611daec0a95c14731446796cc7c60 WatchSource:0}: Error finding container 5f6429d280ff7980b96ebf487d04c83a552611daec0a95c14731446796cc7c60: Status 404 returned error can't find the container with id 5f6429d280ff7980b96ebf487d04c83a552611daec0a95c14731446796cc7c60 Jun 02 06:04:30.104450 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:30.104433 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 06:04:30.436135 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:30.436097 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nbsm2/must-gather-r6ktd" event={"ID":"983adb60-4888-4f35-8ea7-94afa40b14c5","Type":"ContainerStarted","Data":"5f6429d280ff7980b96ebf487d04c83a552611daec0a95c14731446796cc7c60"} Jun 02 06:04:31.442993 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:31.442928 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nbsm2/must-gather-r6ktd" event={"ID":"983adb60-4888-4f35-8ea7-94afa40b14c5","Type":"ContainerStarted","Data":"cf7bc8b99b44ad3e466bb86abd258ec384ee4550f8bb201c20f05b2778f5e5d9"} Jun 02 06:04:31.442993 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:31.442985 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nbsm2/must-gather-r6ktd" event={"ID":"983adb60-4888-4f35-8ea7-94afa40b14c5","Type":"ContainerStarted","Data":"ee582392abf9dbf26e9e0ae904df00f5bf4ebb4fecba7d46286a585b9220f97b"} Jun 02 06:04:31.479670 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:31.479620 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-nbsm2/must-gather-r6ktd" podStartSLOduration=1.707507461 podStartE2EDuration="2.479604982s" podCreationTimestamp="2026-06-02 06:04:29 +0000 UTC" firstStartedPulling="2026-06-02 06:04:30.10456022 +0000 UTC m=+1108.236441091" lastFinishedPulling="2026-06-02 06:04:30.87665773 +0000 UTC m=+1109.008538612" observedRunningTime="2026-06-02 06:04:31.478549464 +0000 UTC m=+1109.610430356" watchObservedRunningTime="2026-06-02 06:04:31.479604982 +0000 UTC m=+1109.611485873" Jun 02 06:04:33.472144 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:33.472100 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-75wbj_b7658156-5f0e-4869-bab6-af9ab63b1c38/global-pull-secret-syncer/0.log" Jun 02 06:04:33.842988 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:33.842952 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6krts_4456caea-7bd5-49b4-9507-f27c71422e4c/konnectivity-agent/0.log" Jun 02 06:04:34.190027 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:34.189924 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-52.ec2.internal_56e29088026b32923ea613473ac85f0c/haproxy/0.log" Jun 02 06:04:37.826850 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:37.826813 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5454666cd4-gs4km_2c267dac-7838-429f-a7c5-fea59fb94fd8/authorino/0.log" Jun 02 06:04:37.952676 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:37.952645 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-nbtpw_37d4f7cb-7c83-46ce-9b19-f6a97658cd76/manager/0.log" Jun 02 06:04:38.192772 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:38.192655 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-5zcn8_8eb4d682-ea2f-4921-8db1-4a21868e214b/manager/0.log" Jun 02 06:04:38.267585 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:38.267554 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-dpr6w_68ae814d-d9a1-4725-9909-c7b70a423e33/limitador/0.log" Jun 02 06:04:40.669335 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:40.669299 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-bb4vk_fde930f7-b558-4514-8237-3682940dc954/kube-state-metrics/0.log" Jun 02 06:04:40.738660 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:40.738620 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-bb4vk_fde930f7-b558-4514-8237-3682940dc954/kube-rbac-proxy-main/0.log" Jun 02 06:04:40.821824 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:40.821778 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-bb4vk_fde930f7-b558-4514-8237-3682940dc954/kube-rbac-proxy-self/0.log" Jun 02 06:04:40.940944 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:40.940851 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-jll4k_fbe941d8-3d0e-49b1-882b-a3dc66d11662/monitoring-plugin/0.log" Jun 02 06:04:40.993873 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:40.993836 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7qq9s_03e42d09-6f83-4668-ad46-54e161e27e41/node-exporter/0.log" Jun 02 06:04:41.075013 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:41.074981 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7qq9s_03e42d09-6f83-4668-ad46-54e161e27e41/kube-rbac-proxy/0.log" Jun 02 06:04:41.250345 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:41.250260 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7qq9s_03e42d09-6f83-4668-ad46-54e161e27e41/init-textfile/0.log" Jun 02 06:04:42.045869 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.045836 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-r4md7_bd32cc7d-6828-45f7-91cc-9eac52479e40/kube-rbac-proxy-main/0.log" Jun 02 06:04:42.145744 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.145700 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-r4md7_bd32cc7d-6828-45f7-91cc-9eac52479e40/kube-rbac-proxy-self/0.log" Jun 02 06:04:42.212825 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.212790 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-r4md7_bd32cc7d-6828-45f7-91cc-9eac52479e40/openshift-state-metrics/0.log" Jun 02 06:04:42.310228 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.310197 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8f9dd3bc-c1c5-4251-8c23-e90f94cad43f/prometheus/0.log" Jun 02 06:04:42.379353 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.379315 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8f9dd3bc-c1c5-4251-8c23-e90f94cad43f/config-reloader/0.log" Jun 02 06:04:42.461364 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.461324 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8f9dd3bc-c1c5-4251-8c23-e90f94cad43f/thanos-sidecar/0.log" Jun 02 06:04:42.578604 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.578527 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8f9dd3bc-c1c5-4251-8c23-e90f94cad43f/kube-rbac-proxy-web/0.log" Jun 02 06:04:42.742421 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.742385 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nbsm2/perf-node-gather-daemonset-xp9n2"] Jun 02 06:04:42.749469 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.749442 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8f9dd3bc-c1c5-4251-8c23-e90f94cad43f/kube-rbac-proxy/0.log" Jun 02 06:04:42.750160 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.750139 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-xp9n2" Jun 02 06:04:42.782759 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.782700 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nbsm2/perf-node-gather-daemonset-xp9n2"] Jun 02 06:04:42.867348 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.867240 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8f9dd3bc-c1c5-4251-8c23-e90f94cad43f/kube-rbac-proxy-thanos/0.log" Jun 02 06:04:42.897047 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.897002 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/282de664-8f5b-411e-b3b8-b22c4e370a1c-lib-modules\") pod \"perf-node-gather-daemonset-xp9n2\" (UID: \"282de664-8f5b-411e-b3b8-b22c4e370a1c\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-xp9n2" Jun 02 06:04:42.897047 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.897045 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/282de664-8f5b-411e-b3b8-b22c4e370a1c-podres\") pod \"perf-node-gather-daemonset-xp9n2\" (UID: \"282de664-8f5b-411e-b3b8-b22c4e370a1c\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-xp9n2" Jun 02 06:04:42.897292 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.897125 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/282de664-8f5b-411e-b3b8-b22c4e370a1c-sys\") pod \"perf-node-gather-daemonset-xp9n2\" (UID: \"282de664-8f5b-411e-b3b8-b22c4e370a1c\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-xp9n2" Jun 02 06:04:42.897292 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.897164 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/282de664-8f5b-411e-b3b8-b22c4e370a1c-proc\") pod \"perf-node-gather-daemonset-xp9n2\" (UID: \"282de664-8f5b-411e-b3b8-b22c4e370a1c\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-xp9n2" Jun 02 06:04:42.897292 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.897189 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66gpg\" (UniqueName: \"kubernetes.io/projected/282de664-8f5b-411e-b3b8-b22c4e370a1c-kube-api-access-66gpg\") pod \"perf-node-gather-daemonset-xp9n2\" (UID: \"282de664-8f5b-411e-b3b8-b22c4e370a1c\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-xp9n2" Jun 02 06:04:42.973441 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.973412 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8f9dd3bc-c1c5-4251-8c23-e90f94cad43f/init-config-reloader/0.log" Jun 02 06:04:42.998605 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.998564 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/282de664-8f5b-411e-b3b8-b22c4e370a1c-lib-modules\") pod \"perf-node-gather-daemonset-xp9n2\" (UID: \"282de664-8f5b-411e-b3b8-b22c4e370a1c\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-xp9n2" Jun 02 06:04:42.998801 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.998615 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/282de664-8f5b-411e-b3b8-b22c4e370a1c-podres\") pod \"perf-node-gather-daemonset-xp9n2\" (UID: \"282de664-8f5b-411e-b3b8-b22c4e370a1c\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-xp9n2" Jun 02 06:04:42.998801 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.998705 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/282de664-8f5b-411e-b3b8-b22c4e370a1c-sys\") pod \"perf-node-gather-daemonset-xp9n2\" (UID: \"282de664-8f5b-411e-b3b8-b22c4e370a1c\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-xp9n2" Jun 02 06:04:42.998801 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.998779 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/282de664-8f5b-411e-b3b8-b22c4e370a1c-lib-modules\") pod \"perf-node-gather-daemonset-xp9n2\" (UID: \"282de664-8f5b-411e-b3b8-b22c4e370a1c\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-xp9n2" Jun 02 06:04:42.999129 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.998799 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/282de664-8f5b-411e-b3b8-b22c4e370a1c-sys\") pod \"perf-node-gather-daemonset-xp9n2\" (UID: \"282de664-8f5b-411e-b3b8-b22c4e370a1c\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-xp9n2" Jun 02 06:04:42.999129 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.998786 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/282de664-8f5b-411e-b3b8-b22c4e370a1c-proc\") pod \"perf-node-gather-daemonset-xp9n2\" (UID: \"282de664-8f5b-411e-b3b8-b22c4e370a1c\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-xp9n2" Jun 02 06:04:42.999129 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.998818 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/282de664-8f5b-411e-b3b8-b22c4e370a1c-podres\") pod \"perf-node-gather-daemonset-xp9n2\" (UID: \"282de664-8f5b-411e-b3b8-b22c4e370a1c\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-xp9n2" Jun 02 06:04:42.999129 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.998835 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/282de664-8f5b-411e-b3b8-b22c4e370a1c-proc\") pod \"perf-node-gather-daemonset-xp9n2\" (UID: \"282de664-8f5b-411e-b3b8-b22c4e370a1c\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-xp9n2" Jun 02 06:04:42.999129 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:42.998861 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-66gpg\" (UniqueName: \"kubernetes.io/projected/282de664-8f5b-411e-b3b8-b22c4e370a1c-kube-api-access-66gpg\") pod \"perf-node-gather-daemonset-xp9n2\" (UID: \"282de664-8f5b-411e-b3b8-b22c4e370a1c\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-xp9n2" Jun 02 06:04:43.012640 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:43.012603 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66gpg\" (UniqueName: \"kubernetes.io/projected/282de664-8f5b-411e-b3b8-b22c4e370a1c-kube-api-access-66gpg\") pod \"perf-node-gather-daemonset-xp9n2\" (UID: \"282de664-8f5b-411e-b3b8-b22c4e370a1c\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-xp9n2" Jun 02 06:04:43.060834 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:43.060795 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-xp9n2" Jun 02 06:04:43.080882 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:43.080849 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-gclmq_76f720f3-bf56-45b7-a757-b9e4e1dd377f/prometheus-operator/0.log" Jun 02 06:04:43.167348 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:43.167285 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-gclmq_76f720f3-bf56-45b7-a757-b9e4e1dd377f/kube-rbac-proxy/0.log" Jun 02 06:04:43.276635 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:43.276512 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-7bwpr_abda115b-298a-4390-ae97-aa3a722eaf73/prometheus-operator-admission-webhook/0.log" Jun 02 06:04:43.277413 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:43.277391 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nbsm2/perf-node-gather-daemonset-xp9n2"] Jun 02 06:04:43.280045 ip-10-0-134-52 kubenswrapper[2575]: W0602 06:04:43.280010 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod282de664_8f5b_411e_b3b8_b22c4e370a1c.slice/crio-a5234daa1db7f82c337bf0a127100c8f93979c0c52a4cd4b62683a31e3675575 WatchSource:0}: Error finding container a5234daa1db7f82c337bf0a127100c8f93979c0c52a4cd4b62683a31e3675575: Status 404 returned error can't find the container with id a5234daa1db7f82c337bf0a127100c8f93979c0c52a4cd4b62683a31e3675575 Jun 02 06:04:43.525705 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:43.525618 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-xp9n2" event={"ID":"282de664-8f5b-411e-b3b8-b22c4e370a1c","Type":"ContainerStarted","Data":"1aa73d90759053495d956a8d741c501b34c98c572819d8d0f016fee570adf834"} Jun 02 06:04:43.525705 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:43.525658 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-xp9n2" event={"ID":"282de664-8f5b-411e-b3b8-b22c4e370a1c","Type":"ContainerStarted","Data":"a5234daa1db7f82c337bf0a127100c8f93979c0c52a4cd4b62683a31e3675575"} Jun 02 06:04:43.526029 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:43.525770 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-xp9n2" Jun 02 06:04:43.572388 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:43.572318 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-xp9n2" podStartSLOduration=1.5722959429999999 podStartE2EDuration="1.572295943s" podCreationTimestamp="2026-06-02 06:04:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 06:04:43.569924058 +0000 UTC m=+1121.701804951" watchObservedRunningTime="2026-06-02 06:04:43.572295943 +0000 UTC m=+1121.704176836" Jun 02 06:04:43.685252 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:43.685212 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-798588557d-j2l74_01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b/thanos-query/0.log" Jun 02 06:04:43.756373 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:43.756336 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-798588557d-j2l74_01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b/kube-rbac-proxy-web/0.log" Jun 02 06:04:43.846337 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:43.846303 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-798588557d-j2l74_01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b/kube-rbac-proxy/0.log" Jun 02 06:04:43.911575 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:43.911550 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-798588557d-j2l74_01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b/prom-label-proxy/0.log" Jun 02 06:04:43.970759 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:43.970693 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-798588557d-j2l74_01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b/kube-rbac-proxy-rules/0.log" Jun 02 06:04:44.026052 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:44.026016 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-798588557d-j2l74_01a2ee2b-eb3d-4e01-87b4-c73d9e2e609b/kube-rbac-proxy-metrics/0.log" Jun 02 06:04:45.464422 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:45.464223 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-lfbgd_7656a0c7-fe16-4852-9f35-be1a8a3a2ffc/networking-console-plugin/0.log" Jun 02 06:04:46.508078 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:46.508034 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qqgq_b68ed6d7-9e23-4f45-a0fb-18ca25e28836/console-operator/2.log" Jun 02 06:04:46.516516 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:46.516485 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qqgq_b68ed6d7-9e23-4f45-a0fb-18ca25e28836/console-operator/3.log" Jun 02 06:04:48.151770 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:48.151741 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-w9kbp_7a099b02-5b14-41ce-9043-2381220fa89c/volume-data-source-validator/0.log" Jun 02 06:04:49.541225 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:49.541197 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-xp9n2" Jun 02 06:04:49.614584 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:49.614556 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tqr92_f0587da4-0df5-48c6-9df5-3b69cc457181/dns/0.log" Jun 02 06:04:49.690117 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:49.690089 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tqr92_f0587da4-0df5-48c6-9df5-3b69cc457181/kube-rbac-proxy/0.log" Jun 02 06:04:49.886615 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:49.886586 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zhf22_50b96b68-af8d-432e-ab2d-b682a7154685/dns-node-resolver/0.log" Jun 02 06:04:50.686999 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:50.686964 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c9qtg_ed81080d-7e5f-4b48-afc2-084a239754c3/node-ca/0.log" Jun 02 06:04:52.382400 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:52.382369 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d6fbd88fb-lk8hw_f15142ca-6fa0-4840-a708-52badee8efff/kube-auth-proxy/0.log" Jun 02 06:04:52.649595 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:52.649567 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bb468cc95-h6d4x_3c4d7e14-ce85-4a4a-b566-3afbab8fc451/router/0.log" Jun 02 06:04:53.585935 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:53.585908 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-758p5_3e1a7f6b-52e8-4248-b043-8248779a965a/serve-healthcheck-canary/0.log" Jun 02 06:04:55.167750 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:55.167696 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qq6tn_67cc0f8d-3ed2-4a60-a4b6-8ff3df258831/kube-rbac-proxy/0.log" Jun 02 06:04:55.225652 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:55.225562 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qq6tn_67cc0f8d-3ed2-4a60-a4b6-8ff3df258831/exporter/0.log" Jun 02 06:04:55.290273 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:55.290240 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qq6tn_67cc0f8d-3ed2-4a60-a4b6-8ff3df258831/extractor/0.log" Jun 02 06:04:58.391716 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:58.391686 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29673000-fqhtz_8d5c86af-ea7d-4d4c-81da-608e51f88d3d/cleanup/0.log" Jun 02 06:04:59.011060 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:59.011023 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74d9c7f795-njkbh_da47eba2-31e0-46fe-bda5-05a987883567/manager/0.log" Jun 02 06:04:59.107712 ip-10-0-134-52 kubenswrapper[2575]: I0602 06:04:59.107681 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74d9c7f795-njkbh_da47eba2-31e0-46fe-bda5-05a987883567/copy-manifests/0.log"