May 26 19:22:55.386359 ip-10-0-139-192 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 26 19:22:55.386372 ip-10-0-139-192 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 26 19:22:55.386378 ip-10-0-139-192 systemd[1]: kubelet.service: Failed with result 'resources'. May 26 19:22:55.386620 ip-10-0-139-192 systemd[1]: Failed to start Kubernetes Kubelet. May 26 19:23:05.567209 ip-10-0-139-192 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 26 19:23:05.567230 ip-10-0-139-192 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1749b605bfe84dee9ec86b0e9b752f84 -- May 26 19:25:35.313638 ip-10-0-139-192 systemd[1]: Starting Kubernetes Kubelet... May 26 19:25:35.888886 ip-10-0-139-192 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 19:25:35.888886 ip-10-0-139-192 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 26 19:25:35.888886 ip-10-0-139-192 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 19:25:35.888886 ip-10-0-139-192 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 26 19:25:35.888886 ip-10-0-139-192 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 19:25:35.890846 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.890742 2578 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 26 19:25:35.894413 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894399 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 19:25:35.894413 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894413 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 19:25:35.894474 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894417 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 19:25:35.894474 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894420 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 19:25:35.894474 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894423 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 19:25:35.894474 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894426 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 19:25:35.894474 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894430 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 19:25:35.894474 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894432 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 19:25:35.894474 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894435 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 19:25:35.894474 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894438 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 19:25:35.894474 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894441 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 19:25:35.894474 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894444 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 19:25:35.894474 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894454 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 19:25:35.894474 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894457 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 19:25:35.894474 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894460 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 19:25:35.894474 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894462 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 19:25:35.894474 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894465 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 19:25:35.894474 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894468 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 19:25:35.894474 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894470 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 19:25:35.894474 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894473 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 19:25:35.894474 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894476 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 19:25:35.894474 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894480 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 19:25:35.894951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894485 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 19:25:35.894951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894488 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 19:25:35.894951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894491 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 19:25:35.894951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894493 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 19:25:35.894951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894496 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 19:25:35.894951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894498 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 19:25:35.894951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894501 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 19:25:35.894951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894503 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 19:25:35.894951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894506 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 19:25:35.894951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894509 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 19:25:35.894951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894511 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 19:25:35.894951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894514 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 19:25:35.894951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894516 2578 feature_gate.go:328] unrecognized feature gate: Example2 May 26 19:25:35.894951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894519 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 19:25:35.894951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894521 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 19:25:35.894951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894523 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 19:25:35.894951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894526 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 19:25:35.894951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894528 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 19:25:35.894951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894531 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 19:25:35.894951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894533 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 19:25:35.895475 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894536 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 19:25:35.895475 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894538 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 19:25:35.895475 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894541 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 19:25:35.895475 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894544 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 19:25:35.895475 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894546 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 19:25:35.895475 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894549 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 19:25:35.895475 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894552 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 19:25:35.895475 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894554 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 19:25:35.895475 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894557 2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 19:25:35.895475 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894559 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 19:25:35.895475 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894562 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 19:25:35.895475 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894564 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 19:25:35.895475 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894568 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 19:25:35.895475 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894572 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 19:25:35.895475 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894575 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 19:25:35.895475 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894578 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 19:25:35.895475 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894581 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 19:25:35.895475 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894583 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 19:25:35.895475 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894586 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 19:25:35.895475 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894588 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 19:25:35.895951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894591 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 19:25:35.895951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894594 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 19:25:35.895951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894596 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 19:25:35.895951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894599 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 19:25:35.895951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894601 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 19:25:35.895951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894604 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 19:25:35.895951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894607 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 19:25:35.895951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894609 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 19:25:35.895951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894612 2578 feature_gate.go:328] unrecognized feature gate: Example May 26 19:25:35.895951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894615 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 19:25:35.895951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894617 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 19:25:35.895951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894620 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 19:25:35.895951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894623 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 19:25:35.895951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894625 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 19:25:35.895951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894629 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 19:25:35.895951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894633 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 19:25:35.895951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894636 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 19:25:35.895951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894639 2578 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 19:25:35.895951 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894642 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 19:25:35.896432 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894645 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 19:25:35.896432 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894647 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 19:25:35.896432 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894650 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 19:25:35.896432 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894654 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 19:25:35.896432 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.894657 2578 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 19:25:35.896432 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895025 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 19:25:35.896432 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895030 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 19:25:35.896432 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895033 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 19:25:35.896432 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895036 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 19:25:35.896432 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895039 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 19:25:35.896432 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895042 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 19:25:35.896432 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895045 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 19:25:35.896432 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895047 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 19:25:35.896432 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895050 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 19:25:35.896432 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895052 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 19:25:35.896432 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895055 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 19:25:35.896432 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895057 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 19:25:35.896432 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895060 2578 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 19:25:35.896432 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895063 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 19:25:35.896432 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895065 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 19:25:35.896908 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895067 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 19:25:35.896908 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895070 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 19:25:35.896908 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895073 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 19:25:35.896908 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895076 2578 feature_gate.go:328] unrecognized feature gate: Example2 May 26 19:25:35.896908 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895079 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 19:25:35.896908 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895082 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 19:25:35.896908 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895084 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 19:25:35.896908 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895087 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 19:25:35.896908 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895090 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 19:25:35.896908 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895093 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 19:25:35.896908 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895096 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 19:25:35.896908 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895098 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 19:25:35.896908 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895101 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 19:25:35.896908 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895104 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 19:25:35.896908 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895106 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 19:25:35.896908 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895109 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 19:25:35.896908 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895111 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 19:25:35.896908 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895114 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 19:25:35.896908 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895116 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 19:25:35.896908 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895119 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 19:25:35.897416 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895121 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 19:25:35.897416 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895124 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 19:25:35.897416 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895126 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 19:25:35.897416 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895129 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 19:25:35.897416 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895131 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 19:25:35.897416 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895134 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 19:25:35.897416 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895136 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 19:25:35.897416 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895139 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 19:25:35.897416 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895142 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 19:25:35.897416 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895144 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 19:25:35.897416 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895147 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 19:25:35.897416 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895150 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 19:25:35.897416 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895152 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 19:25:35.897416 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895155 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 19:25:35.897416 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895157 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 19:25:35.897416 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895160 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 19:25:35.897416 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895163 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 19:25:35.897416 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895165 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 19:25:35.897416 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895169 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 19:25:35.897933 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895173 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 19:25:35.897933 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895176 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 19:25:35.897933 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895179 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 19:25:35.897933 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895181 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 19:25:35.897933 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895184 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 19:25:35.897933 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895187 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 19:25:35.897933 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895189 2578 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 19:25:35.897933 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895192 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 19:25:35.897933 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895195 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 19:25:35.897933 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895197 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 19:25:35.897933 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895199 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 19:25:35.897933 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895202 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 19:25:35.897933 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895204 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 19:25:35.897933 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895208 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 19:25:35.897933 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895212 2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 19:25:35.897933 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895215 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 19:25:35.897933 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895217 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 19:25:35.897933 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895220 2578 feature_gate.go:328] unrecognized feature gate: Example May 26 19:25:35.897933 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895223 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 19:25:35.898415 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895226 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 19:25:35.898415 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895228 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 19:25:35.898415 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895231 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 19:25:35.898415 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895233 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 19:25:35.898415 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895240 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 19:25:35.898415 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895243 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 19:25:35.898415 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895245 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 19:25:35.898415 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895248 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 19:25:35.898415 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895250 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 19:25:35.898415 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895253 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 19:25:35.898415 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895255 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 19:25:35.898415 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895258 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 19:25:35.898415 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.895260 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 19:25:35.898415 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896125 2578 flags.go:64] FLAG: --address="0.0.0.0" May 26 19:25:35.898415 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896136 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 26 19:25:35.898415 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896143 2578 flags.go:64] FLAG: --anonymous-auth="true" May 26 19:25:35.898415 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896148 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" May 26 19:25:35.898415 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896153 2578 flags.go:64] FLAG: --authentication-token-webhook="false" May 26 19:25:35.898415 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896156 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 26 19:25:35.898415 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896161 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 26 19:25:35.898415 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896165 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 26 19:25:35.898948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896168 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 26 19:25:35.898948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896172 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 26 19:25:35.898948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896175 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 26 19:25:35.898948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896179 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 26 19:25:35.898948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896182 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 26 19:25:35.898948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896185 2578 flags.go:64] FLAG: --cgroup-root="" May 26 19:25:35.898948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896188 2578 flags.go:64] FLAG: --cgroups-per-qos="true" May 26 19:25:35.898948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896191 2578 flags.go:64] FLAG: --client-ca-file="" May 26 19:25:35.898948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896193 2578 flags.go:64] FLAG: --cloud-config="" May 26 19:25:35.898948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896196 2578 flags.go:64] FLAG: --cloud-provider="external" May 26 19:25:35.898948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896199 2578 flags.go:64] FLAG: --cluster-dns="[]" May 26 19:25:35.898948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896203 2578 flags.go:64] FLAG: --cluster-domain="" May 26 19:25:35.898948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896206 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 26 19:25:35.898948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896209 2578 flags.go:64] FLAG: --config-dir="" May 26 19:25:35.898948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896212 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 26 19:25:35.898948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896217 2578 flags.go:64] FLAG: --container-log-max-files="5" May 26 19:25:35.898948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896221 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" May 26 19:25:35.898948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896224 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 26 19:25:35.898948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896228 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 26 19:25:35.898948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896231 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 26 19:25:35.898948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896234 2578 flags.go:64] FLAG: --contention-profiling="false" May 26 19:25:35.898948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896237 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" May 26 19:25:35.898948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896240 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 26 19:25:35.898948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896243 2578 flags.go:64] FLAG: --cpu-manager-policy="none" May 26 19:25:35.898948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896246 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" May 26 19:25:35.899570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896252 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 26 19:25:35.899570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896255 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 26 19:25:35.899570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896258 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" May 26 19:25:35.899570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896261 2578 flags.go:64] FLAG: --enable-load-reader="false" May 26 19:25:35.899570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896265 2578 flags.go:64] FLAG: --enable-server="true" May 26 19:25:35.899570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896268 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 26 19:25:35.899570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896273 2578 flags.go:64] FLAG: --event-burst="100" May 26 19:25:35.899570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896276 2578 flags.go:64] FLAG: --event-qps="50" May 26 19:25:35.899570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896279 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 26 19:25:35.899570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896282 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 26 19:25:35.899570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896285 2578 flags.go:64] FLAG: --eviction-hard="" May 26 19:25:35.899570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896289 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 26 19:25:35.899570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896292 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 26 19:25:35.899570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896295 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 26 19:25:35.899570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896298 2578 flags.go:64] FLAG: --eviction-soft="" May 26 19:25:35.899570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896301 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" May 26 19:25:35.899570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896304 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" May 26 19:25:35.899570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896307 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 26 19:25:35.899570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896310 2578 flags.go:64] FLAG: --experimental-mounter-path="" May 26 19:25:35.899570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896313 2578 flags.go:64] FLAG: --fail-cgroupv1="false" May 26 19:25:35.899570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896316 2578 flags.go:64] FLAG: --fail-swap-on="true" May 26 19:25:35.899570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896331 2578 flags.go:64] FLAG: --feature-gates="" May 26 19:25:35.899570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896336 2578 flags.go:64] FLAG: --file-check-frequency="20s" May 26 19:25:35.899570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896340 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 26 19:25:35.899570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896343 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 26 19:25:35.900167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896346 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 26 19:25:35.900167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896349 2578 flags.go:64] FLAG: --healthz-port="10248" May 26 19:25:35.900167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896352 2578 flags.go:64] FLAG: --help="false" May 26 19:25:35.900167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896355 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-139-192.ec2.internal" May 26 19:25:35.900167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896358 2578 flags.go:64] FLAG: --housekeeping-interval="10s" May 26 19:25:35.900167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896361 2578 flags.go:64] FLAG: --http-check-frequency="20s" May 26 19:25:35.900167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896364 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 26 19:25:35.900167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896369 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 26 19:25:35.900167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896373 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" May 26 19:25:35.900167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896377 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" May 26 19:25:35.900167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896380 2578 flags.go:64] FLAG: --image-service-endpoint="" May 26 19:25:35.900167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896383 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" May 26 19:25:35.900167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896387 2578 flags.go:64] FLAG: --kube-api-burst="100" May 26 19:25:35.900167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896390 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 26 19:25:35.900167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896393 2578 flags.go:64] FLAG: --kube-api-qps="50" May 26 19:25:35.900167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896396 2578 flags.go:64] FLAG: --kube-reserved="" May 26 19:25:35.900167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896399 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" May 26 19:25:35.900167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896402 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 26 19:25:35.900167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896405 2578 flags.go:64] FLAG: --kubelet-cgroups="" May 26 19:25:35.900167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896408 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 26 19:25:35.900167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896411 2578 flags.go:64] FLAG: --lock-file="" May 26 19:25:35.900167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896414 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" May 26 19:25:35.900167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896417 2578 flags.go:64] FLAG: --log-flush-frequency="5s" May 26 19:25:35.900167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896420 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 26 19:25:35.900786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896425 2578 flags.go:64] FLAG: --log-json-split-stream="false" May 26 19:25:35.900786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896428 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 26 19:25:35.900786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896431 2578 flags.go:64] FLAG: --log-text-split-stream="false" May 26 19:25:35.900786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896434 2578 flags.go:64] FLAG: --logging-format="text" May 26 19:25:35.900786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896437 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 26 19:25:35.900786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896442 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" May 26 19:25:35.900786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896445 2578 flags.go:64] FLAG: --manifest-url="" May 26 19:25:35.900786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896448 2578 flags.go:64] FLAG: --manifest-url-header="" May 26 19:25:35.900786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896452 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 26 19:25:35.900786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896455 2578 flags.go:64] FLAG: --max-open-files="1000000" May 26 19:25:35.900786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896460 2578 flags.go:64] FLAG: --max-pods="110" May 26 19:25:35.900786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896462 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" May 26 19:25:35.900786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896466 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 26 19:25:35.900786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896469 2578 flags.go:64] FLAG: --memory-manager-policy="None" May 26 19:25:35.900786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896472 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 26 19:25:35.900786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896475 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 26 19:25:35.900786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896478 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" May 26 19:25:35.900786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896481 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 26 19:25:35.900786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896488 2578 flags.go:64] FLAG: --node-status-max-images="50" May 26 19:25:35.900786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896491 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" May 26 19:25:35.900786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896494 2578 flags.go:64] FLAG: --oom-score-adj="-999" May 26 19:25:35.900786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896498 2578 flags.go:64] FLAG: --pod-cidr="" May 26 19:25:35.900786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896501 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896506 2578 flags.go:64] FLAG: --pod-manifest-path="" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896509 2578 flags.go:64] FLAG: --pod-max-pids="-1" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896513 2578 flags.go:64] FLAG: --pods-per-core="0" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896515 2578 flags.go:64] FLAG: --port="10250" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896518 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896521 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00b4d9e1efb027533" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896524 2578 flags.go:64] FLAG: --qos-reserved="" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896527 2578 flags.go:64] FLAG: --read-only-port="10255" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896530 2578 flags.go:64] FLAG: --register-node="true" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896533 2578 flags.go:64] FLAG: --register-schedulable="true" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896537 2578 flags.go:64] FLAG: --register-with-taints="" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896540 2578 flags.go:64] FLAG: --registry-burst="10" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896543 2578 flags.go:64] FLAG: --registry-qps="5" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896545 2578 flags.go:64] FLAG: --reserved-cpus="" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896549 2578 flags.go:64] FLAG: --reserved-memory="" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896554 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896557 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896559 2578 flags.go:64] FLAG: --rotate-certificates="false" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896562 2578 flags.go:64] FLAG: --rotate-server-certificates="false" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896565 2578 flags.go:64] FLAG: --runonce="false" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896568 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896571 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896574 2578 flags.go:64] FLAG: --seccomp-default="false" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896578 2578 flags.go:64] FLAG: --serialize-image-pulls="true" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896580 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 26 19:25:35.901374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896583 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 26 19:25:35.902033 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896586 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 26 19:25:35.902033 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896589 2578 flags.go:64] FLAG: --storage-driver-password="root" May 26 19:25:35.902033 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896592 2578 flags.go:64] FLAG: --storage-driver-secure="false" May 26 19:25:35.902033 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896595 2578 flags.go:64] FLAG: --storage-driver-table="stats" May 26 19:25:35.902033 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896598 2578 flags.go:64] FLAG: --storage-driver-user="root" May 26 19:25:35.902033 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896601 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 26 19:25:35.902033 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896605 2578 flags.go:64] FLAG: --sync-frequency="1m0s" May 26 19:25:35.902033 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896608 2578 flags.go:64] FLAG: --system-cgroups="" May 26 19:25:35.902033 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896611 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 26 19:25:35.902033 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896616 2578 flags.go:64] FLAG: --system-reserved-cgroup="" May 26 19:25:35.902033 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896619 2578 flags.go:64] FLAG: --tls-cert-file="" May 26 19:25:35.902033 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896622 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" May 26 19:25:35.902033 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896625 2578 flags.go:64] FLAG: --tls-min-version="" May 26 19:25:35.902033 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896628 2578 flags.go:64] FLAG: --tls-private-key-file="" May 26 19:25:35.902033 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896631 2578 flags.go:64] FLAG: --topology-manager-policy="none" May 26 19:25:35.902033 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896634 2578 flags.go:64] FLAG: --topology-manager-policy-options="" May 26 19:25:35.902033 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896637 2578 flags.go:64] FLAG: --topology-manager-scope="container" May 26 19:25:35.902033 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896640 2578 flags.go:64] FLAG: --v="2" May 26 19:25:35.902033 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896644 2578 flags.go:64] FLAG: --version="false" May 26 19:25:35.902033 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896649 2578 flags.go:64] FLAG: --vmodule="" May 26 19:25:35.902033 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896653 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 26 19:25:35.902033 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.896658 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 26 19:25:35.902033 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896751 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 19:25:35.902033 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896755 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 19:25:35.902623 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896758 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 19:25:35.902623 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896761 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 19:25:35.902623 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896764 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 19:25:35.902623 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896767 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 19:25:35.902623 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896770 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 19:25:35.902623 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896773 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 19:25:35.902623 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896776 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 19:25:35.902623 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896779 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 19:25:35.902623 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896782 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 19:25:35.902623 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896784 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 19:25:35.902623 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896787 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 19:25:35.902623 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896790 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 19:25:35.902623 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896792 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 19:25:35.902623 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896795 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 19:25:35.902623 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896798 2578 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 19:25:35.902623 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896801 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 19:25:35.902623 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896803 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 19:25:35.902623 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896806 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 19:25:35.902623 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896808 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 19:25:35.903096 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896811 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 19:25:35.903096 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896814 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 19:25:35.903096 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896816 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 19:25:35.903096 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896819 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 19:25:35.903096 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896821 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 19:25:35.903096 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896824 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 19:25:35.903096 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896828 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 19:25:35.903096 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896831 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 19:25:35.903096 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896834 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 19:25:35.903096 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896837 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 19:25:35.903096 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896841 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 19:25:35.903096 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896844 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 19:25:35.903096 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896847 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 19:25:35.903096 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896850 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 19:25:35.903096 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896852 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 19:25:35.903096 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896855 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 19:25:35.903096 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896858 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 19:25:35.903096 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896860 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 19:25:35.903096 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896863 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 19:25:35.903650 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896866 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 19:25:35.903650 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896868 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 19:25:35.903650 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896871 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 19:25:35.903650 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896874 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 19:25:35.903650 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896876 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 19:25:35.903650 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896879 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 19:25:35.903650 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896881 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 19:25:35.903650 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896884 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 19:25:35.903650 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896886 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 19:25:35.903650 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896889 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 19:25:35.903650 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896892 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 19:25:35.903650 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896894 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 19:25:35.903650 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896897 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 19:25:35.903650 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896899 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 19:25:35.903650 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896902 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 19:25:35.903650 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896905 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 19:25:35.903650 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896907 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 19:25:35.903650 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896910 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 19:25:35.903650 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896913 2578 feature_gate.go:328] unrecognized feature gate: Example May 26 19:25:35.903650 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896915 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 19:25:35.904127 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896918 2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 19:25:35.904127 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896920 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 19:25:35.904127 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896923 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 19:25:35.904127 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896928 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 19:25:35.904127 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896931 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 19:25:35.904127 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896933 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 19:25:35.904127 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896936 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 19:25:35.904127 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896938 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 19:25:35.904127 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896941 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 19:25:35.904127 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896943 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 19:25:35.904127 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896947 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 19:25:35.904127 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896950 2578 feature_gate.go:328] unrecognized feature gate: Example2 May 26 19:25:35.904127 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896953 2578 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 19:25:35.904127 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896956 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 19:25:35.904127 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896958 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 19:25:35.904127 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896961 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 19:25:35.904127 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896964 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 19:25:35.904127 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896967 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 19:25:35.904127 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896969 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 19:25:35.904127 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896972 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 19:25:35.904645 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896974 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 19:25:35.904645 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896977 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 19:25:35.904645 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896980 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 19:25:35.904645 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896982 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 19:25:35.904645 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896985 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 19:25:35.904645 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.896987 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 19:25:35.904645 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.897599 2578 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 19:25:35.906641 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.906619 2578 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 26 19:25:35.906641 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.906639 2578 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 26 19:25:35.906767 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906686 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 19:25:35.906767 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906691 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 19:25:35.906767 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906694 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 19:25:35.906767 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906698 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 19:25:35.906767 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906701 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 19:25:35.906767 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906703 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 19:25:35.906767 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906706 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 19:25:35.906767 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906709 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 19:25:35.906767 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906711 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 19:25:35.906767 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906714 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 19:25:35.906767 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906717 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 19:25:35.906767 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906719 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 19:25:35.906767 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906722 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 19:25:35.906767 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906724 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 19:25:35.906767 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906727 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 19:25:35.906767 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906729 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 19:25:35.906767 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906732 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 19:25:35.906767 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906735 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 19:25:35.906767 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906737 2578 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 19:25:35.907290 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906740 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 19:25:35.907290 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906742 2578 feature_gate.go:328] unrecognized feature gate: Example May 26 19:25:35.907290 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906745 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 19:25:35.907290 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906749 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 19:25:35.907290 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906751 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 19:25:35.907290 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906754 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 19:25:35.907290 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906756 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 19:25:35.907290 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906759 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 19:25:35.907290 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906761 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 19:25:35.907290 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906764 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 19:25:35.907290 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906767 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 19:25:35.907290 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906769 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 19:25:35.907290 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906772 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 19:25:35.907290 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906775 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 19:25:35.907290 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906778 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 19:25:35.907290 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906781 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 19:25:35.907290 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906784 2578 feature_gate.go:328] unrecognized feature gate: Example2 May 26 19:25:35.907290 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906787 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 19:25:35.907290 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906789 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 19:25:35.907290 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906792 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 19:25:35.907798 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906794 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 19:25:35.907798 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906797 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 19:25:35.907798 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906799 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 19:25:35.907798 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906802 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 19:25:35.907798 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906804 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 19:25:35.907798 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906807 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 19:25:35.907798 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906809 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 19:25:35.907798 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906812 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 19:25:35.907798 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906815 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 19:25:35.907798 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906817 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 19:25:35.907798 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906820 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 19:25:35.907798 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906823 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 19:25:35.907798 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906825 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 19:25:35.907798 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906829 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 19:25:35.907798 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906832 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 19:25:35.907798 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906834 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 19:25:35.907798 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906837 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 19:25:35.907798 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906848 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 19:25:35.907798 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906851 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 19:25:35.907798 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906854 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 19:25:35.908289 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906857 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 19:25:35.908289 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906861 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 19:25:35.908289 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906866 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 19:25:35.908289 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906869 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 19:25:35.908289 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906872 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 19:25:35.908289 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906875 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 19:25:35.908289 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906879 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 19:25:35.908289 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906883 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 19:25:35.908289 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906886 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 19:25:35.908289 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906889 2578 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 19:25:35.908289 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906891 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 19:25:35.908289 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906894 2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 19:25:35.908289 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906896 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 19:25:35.908289 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906899 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 19:25:35.908289 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906901 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 19:25:35.908289 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906904 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 19:25:35.908289 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906906 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 19:25:35.908289 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906910 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 19:25:35.908289 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906913 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 19:25:35.908788 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906915 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 19:25:35.908788 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906918 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 19:25:35.908788 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906920 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 19:25:35.908788 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906923 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 19:25:35.908788 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906925 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 19:25:35.908788 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906928 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 19:25:35.908788 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906931 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 19:25:35.908788 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.906934 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 19:25:35.908788 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.906940 2578 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 19:25:35.908788 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907055 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 19:25:35.908788 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907061 2578 feature_gate.go:328] unrecognized feature gate: Example May 26 19:25:35.908788 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907065 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 19:25:35.908788 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907068 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 19:25:35.908788 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907070 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 19:25:35.908788 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907073 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 19:25:35.909159 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907076 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 19:25:35.909159 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907078 2578 feature_gate.go:328] unrecognized feature gate: Example2 May 26 19:25:35.909159 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907081 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 19:25:35.909159 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907084 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 19:25:35.909159 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907086 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 19:25:35.909159 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907089 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 19:25:35.909159 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907091 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 19:25:35.909159 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907094 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 19:25:35.909159 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907096 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 19:25:35.909159 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907099 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 19:25:35.909159 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907102 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 19:25:35.909159 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907104 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 19:25:35.909159 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907107 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 19:25:35.909159 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907110 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 19:25:35.909159 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907112 2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 19:25:35.909159 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907115 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 19:25:35.909159 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907118 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 19:25:35.909159 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907121 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 19:25:35.909159 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907123 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 19:25:35.909159 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907126 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 19:25:35.909671 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907129 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 19:25:35.909671 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907131 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 19:25:35.909671 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907134 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 19:25:35.909671 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907138 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 19:25:35.909671 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907142 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 19:25:35.909671 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907145 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 19:25:35.909671 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907148 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 19:25:35.909671 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907150 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 19:25:35.909671 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907153 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 19:25:35.909671 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907156 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 19:25:35.909671 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907158 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 19:25:35.909671 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907161 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 19:25:35.909671 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907163 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 19:25:35.909671 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907166 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 19:25:35.909671 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907168 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 19:25:35.909671 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907171 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 19:25:35.909671 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907173 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 19:25:35.909671 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907176 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 19:25:35.909671 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907178 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 19:25:35.910128 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907181 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 19:25:35.910128 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907183 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 19:25:35.910128 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907186 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 19:25:35.910128 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907188 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 19:25:35.910128 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907190 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 19:25:35.910128 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907193 2578 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 19:25:35.910128 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907196 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 19:25:35.910128 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907198 2578 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 19:25:35.910128 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907201 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 19:25:35.910128 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907204 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 19:25:35.910128 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907208 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 19:25:35.910128 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907211 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 19:25:35.910128 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907214 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 19:25:35.910128 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907217 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 19:25:35.910128 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907219 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 19:25:35.910128 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907222 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 19:25:35.910128 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907224 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 19:25:35.910128 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907227 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 19:25:35.910128 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907229 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 19:25:35.910128 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907231 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 19:25:35.910672 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907234 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 19:25:35.910672 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907236 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 19:25:35.910672 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907239 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 19:25:35.910672 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907241 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 19:25:35.910672 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907244 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 19:25:35.910672 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907246 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 19:25:35.910672 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907249 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 19:25:35.910672 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907251 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 19:25:35.910672 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907254 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 19:25:35.910672 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907256 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 19:25:35.910672 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907259 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 19:25:35.910672 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907261 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 19:25:35.910672 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907264 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 19:25:35.910672 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907266 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 19:25:35.910672 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907269 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 19:25:35.910672 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907271 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 19:25:35.910672 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907273 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 19:25:35.910672 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907276 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 19:25:35.910672 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907278 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 19:25:35.910672 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907281 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 19:25:35.911175 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:35.907284 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 19:25:35.911175 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.907288 2578 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 19:25:35.911175 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.908031 2578 server.go:962] "Client rotation is on, will bootstrap in background" May 26 19:25:35.911687 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.911674 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 26 19:25:35.912609 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.912599 2578 server.go:1019] "Starting client certificate rotation" May 26 19:25:35.912711 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.912694 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 26 19:25:35.912746 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.912736 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 26 19:25:35.938866 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.938834 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 26 19:25:35.941939 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.941919 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 26 19:25:35.954988 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.954969 2578 log.go:25] "Validated CRI v1 runtime API" May 26 19:25:35.960341 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.960316 2578 log.go:25] "Validated CRI v1 image API" May 26 19:25:35.961605 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.961590 2578 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 26 19:25:35.966953 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.966929 2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a16412e8-20f3-4113-bc84-5e4f6dd81988:/dev/nvme0n1p4 ad28e06c-ff41-462f-b16a-acabe0a9326c:/dev/nvme0n1p3] May 26 19:25:35.967018 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.966951 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 26 19:25:35.971838 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.971814 2578 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 26 19:25:35.973299 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.973198 2578 manager.go:217] Machine: {Timestamp:2026-05-26 19:25:35.972722304 +0000 UTC m=+0.506695079 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099969 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23a9f5acebe9498b8329ab816e3622 SystemUUID:ec23a9f5-aceb-e949-8b83-29ab816e3622 BootID:1749b605-bfe8-4dee-9ec8-6b0e9b752f84 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:51:f8:8c:1d:6d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:51:f8:8c:1d:6d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:82:aa:13:ea:9b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 26 19:25:35.973299 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.973294 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 26 19:25:35.973430 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.973410 2578 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 26 19:25:35.975066 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.975040 2578 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 26 19:25:35.975200 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.975069 2578 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-192.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 26 19:25:35.975249 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.975210 2578 topology_manager.go:138] "Creating topology manager with none policy" May 26 19:25:35.975249 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.975218 2578 container_manager_linux.go:306] "Creating device plugin manager" May 26 19:25:35.975249 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.975226 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 26 19:25:35.976115 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.976104 2578 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 26 19:25:35.977744 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.977734 2578 state_mem.go:36] "Initialized new in-memory state store" May 26 19:25:35.977852 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.977843 2578 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 26 19:25:35.981597 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.981586 2578 kubelet.go:491] "Attempting to sync node with API server" May 26 19:25:35.981639 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.981602 2578 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 26 19:25:35.981639 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.981617 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 26 19:25:35.981639 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.981626 2578 kubelet.go:397] "Adding apiserver pod source" May 26 19:25:35.981639 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.981636 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 26 19:25:35.982780 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.982769 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 26 19:25:35.982818 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.982787 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 26 19:25:35.987504 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.987488 2578 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 26 19:25:35.989257 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.989244 2578 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 26 19:25:35.990219 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.990198 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9rlq5" May 26 19:25:35.990279 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.990232 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 26 19:25:35.990279 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.990258 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 26 19:25:35.990279 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.990272 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 26 19:25:35.990279 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.990278 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 26 19:25:35.990411 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.990286 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 26 19:25:35.990411 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.990292 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 26 19:25:35.990411 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.990298 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 26 19:25:35.990411 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.990304 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 26 19:25:35.990411 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.990310 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 26 19:25:35.990411 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.990316 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 26 19:25:35.990411 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.990348 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 26 19:25:35.990589 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.990488 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 26 19:25:35.991369 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.991358 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 26 19:25:35.991369 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.991368 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 26 19:25:35.993478 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:35.993314 2578 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-192.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 26 19:25:35.993531 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:35.993315 2578 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 26 19:25:35.995423 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.995410 2578 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 26 19:25:35.995470 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.995451 2578 server.go:1295] "Started kubelet" May 26 19:25:35.995515 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.995449 2578 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-192.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 26 19:25:35.995645 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.995568 2578 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 26 19:25:35.995759 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.995727 2578 server_v1.go:47] "podresources" method="list" useActivePods=true May 26 19:25:35.996440 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.996417 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 26 19:25:35.996501 ip-10-0-139-192 systemd[1]: Started Kubernetes Kubelet. May 26 19:25:35.997807 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.997793 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9rlq5" May 26 19:25:35.999385 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.999354 2578 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 26 19:25:35.999471 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:35.999459 2578 server.go:317] "Adding debug handlers to kubelet server" May 26 19:25:36.002707 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:36.001882 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-192.ec2.internal.18b3341379e30f12 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-192.ec2.internal,UID:ip-10-0-139-192.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-192.ec2.internal,},FirstTimestamp:2026-05-26 19:25:35.99542453 +0000 UTC m=+0.529397308,LastTimestamp:2026-05-26 19:25:35.99542453 +0000 UTC m=+0.529397308,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-192.ec2.internal,}" May 26 19:25:36.005544 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.005527 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 26 19:25:36.005544 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.005539 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 26 19:25:36.005678 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.005620 2578 volume_manager.go:295] "The desired_state_of_world populator starts" May 26 19:25:36.005678 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.005633 2578 volume_manager.go:297] "Starting Kubelet Volume Manager" May 26 19:25:36.005763 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.005735 2578 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 26 19:25:36.005809 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.005771 2578 reconstruct.go:97] "Volume reconstruction finished" May 26 19:25:36.005809 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.005777 2578 reconciler.go:26] "Reconciler: start to sync state" May 26 19:25:36.007588 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.006783 2578 factory.go:55] Registering systemd factory May 26 19:25:36.007588 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.006797 2578 factory.go:223] Registration of the systemd container factory successfully May 26 19:25:36.007588 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:36.006993 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-192.ec2.internal\" not found" May 26 19:25:36.007588 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:36.007441 2578 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 26 19:25:36.008376 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.008315 2578 factory.go:153] Registering CRI-O factory May 26 19:25:36.008376 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.008366 2578 factory.go:223] Registration of the crio container factory successfully May 26 19:25:36.008514 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.008478 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 26 19:25:36.008514 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.008499 2578 factory.go:103] Registering Raw factory May 26 19:25:36.008514 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.008514 2578 manager.go:1196] Started watching for new ooms in manager May 26 19:25:36.010536 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.010512 2578 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 26 19:25:36.010879 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.010862 2578 manager.go:319] Starting recovery of all containers May 26 19:25:36.012565 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:36.012527 2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-192.ec2.internal\" not found" node="ip-10-0-139-192.ec2.internal" May 26 19:25:36.022444 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.022428 2578 manager.go:324] Recovery completed May 26 19:25:36.027066 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.027048 2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 19:25:36.028890 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.028877 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-192.ec2.internal" event="NodeHasSufficientMemory" May 26 19:25:36.028973 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.028911 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-192.ec2.internal" event="NodeHasNoDiskPressure" May 26 19:25:36.028973 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.028928 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-192.ec2.internal" event="NodeHasSufficientPID" May 26 19:25:36.029449 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.029435 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" May 26 19:25:36.029449 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.029447 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 26 19:25:36.029548 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.029468 2578 state_mem.go:36] "Initialized new in-memory state store" May 26 19:25:36.031726 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.031715 2578 policy_none.go:49] "None policy: Start" May 26 19:25:36.031771 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.031731 2578 memory_manager.go:186] "Starting memorymanager" policy="None" May 26 19:25:36.031771 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.031740 2578 state_mem.go:35] "Initializing new in-memory state store" May 26 19:25:36.065925 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.065907 2578 manager.go:341] "Starting Device Plugin manager" May 26 19:25:36.075905 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:36.065943 2578 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 26 19:25:36.075905 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.065953 2578 server.go:85] "Starting device plugin registration server" May 26 19:25:36.075905 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.066185 2578 eviction_manager.go:189] "Eviction manager: starting control loop" May 26 19:25:36.075905 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.066198 2578 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 26 19:25:36.075905 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.066300 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 26 19:25:36.075905 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.066401 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 26 19:25:36.075905 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.066412 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 26 19:25:36.075905 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:36.066908 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 26 19:25:36.075905 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:36.066938 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-192.ec2.internal\" not found" May 26 19:25:36.097242 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.097214 2578 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 26 19:25:36.098404 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.098383 2578 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 26 19:25:36.098481 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.098407 2578 status_manager.go:230] "Starting to sync pod status with apiserver" May 26 19:25:36.098481 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.098425 2578 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 26 19:25:36.098481 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.098433 2578 kubelet.go:2451] "Starting kubelet main sync loop" May 26 19:25:36.098481 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:36.098468 2578 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 26 19:25:36.100790 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.100771 2578 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 26 19:25:36.166959 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.166896 2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 19:25:36.167933 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.167917 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-192.ec2.internal" event="NodeHasSufficientMemory" May 26 19:25:36.168009 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.167947 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-192.ec2.internal" event="NodeHasNoDiskPressure" May 26 19:25:36.168009 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.167963 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-192.ec2.internal" event="NodeHasSufficientPID" May 26 19:25:36.168009 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.167990 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-192.ec2.internal" May 26 19:25:36.173660 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.173646 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-192.ec2.internal" May 26 19:25:36.173704 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:36.173668 2578 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-192.ec2.internal\": node \"ip-10-0-139-192.ec2.internal\" not found" May 26 19:25:36.187047 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:36.187030 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-192.ec2.internal\" not found" May 26 19:25:36.199056 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.199037 2578 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-192.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-192.ec2.internal"] May 26 19:25:36.199103 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.199096 2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 19:25:36.201352 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.201337 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-192.ec2.internal" event="NodeHasSufficientMemory" May 26 19:25:36.201410 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.201362 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-192.ec2.internal" event="NodeHasNoDiskPressure" May 26 19:25:36.201410 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.201373 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-192.ec2.internal" event="NodeHasSufficientPID" May 26 19:25:36.202624 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.202613 2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 19:25:36.202751 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.202739 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-192.ec2.internal" May 26 19:25:36.202785 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.202772 2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 19:25:36.203277 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.203257 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-192.ec2.internal" event="NodeHasSufficientMemory" May 26 19:25:36.203277 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.203258 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-192.ec2.internal" event="NodeHasSufficientMemory" May 26 19:25:36.203277 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.203277 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-192.ec2.internal" event="NodeHasNoDiskPressure" May 26 19:25:36.203424 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.203287 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-192.ec2.internal" event="NodeHasSufficientPID" May 26 19:25:36.203424 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.203303 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-192.ec2.internal" event="NodeHasNoDiskPressure" May 26 19:25:36.203424 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.203314 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-192.ec2.internal" event="NodeHasSufficientPID" May 26 19:25:36.204511 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.204499 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-192.ec2.internal" May 26 19:25:36.204562 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.204521 2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 19:25:36.205109 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.205087 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-192.ec2.internal" event="NodeHasSufficientMemory" May 26 19:25:36.205167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.205119 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-192.ec2.internal" event="NodeHasNoDiskPressure" May 26 19:25:36.205167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.205134 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-192.ec2.internal" event="NodeHasSufficientPID" May 26 19:25:36.207454 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.207436 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fc215021d39a93030cc522d33c5e6e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-192.ec2.internal\" (UID: \"3fc215021d39a93030cc522d33c5e6e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-192.ec2.internal" May 26 19:25:36.207515 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.207469 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9debf8db6ecc45306c3a0d95b6812bb8-config\") pod \"kube-apiserver-proxy-ip-10-0-139-192.ec2.internal\" (UID: \"9debf8db6ecc45306c3a0d95b6812bb8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-192.ec2.internal" May 26 19:25:36.207515 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.207494 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3fc215021d39a93030cc522d33c5e6e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-192.ec2.internal\" (UID: \"3fc215021d39a93030cc522d33c5e6e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-192.ec2.internal" May 26 19:25:36.232903 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:36.232881 2578 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-192.ec2.internal\" not found" node="ip-10-0-139-192.ec2.internal" May 26 19:25:36.237113 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:36.237098 2578 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-192.ec2.internal\" not found" node="ip-10-0-139-192.ec2.internal" May 26 19:25:36.287900 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:36.287878 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-192.ec2.internal\" not found" May 26 19:25:36.308054 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.307866 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9debf8db6ecc45306c3a0d95b6812bb8-config\") pod \"kube-apiserver-proxy-ip-10-0-139-192.ec2.internal\" (UID: \"9debf8db6ecc45306c3a0d95b6812bb8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-192.ec2.internal" May 26 19:25:36.308054 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.307956 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3fc215021d39a93030cc522d33c5e6e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-192.ec2.internal\" (UID: \"3fc215021d39a93030cc522d33c5e6e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-192.ec2.internal" May 26 19:25:36.308054 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.308019 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3fc215021d39a93030cc522d33c5e6e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-192.ec2.internal\" (UID: \"3fc215021d39a93030cc522d33c5e6e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-192.ec2.internal" May 26 19:25:36.308054 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.308046 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fc215021d39a93030cc522d33c5e6e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-192.ec2.internal\" (UID: \"3fc215021d39a93030cc522d33c5e6e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-192.ec2.internal" May 26 19:25:36.308296 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.308023 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9debf8db6ecc45306c3a0d95b6812bb8-config\") pod \"kube-apiserver-proxy-ip-10-0-139-192.ec2.internal\" (UID: \"9debf8db6ecc45306c3a0d95b6812bb8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-192.ec2.internal" May 26 19:25:36.308296 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.308115 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fc215021d39a93030cc522d33c5e6e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-192.ec2.internal\" (UID: \"3fc215021d39a93030cc522d33c5e6e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-192.ec2.internal" May 26 19:25:36.388232 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:36.388208 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-192.ec2.internal\" not found" May 26 19:25:36.489012 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:36.488944 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-192.ec2.internal\" not found" May 26 19:25:36.535395 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.535362 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-192.ec2.internal" May 26 19:25:36.540150 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.540133 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-192.ec2.internal" May 26 19:25:36.589777 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:36.589751 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-192.ec2.internal\" not found" May 26 19:25:36.690181 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:36.690148 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-192.ec2.internal\" not found" May 26 19:25:36.790656 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:36.790593 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-192.ec2.internal\" not found" May 26 19:25:36.891176 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:36.891148 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-192.ec2.internal\" not found" May 26 19:25:36.912521 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.912502 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 26 19:25:36.912653 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.912634 2578 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 26 19:25:36.912710 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.912684 2578 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 26 19:25:36.966599 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:36.966573 2578 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 26 19:25:36.991822 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:36.991792 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-192.ec2.internal\" not found" May 26 19:25:37.001029 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:37.000999 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 19:20:35 +0000 UTC" deadline="2027-11-07 04:00:34.101176499 +0000 UTC" May 26 19:25:37.001029 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:37.001025 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12704h34m57.10015342s" May 26 19:25:37.006367 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:37.006343 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 26 19:25:37.017503 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:37.017484 2578 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 26 19:25:37.035238 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:37.035217 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fz622" May 26 19:25:37.043040 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:37.042998 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fz622" May 26 19:25:37.085453 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:37.085425 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9debf8db6ecc45306c3a0d95b6812bb8.slice/crio-61f24bd8babbd39a278c759ffd7cefd77ff21aaf1b05ef0b086f5247e2949ed4 WatchSource:0}: Error finding container 61f24bd8babbd39a278c759ffd7cefd77ff21aaf1b05ef0b086f5247e2949ed4: Status 404 returned error can't find the container with id 61f24bd8babbd39a278c759ffd7cefd77ff21aaf1b05ef0b086f5247e2949ed4 May 26 19:25:37.085594 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:37.085577 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fc215021d39a93030cc522d33c5e6e8.slice/crio-d09412070b6e44ad68ef2002a283643ddd2cfb8cee76a6ddf9cd724ee2f583bc WatchSource:0}: Error finding container d09412070b6e44ad68ef2002a283643ddd2cfb8cee76a6ddf9cd724ee2f583bc: Status 404 returned error can't find the container with id d09412070b6e44ad68ef2002a283643ddd2cfb8cee76a6ddf9cd724ee2f583bc May 26 19:25:37.089837 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:37.089820 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 19:25:37.092112 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:37.092095 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-192.ec2.internal\" not found" May 26 19:25:37.101727 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:37.101690 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-192.ec2.internal" event={"ID":"3fc215021d39a93030cc522d33c5e6e8","Type":"ContainerStarted","Data":"d09412070b6e44ad68ef2002a283643ddd2cfb8cee76a6ddf9cd724ee2f583bc"} May 26 19:25:37.102635 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:37.102614 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-192.ec2.internal" event={"ID":"9debf8db6ecc45306c3a0d95b6812bb8","Type":"ContainerStarted","Data":"61f24bd8babbd39a278c759ffd7cefd77ff21aaf1b05ef0b086f5247e2949ed4"} May 26 19:25:37.193103 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:37.193074 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-192.ec2.internal\" not found" May 26 19:25:37.293592 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:37.293523 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-192.ec2.internal\" not found" May 26 19:25:37.394041 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:37.394010 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-192.ec2.internal\" not found" May 26 19:25:37.494845 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:37.494805 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-192.ec2.internal\" not found" May 26 19:25:37.561060 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:37.560987 2578 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 26 19:25:37.606355 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:37.606331 2578 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-192.ec2.internal" May 26 19:25:37.617472 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:37.617444 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 26 19:25:37.618734 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:37.618713 2578 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-192.ec2.internal" May 26 19:25:37.627176 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:37.627156 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 26 19:25:37.982757 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:37.982681 2578 apiserver.go:52] "Watching apiserver" May 26 19:25:37.994952 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:37.994924 2578 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 26 19:25:37.995311 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:37.995279 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-wtj5c","openshift-multus/network-metrics-daemon-qsdsm","openshift-network-diagnostics/network-check-target-87j6z","kube-system/kube-apiserver-proxy-ip-10-0-139-192.ec2.internal","openshift-cluster-node-tuning-operator/tuned-pqc8t","openshift-multus/multus-nft6f","openshift-network-operator/iptables-alerter-mh9ns","openshift-ovn-kubernetes/ovnkube-node-k89dv","kube-system/konnectivity-agent-84vtm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx","openshift-dns/node-resolver-ggpg7","openshift-image-registry/node-ca-bjdfl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-192.ec2.internal"] May 26 19:25:37.996776 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:37.996755 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" May 26 19:25:37.997892 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:37.997872 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:25:37.997984 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:37.997953 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qsdsm" podUID="6ee8f53e-5d8f-4944-89c4-ed98b8fad590" May 26 19:25:37.999024 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:37.998827 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:25:37.999112 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:37.999086 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87j6z" podUID="4e8c295a-8845-4441-b1b8-6acb0b485589" May 26 19:25:37.999316 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:37.999287 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 26 19:25:37.999316 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:37.999296 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 26 19:25:37.999541 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:37.999521 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jlfr9\"" May 26 19:25:37.999613 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:37.999554 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 26 19:25:37.999997 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:37.999974 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.002621 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.002287 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nft6f" May 26 19:25:38.002621 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.002376 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mh9ns" May 26 19:25:38.002962 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.002944 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 26 19:25:38.003379 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.003001 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-n4t4n\"" May 26 19:25:38.003488 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.003468 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 26 19:25:38.004533 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.003904 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.005402 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.005142 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5gmpn\"" May 26 19:25:38.005402 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.005163 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 26 19:25:38.005527 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.005411 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 26 19:25:38.005907 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.005886 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 26 19:25:38.005993 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.005890 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 26 19:25:38.005993 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.005950 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-84vtm" May 26 19:25:38.006480 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.006232 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 26 19:25:38.006480 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.006414 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 26 19:25:38.007044 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.007023 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 26 19:25:38.007404 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.007379 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 26 19:25:38.007857 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.007760 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.009030 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.008575 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 26 19:25:38.009030 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.008720 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 26 19:25:38.009030 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.008814 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 26 19:25:38.009030 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.008861 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 26 19:25:38.009030 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.008925 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 26 19:25:38.009337 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.009113 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7lnj4\"" May 26 19:25:38.009337 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.009146 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k9wkb\"" May 26 19:25:38.009337 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.009203 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 26 19:25:38.009337 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.009243 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 26 19:25:38.009531 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.009348 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lgx9m\"" May 26 19:25:38.009828 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.009814 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ggpg7" May 26 19:25:38.011248 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.010936 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 26 19:25:38.011248 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.010967 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pff4h\"" May 26 19:25:38.011248 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.011024 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bjdfl" May 26 19:25:38.011248 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.011044 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 26 19:25:38.012099 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.012082 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 26 19:25:38.012306 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.012286 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 26 19:25:38.012575 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.012485 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-djll7\"" May 26 19:25:38.013393 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.013314 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 26 19:25:38.013760 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.013735 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 26 19:25:38.013844 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.013737 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 26 19:25:38.013844 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.013772 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lpjbr\"" May 26 19:25:38.016703 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.016681 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-os-release\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.016803 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.016713 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-multus-socket-dir-parent\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.016803 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.016745 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-host-run-netns\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.016803 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.016761 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-host-slash\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.016803 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.016777 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-host-run-netns\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.017000 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.016821 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-etc-openvswitch\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.017000 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.016845 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-ovn-node-metrics-cert\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.017000 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.016866 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10c865c8-5b1a-4a48-8c45-2155cbdb8323-socket-dir\") pod \"aws-ebs-csi-driver-node-29hbx\" (UID: \"10c865c8-5b1a-4a48-8c45-2155cbdb8323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" May 26 19:25:38.017000 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.016907 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-etc-systemd\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.017000 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.016933 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-system-cni-dir\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.017000 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.016955 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-etc-kubernetes\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.017000 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.016973 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-var-lib-openvswitch\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.017000 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.016988 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-host-cni-bin\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.017397 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017005 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1cdc1bc5-00d9-435b-b4da-1c5352befce9-cni-binary-copy\") pod \"multus-additional-cni-plugins-wtj5c\" (UID: \"1cdc1bc5-00d9-435b-b4da-1c5352befce9\") " pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.017397 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017027 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1cdc1bc5-00d9-435b-b4da-1c5352befce9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wtj5c\" (UID: \"1cdc1bc5-00d9-435b-b4da-1c5352befce9\") " pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.017397 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017051 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljxwh\" (UniqueName: \"kubernetes.io/projected/1cdc1bc5-00d9-435b-b4da-1c5352befce9-kube-api-access-ljxwh\") pod \"multus-additional-cni-plugins-wtj5c\" (UID: \"1cdc1bc5-00d9-435b-b4da-1c5352befce9\") " pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.017397 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017072 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-cnibin\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.017397 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017101 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-host-kubelet\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.017397 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017128 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10c865c8-5b1a-4a48-8c45-2155cbdb8323-registration-dir\") pod \"aws-ebs-csi-driver-node-29hbx\" (UID: \"10c865c8-5b1a-4a48-8c45-2155cbdb8323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" May 26 19:25:38.017397 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017149 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10c865c8-5b1a-4a48-8c45-2155cbdb8323-etc-selinux\") pod \"aws-ebs-csi-driver-node-29hbx\" (UID: \"10c865c8-5b1a-4a48-8c45-2155cbdb8323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" May 26 19:25:38.017397 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017164 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-etc-kubernetes\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.017397 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017178 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-run\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.017397 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017193 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-host-var-lib-kubelet\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.017397 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017217 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-host-cni-netd\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.017397 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017233 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-ovnkube-config\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.017397 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017255 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c43aa978-84ce-44cf-925a-d7fca81bae38-agent-certs\") pod \"konnectivity-agent-84vtm\" (UID: \"c43aa978-84ce-44cf-925a-d7fca81bae38\") " pod="kube-system/konnectivity-agent-84vtm" May 26 19:25:38.017397 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017289 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-host-var-lib-cni-multus\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.017397 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017356 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1cdc1bc5-00d9-435b-b4da-1c5352befce9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wtj5c\" (UID: \"1cdc1bc5-00d9-435b-b4da-1c5352befce9\") " pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.017397 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017395 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10c865c8-5b1a-4a48-8c45-2155cbdb8323-sys-fs\") pod \"aws-ebs-csi-driver-node-29hbx\" (UID: \"10c865c8-5b1a-4a48-8c45-2155cbdb8323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" May 26 19:25:38.018063 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017419 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-lib-modules\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.018063 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017444 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-node-log\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.018063 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017492 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1cdc1bc5-00d9-435b-b4da-1c5352befce9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wtj5c\" (UID: \"1cdc1bc5-00d9-435b-b4da-1c5352befce9\") " pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.018063 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017541 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-host\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.018063 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017573 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-host-run-k8s-cni-cncf-io\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.018063 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017614 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-systemd-units\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.018063 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017641 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10c865c8-5b1a-4a48-8c45-2155cbdb8323-device-dir\") pod \"aws-ebs-csi-driver-node-29hbx\" (UID: \"10c865c8-5b1a-4a48-8c45-2155cbdb8323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" May 26 19:25:38.018063 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017665 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-host-run-multus-certs\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.018063 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017704 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-env-overrides\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.018063 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017727 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffpmv\" (UniqueName: \"kubernetes.io/projected/d328c544-5589-4537-81b6-f5caf93f3903-kube-api-access-ffpmv\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.018063 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017751 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5b3e373a-26db-42d4-ae8b-08576159277d-multus-daemon-config\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.018063 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017793 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26ba334e-48a4-4886-bcde-21f01d18ec12-host-slash\") pod \"iptables-alerter-mh9ns\" (UID: \"26ba334e-48a4-4886-bcde-21f01d18ec12\") " pod="openshift-network-operator/iptables-alerter-mh9ns" May 26 19:25:38.018063 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017815 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c43aa978-84ce-44cf-925a-d7fca81bae38-konnectivity-ca\") pod \"konnectivity-agent-84vtm\" (UID: \"c43aa978-84ce-44cf-925a-d7fca81bae38\") " pod="kube-system/konnectivity-agent-84vtm" May 26 19:25:38.018063 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017837 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs\") pod \"network-metrics-daemon-qsdsm\" (UID: \"6ee8f53e-5d8f-4944-89c4-ed98b8fad590\") " pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:25:38.018063 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017857 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-etc-modprobe-d\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.018063 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017883 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-multus-conf-dir\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.018802 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017907 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-etc-sysctl-d\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.018802 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017920 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d328c544-5589-4537-81b6-f5caf93f3903-tmp\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.018802 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017941 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/26ba334e-48a4-4886-bcde-21f01d18ec12-iptables-alerter-script\") pod \"iptables-alerter-mh9ns\" (UID: \"26ba334e-48a4-4886-bcde-21f01d18ec12\") " pod="openshift-network-operator/iptables-alerter-mh9ns" May 26 19:25:38.018802 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.017973 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-run-openvswitch\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.018802 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.018001 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-ovnkube-script-lib\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.018802 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.018024 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1cdc1bc5-00d9-435b-b4da-1c5352befce9-cnibin\") pod \"multus-additional-cni-plugins-wtj5c\" (UID: \"1cdc1bc5-00d9-435b-b4da-1c5352befce9\") " pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.018802 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.018051 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlnlq\" (UniqueName: \"kubernetes.io/projected/4e8c295a-8845-4441-b1b8-6acb0b485589-kube-api-access-mlnlq\") pod \"network-check-target-87j6z\" (UID: \"4e8c295a-8845-4441-b1b8-6acb0b485589\") " pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:25:38.018802 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.018074 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-etc-sysconfig\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.018802 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.018096 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-multus-cni-dir\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.018802 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.018118 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b3e373a-26db-42d4-ae8b-08576159277d-cni-binary-copy\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.018802 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.018146 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-host-var-lib-cni-bin\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.018802 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.018195 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-hostroot\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.018802 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.018237 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-log-socket\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.018802 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.018270 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.018802 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.018300 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cdc1bc5-00d9-435b-b4da-1c5352befce9-system-cni-dir\") pod \"multus-additional-cni-plugins-wtj5c\" (UID: \"1cdc1bc5-00d9-435b-b4da-1c5352befce9\") " pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.018802 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.018347 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xzvc\" (UniqueName: \"kubernetes.io/projected/10c865c8-5b1a-4a48-8c45-2155cbdb8323-kube-api-access-7xzvc\") pod \"aws-ebs-csi-driver-node-29hbx\" (UID: \"10c865c8-5b1a-4a48-8c45-2155cbdb8323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" May 26 19:25:38.019612 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.018382 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-run-systemd\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.019612 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.018407 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xtm6\" (UniqueName: \"kubernetes.io/projected/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-kube-api-access-9xtm6\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.019612 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.018433 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tnmd\" (UniqueName: \"kubernetes.io/projected/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-kube-api-access-7tnmd\") pod \"network-metrics-daemon-qsdsm\" (UID: \"6ee8f53e-5d8f-4944-89c4-ed98b8fad590\") " pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:25:38.019612 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.018456 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-etc-sysctl-conf\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.019612 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.018480 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d328c544-5589-4537-81b6-f5caf93f3903-etc-tuned\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.019612 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.018502 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9nm8\" (UniqueName: \"kubernetes.io/projected/5b3e373a-26db-42d4-ae8b-08576159277d-kube-api-access-l9nm8\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.019612 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.018540 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm5tf\" (UniqueName: \"kubernetes.io/projected/26ba334e-48a4-4886-bcde-21f01d18ec12-kube-api-access-lm5tf\") pod \"iptables-alerter-mh9ns\" (UID: \"26ba334e-48a4-4886-bcde-21f01d18ec12\") " pod="openshift-network-operator/iptables-alerter-mh9ns" May 26 19:25:38.019612 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.018574 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-host-run-ovn-kubernetes\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.019612 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.018604 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1cdc1bc5-00d9-435b-b4da-1c5352befce9-os-release\") pod \"multus-additional-cni-plugins-wtj5c\" (UID: \"1cdc1bc5-00d9-435b-b4da-1c5352befce9\") " pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.019612 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.018633 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-sys\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.019612 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.018658 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-run-ovn\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.019612 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.018682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10c865c8-5b1a-4a48-8c45-2155cbdb8323-kubelet-dir\") pod \"aws-ebs-csi-driver-node-29hbx\" (UID: \"10c865c8-5b1a-4a48-8c45-2155cbdb8323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" May 26 19:25:38.019612 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.018707 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-var-lib-kubelet\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.044426 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.044388 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 19:20:37 +0000 UTC" deadline="2028-02-22 20:04:51.25823872 +0000 UTC" May 26 19:25:38.044426 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.044418 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15288h39m13.21382537s" May 26 19:25:38.106545 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.106520 2578 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 26 19:25:38.119196 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119169 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l9nm8\" (UniqueName: \"kubernetes.io/projected/5b3e373a-26db-42d4-ae8b-08576159277d-kube-api-access-l9nm8\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.119362 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119203 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lm5tf\" (UniqueName: \"kubernetes.io/projected/26ba334e-48a4-4886-bcde-21f01d18ec12-kube-api-access-lm5tf\") pod \"iptables-alerter-mh9ns\" (UID: \"26ba334e-48a4-4886-bcde-21f01d18ec12\") " pod="openshift-network-operator/iptables-alerter-mh9ns" May 26 19:25:38.119362 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119224 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-host-run-ovn-kubernetes\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.119478 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119368 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1cdc1bc5-00d9-435b-b4da-1c5352befce9-os-release\") pod \"multus-additional-cni-plugins-wtj5c\" (UID: \"1cdc1bc5-00d9-435b-b4da-1c5352befce9\") " pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.119478 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119405 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-sys\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.119478 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119433 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-run-ovn\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.119478 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119457 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-host-run-ovn-kubernetes\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.119478 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119473 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10c865c8-5b1a-4a48-8c45-2155cbdb8323-kubelet-dir\") pod \"aws-ebs-csi-driver-node-29hbx\" (UID: \"10c865c8-5b1a-4a48-8c45-2155cbdb8323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" May 26 19:25:38.119708 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119499 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1cdc1bc5-00d9-435b-b4da-1c5352befce9-os-release\") pod \"multus-additional-cni-plugins-wtj5c\" (UID: \"1cdc1bc5-00d9-435b-b4da-1c5352befce9\") " pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.119708 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119480 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-run-ovn\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.119708 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119507 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-var-lib-kubelet\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.119708 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119527 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-sys\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.119708 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119516 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10c865c8-5b1a-4a48-8c45-2155cbdb8323-kubelet-dir\") pod \"aws-ebs-csi-driver-node-29hbx\" (UID: \"10c865c8-5b1a-4a48-8c45-2155cbdb8323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" May 26 19:25:38.119708 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119558 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-os-release\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.119708 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119564 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-var-lib-kubelet\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.119708 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119586 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-multus-socket-dir-parent\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.119708 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119612 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-host-run-netns\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.119708 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119626 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-os-release\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.119708 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119640 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-host-slash\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.119708 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119646 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-host-run-netns\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.119708 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119661 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-host-run-netns\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.119708 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119661 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-multus-socket-dir-parent\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.119708 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119678 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/582de6bd-0ed1-4a29-b96e-f8825f9df04f-host\") pod \"node-ca-bjdfl\" (UID: \"582de6bd-0ed1-4a29-b96e-f8825f9df04f\") " pod="openshift-image-registry/node-ca-bjdfl" May 26 19:25:38.119708 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119679 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-host-slash\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.119708 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119705 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-host-run-netns\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.119708 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119713 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-etc-openvswitch\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.120545 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119740 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-ovn-node-metrics-cert\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.120545 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119767 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10c865c8-5b1a-4a48-8c45-2155cbdb8323-socket-dir\") pod \"aws-ebs-csi-driver-node-29hbx\" (UID: \"10c865c8-5b1a-4a48-8c45-2155cbdb8323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" May 26 19:25:38.120545 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119784 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-etc-openvswitch\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.120545 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119790 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-etc-systemd\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.120545 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119818 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-system-cni-dir\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.120545 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119842 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-etc-kubernetes\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.120545 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119865 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-var-lib-openvswitch\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.120545 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119891 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-host-cni-bin\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.120545 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119915 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1cdc1bc5-00d9-435b-b4da-1c5352befce9-cni-binary-copy\") pod \"multus-additional-cni-plugins-wtj5c\" (UID: \"1cdc1bc5-00d9-435b-b4da-1c5352befce9\") " pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.120545 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119942 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1cdc1bc5-00d9-435b-b4da-1c5352befce9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wtj5c\" (UID: \"1cdc1bc5-00d9-435b-b4da-1c5352befce9\") " pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.120545 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119969 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ljxwh\" (UniqueName: \"kubernetes.io/projected/1cdc1bc5-00d9-435b-b4da-1c5352befce9-kube-api-access-ljxwh\") pod \"multus-additional-cni-plugins-wtj5c\" (UID: \"1cdc1bc5-00d9-435b-b4da-1c5352befce9\") " pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.120545 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.119994 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-cnibin\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.120545 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120018 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-host-kubelet\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.120545 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120044 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10c865c8-5b1a-4a48-8c45-2155cbdb8323-registration-dir\") pod \"aws-ebs-csi-driver-node-29hbx\" (UID: \"10c865c8-5b1a-4a48-8c45-2155cbdb8323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" May 26 19:25:38.120545 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120069 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10c865c8-5b1a-4a48-8c45-2155cbdb8323-etc-selinux\") pod \"aws-ebs-csi-driver-node-29hbx\" (UID: \"10c865c8-5b1a-4a48-8c45-2155cbdb8323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" May 26 19:25:38.120545 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120090 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-host-cni-bin\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.120545 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120094 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-etc-kubernetes\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.121335 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120107 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 26 19:25:38.121335 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120120 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-run\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.121335 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120179 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10c865c8-5b1a-4a48-8c45-2155cbdb8323-socket-dir\") pod \"aws-ebs-csi-driver-node-29hbx\" (UID: \"10c865c8-5b1a-4a48-8c45-2155cbdb8323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" May 26 19:25:38.121335 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120178 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20a5cc5f-5de0-4de6-802a-cf1bcb303748-tmp-dir\") pod \"node-resolver-ggpg7\" (UID: \"20a5cc5f-5de0-4de6-802a-cf1bcb303748\") " pod="openshift-dns/node-resolver-ggpg7" May 26 19:25:38.121335 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120211 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-etc-systemd\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.121335 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120210 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-host-var-lib-kubelet\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.121335 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120236 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-host-cni-netd\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.121335 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120249 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-host-var-lib-kubelet\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.121335 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120252 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-ovnkube-config\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.121335 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120288 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c43aa978-84ce-44cf-925a-d7fca81bae38-agent-certs\") pod \"konnectivity-agent-84vtm\" (UID: \"c43aa978-84ce-44cf-925a-d7fca81bae38\") " pod="kube-system/konnectivity-agent-84vtm" May 26 19:25:38.121335 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120315 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-host-var-lib-cni-multus\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.121335 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120361 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1cdc1bc5-00d9-435b-b4da-1c5352befce9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wtj5c\" (UID: \"1cdc1bc5-00d9-435b-b4da-1c5352befce9\") " pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.121335 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120386 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10c865c8-5b1a-4a48-8c45-2155cbdb8323-sys-fs\") pod \"aws-ebs-csi-driver-node-29hbx\" (UID: \"10c865c8-5b1a-4a48-8c45-2155cbdb8323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" May 26 19:25:38.121335 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120411 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-lib-modules\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.121335 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120436 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-etc-kubernetes\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.121335 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120440 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49zbk\" (UniqueName: \"kubernetes.io/projected/582de6bd-0ed1-4a29-b96e-f8825f9df04f-kube-api-access-49zbk\") pod \"node-ca-bjdfl\" (UID: \"582de6bd-0ed1-4a29-b96e-f8825f9df04f\") " pod="openshift-image-registry/node-ca-bjdfl" May 26 19:25:38.121335 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120485 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-node-log\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.121335 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120485 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-system-cni-dir\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.122141 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120510 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-run\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.122141 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120518 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1cdc1bc5-00d9-435b-b4da-1c5352befce9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wtj5c\" (UID: \"1cdc1bc5-00d9-435b-b4da-1c5352befce9\") " pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.122141 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120441 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-var-lib-openvswitch\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.122141 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120547 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-host\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.122141 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120577 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29qhm\" (UniqueName: \"kubernetes.io/projected/20a5cc5f-5de0-4de6-802a-cf1bcb303748-kube-api-access-29qhm\") pod \"node-resolver-ggpg7\" (UID: \"20a5cc5f-5de0-4de6-802a-cf1bcb303748\") " pod="openshift-dns/node-resolver-ggpg7" May 26 19:25:38.122141 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120568 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-cnibin\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.122141 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120609 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-host-run-k8s-cni-cncf-io\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.122141 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120636 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-systemd-units\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.122141 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120693 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10c865c8-5b1a-4a48-8c45-2155cbdb8323-device-dir\") pod \"aws-ebs-csi-driver-node-29hbx\" (UID: \"10c865c8-5b1a-4a48-8c45-2155cbdb8323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" May 26 19:25:38.122141 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120696 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-host-cni-netd\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.122141 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120740 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-node-log\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.122141 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120748 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10c865c8-5b1a-4a48-8c45-2155cbdb8323-device-dir\") pod \"aws-ebs-csi-driver-node-29hbx\" (UID: \"10c865c8-5b1a-4a48-8c45-2155cbdb8323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" May 26 19:25:38.122141 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120777 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-ovnkube-config\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.122141 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120778 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/20a5cc5f-5de0-4de6-802a-cf1bcb303748-hosts-file\") pod \"node-resolver-ggpg7\" (UID: \"20a5cc5f-5de0-4de6-802a-cf1bcb303748\") " pod="openshift-dns/node-resolver-ggpg7" May 26 19:25:38.122141 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120848 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/582de6bd-0ed1-4a29-b96e-f8825f9df04f-serviceca\") pod \"node-ca-bjdfl\" (UID: \"582de6bd-0ed1-4a29-b96e-f8825f9df04f\") " pod="openshift-image-registry/node-ca-bjdfl" May 26 19:25:38.122141 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120878 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-host-run-multus-certs\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.122141 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120907 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-env-overrides\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.122871 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120928 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1cdc1bc5-00d9-435b-b4da-1c5352befce9-cni-binary-copy\") pod \"multus-additional-cni-plugins-wtj5c\" (UID: \"1cdc1bc5-00d9-435b-b4da-1c5352befce9\") " pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.122871 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120956 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-host-run-k8s-cni-cncf-io\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.122871 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120962 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-host-var-lib-cni-multus\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.122871 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120970 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-host\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.122871 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120933 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ffpmv\" (UniqueName: \"kubernetes.io/projected/d328c544-5589-4537-81b6-f5caf93f3903-kube-api-access-ffpmv\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.122871 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121005 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10c865c8-5b1a-4a48-8c45-2155cbdb8323-sys-fs\") pod \"aws-ebs-csi-driver-node-29hbx\" (UID: \"10c865c8-5b1a-4a48-8c45-2155cbdb8323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" May 26 19:25:38.122871 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121022 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5b3e373a-26db-42d4-ae8b-08576159277d-multus-daemon-config\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.122871 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121048 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26ba334e-48a4-4886-bcde-21f01d18ec12-host-slash\") pod \"iptables-alerter-mh9ns\" (UID: \"26ba334e-48a4-4886-bcde-21f01d18ec12\") " pod="openshift-network-operator/iptables-alerter-mh9ns" May 26 19:25:38.122871 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121044 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-systemd-units\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.122871 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121075 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c43aa978-84ce-44cf-925a-d7fca81bae38-konnectivity-ca\") pod \"konnectivity-agent-84vtm\" (UID: \"c43aa978-84ce-44cf-925a-d7fca81bae38\") " pod="kube-system/konnectivity-agent-84vtm" May 26 19:25:38.122871 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121099 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-etc-kubernetes\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.122871 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121102 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs\") pod \"network-metrics-daemon-qsdsm\" (UID: \"6ee8f53e-5d8f-4944-89c4-ed98b8fad590\") " pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:25:38.122871 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121135 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-etc-modprobe-d\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.122871 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121177 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-multus-conf-dir\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.122871 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:38.121181 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:25:38.122871 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121203 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-etc-sysctl-d\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.122871 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121228 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d328c544-5589-4537-81b6-f5caf93f3903-tmp\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.123684 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:38.121288 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs podName:6ee8f53e-5d8f-4944-89c4-ed98b8fad590 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:38.621231368 +0000 UTC m=+3.155204133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs") pod "network-metrics-daemon-qsdsm" (UID: "6ee8f53e-5d8f-4944-89c4-ed98b8fad590") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:25:38.123684 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121334 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10c865c8-5b1a-4a48-8c45-2155cbdb8323-registration-dir\") pod \"aws-ebs-csi-driver-node-29hbx\" (UID: \"10c865c8-5b1a-4a48-8c45-2155cbdb8323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" May 26 19:25:38.123684 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121336 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/26ba334e-48a4-4886-bcde-21f01d18ec12-iptables-alerter-script\") pod \"iptables-alerter-mh9ns\" (UID: \"26ba334e-48a4-4886-bcde-21f01d18ec12\") " pod="openshift-network-operator/iptables-alerter-mh9ns" May 26 19:25:38.123684 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121361 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1cdc1bc5-00d9-435b-b4da-1c5352befce9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wtj5c\" (UID: \"1cdc1bc5-00d9-435b-b4da-1c5352befce9\") " pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.123684 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121386 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-run-openvswitch\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.123684 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121414 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-ovnkube-script-lib\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.123684 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121439 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1cdc1bc5-00d9-435b-b4da-1c5352befce9-cnibin\") pod \"multus-additional-cni-plugins-wtj5c\" (UID: \"1cdc1bc5-00d9-435b-b4da-1c5352befce9\") " pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.123684 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121462 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mlnlq\" (UniqueName: \"kubernetes.io/projected/4e8c295a-8845-4441-b1b8-6acb0b485589-kube-api-access-mlnlq\") pod \"network-check-target-87j6z\" (UID: \"4e8c295a-8845-4441-b1b8-6acb0b485589\") " pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:25:38.123684 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121484 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-etc-sysconfig\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.123684 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121492 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1cdc1bc5-00d9-435b-b4da-1c5352befce9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wtj5c\" (UID: \"1cdc1bc5-00d9-435b-b4da-1c5352befce9\") " pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.123684 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121503 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-etc-modprobe-d\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.123684 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121415 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-multus-conf-dir\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.123684 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121527 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-multus-cni-dir\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.123684 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121556 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-host-run-multus-certs\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.123684 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121571 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b3e373a-26db-42d4-ae8b-08576159277d-cni-binary-copy\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.123684 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121598 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-host-var-lib-cni-bin\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.124342 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121613 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10c865c8-5b1a-4a48-8c45-2155cbdb8323-etc-selinux\") pod \"aws-ebs-csi-driver-node-29hbx\" (UID: \"10c865c8-5b1a-4a48-8c45-2155cbdb8323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" May 26 19:25:38.124342 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121623 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-hostroot\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.124342 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121646 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-log-socket\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.124342 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121672 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.124342 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121702 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cdc1bc5-00d9-435b-b4da-1c5352befce9-system-cni-dir\") pod \"multus-additional-cni-plugins-wtj5c\" (UID: \"1cdc1bc5-00d9-435b-b4da-1c5352befce9\") " pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.124342 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121726 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1cdc1bc5-00d9-435b-b4da-1c5352befce9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wtj5c\" (UID: \"1cdc1bc5-00d9-435b-b4da-1c5352befce9\") " pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.124342 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121728 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7xzvc\" (UniqueName: \"kubernetes.io/projected/10c865c8-5b1a-4a48-8c45-2155cbdb8323-kube-api-access-7xzvc\") pod \"aws-ebs-csi-driver-node-29hbx\" (UID: \"10c865c8-5b1a-4a48-8c45-2155cbdb8323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" May 26 19:25:38.124342 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121765 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-run-systemd\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.124342 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121790 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9xtm6\" (UniqueName: \"kubernetes.io/projected/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-kube-api-access-9xtm6\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.124342 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121816 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7tnmd\" (UniqueName: \"kubernetes.io/projected/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-kube-api-access-7tnmd\") pod \"network-metrics-daemon-qsdsm\" (UID: \"6ee8f53e-5d8f-4944-89c4-ed98b8fad590\") " pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:25:38.124342 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121827 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-env-overrides\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.124342 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121841 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-etc-sysctl-conf\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.124342 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.120988 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-host-kubelet\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.124342 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121867 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d328c544-5589-4537-81b6-f5caf93f3903-etc-tuned\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.124342 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121937 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-lib-modules\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.124342 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121953 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1cdc1bc5-00d9-435b-b4da-1c5352befce9-cnibin\") pod \"multus-additional-cni-plugins-wtj5c\" (UID: \"1cdc1bc5-00d9-435b-b4da-1c5352befce9\") " pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.124342 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121995 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-host-var-lib-cni-bin\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.124878 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.122052 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-multus-cni-dir\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.124878 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.122061 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-etc-sysctl-d\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.124878 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.122087 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-run-openvswitch\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.124878 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.122119 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-etc-sysconfig\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.124878 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.122124 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5b3e373a-26db-42d4-ae8b-08576159277d-hostroot\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.124878 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.122173 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26ba334e-48a4-4886-bcde-21f01d18ec12-host-slash\") pod \"iptables-alerter-mh9ns\" (UID: \"26ba334e-48a4-4886-bcde-21f01d18ec12\") " pod="openshift-network-operator/iptables-alerter-mh9ns" May 26 19:25:38.124878 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.122180 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-log-socket\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.124878 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.122203 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.124878 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.122247 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cdc1bc5-00d9-435b-b4da-1c5352befce9-system-cni-dir\") pod \"multus-additional-cni-plugins-wtj5c\" (UID: \"1cdc1bc5-00d9-435b-b4da-1c5352befce9\") " pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.124878 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.122296 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5b3e373a-26db-42d4-ae8b-08576159277d-multus-daemon-config\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.124878 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.122444 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b3e373a-26db-42d4-ae8b-08576159277d-cni-binary-copy\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.124878 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.122515 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-run-systemd\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.124878 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.121815 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/26ba334e-48a4-4886-bcde-21f01d18ec12-iptables-alerter-script\") pod \"iptables-alerter-mh9ns\" (UID: \"26ba334e-48a4-4886-bcde-21f01d18ec12\") " pod="openshift-network-operator/iptables-alerter-mh9ns" May 26 19:25:38.124878 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.122628 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-ovnkube-script-lib\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.124878 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.122680 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d328c544-5589-4537-81b6-f5caf93f3903-etc-sysctl-conf\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.124878 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.122691 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c43aa978-84ce-44cf-925a-d7fca81bae38-konnectivity-ca\") pod \"konnectivity-agent-84vtm\" (UID: \"c43aa978-84ce-44cf-925a-d7fca81bae38\") " pod="kube-system/konnectivity-agent-84vtm" May 26 19:25:38.124878 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.123279 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-ovn-node-metrics-cert\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.124878 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.123985 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d328c544-5589-4537-81b6-f5caf93f3903-tmp\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.125452 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.124387 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c43aa978-84ce-44cf-925a-d7fca81bae38-agent-certs\") pod \"konnectivity-agent-84vtm\" (UID: \"c43aa978-84ce-44cf-925a-d7fca81bae38\") " pod="kube-system/konnectivity-agent-84vtm" May 26 19:25:38.125452 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.125129 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d328c544-5589-4537-81b6-f5caf93f3903-etc-tuned\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.129221 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.129203 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffpmv\" (UniqueName: \"kubernetes.io/projected/d328c544-5589-4537-81b6-f5caf93f3903-kube-api-access-ffpmv\") pod \"tuned-pqc8t\" (UID: \"d328c544-5589-4537-81b6-f5caf93f3903\") " pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.129311 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.129233 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm5tf\" (UniqueName: \"kubernetes.io/projected/26ba334e-48a4-4886-bcde-21f01d18ec12-kube-api-access-lm5tf\") pod \"iptables-alerter-mh9ns\" (UID: \"26ba334e-48a4-4886-bcde-21f01d18ec12\") " pod="openshift-network-operator/iptables-alerter-mh9ns" May 26 19:25:38.129909 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.129894 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9nm8\" (UniqueName: \"kubernetes.io/projected/5b3e373a-26db-42d4-ae8b-08576159277d-kube-api-access-l9nm8\") pod \"multus-nft6f\" (UID: \"5b3e373a-26db-42d4-ae8b-08576159277d\") " pod="openshift-multus/multus-nft6f" May 26 19:25:38.130364 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.130346 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljxwh\" (UniqueName: \"kubernetes.io/projected/1cdc1bc5-00d9-435b-b4da-1c5352befce9-kube-api-access-ljxwh\") pod \"multus-additional-cni-plugins-wtj5c\" (UID: \"1cdc1bc5-00d9-435b-b4da-1c5352befce9\") " pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.131678 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:38.131661 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 19:25:38.131678 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:38.131678 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 19:25:38.131796 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:38.131689 2578 projected.go:194] Error preparing data for projected volume kube-api-access-mlnlq for pod openshift-network-diagnostics/network-check-target-87j6z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:25:38.131796 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:38.131754 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e8c295a-8845-4441-b1b8-6acb0b485589-kube-api-access-mlnlq podName:4e8c295a-8845-4441-b1b8-6acb0b485589 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:38.631742227 +0000 UTC m=+3.165714993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mlnlq" (UniqueName: "kubernetes.io/projected/4e8c295a-8845-4441-b1b8-6acb0b485589-kube-api-access-mlnlq") pod "network-check-target-87j6z" (UID: "4e8c295a-8845-4441-b1b8-6acb0b485589") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:25:38.133677 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.133653 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tnmd\" (UniqueName: \"kubernetes.io/projected/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-kube-api-access-7tnmd\") pod \"network-metrics-daemon-qsdsm\" (UID: \"6ee8f53e-5d8f-4944-89c4-ed98b8fad590\") " pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:25:38.134162 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.134147 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xzvc\" (UniqueName: \"kubernetes.io/projected/10c865c8-5b1a-4a48-8c45-2155cbdb8323-kube-api-access-7xzvc\") pod \"aws-ebs-csi-driver-node-29hbx\" (UID: \"10c865c8-5b1a-4a48-8c45-2155cbdb8323\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" May 26 19:25:38.134526 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.134507 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xtm6\" (UniqueName: \"kubernetes.io/projected/f0da33a6-a79c-40bb-ab52-0133a75f2f3a-kube-api-access-9xtm6\") pod \"ovnkube-node-k89dv\" (UID: \"f0da33a6-a79c-40bb-ab52-0133a75f2f3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.222630 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.222588 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/582de6bd-0ed1-4a29-b96e-f8825f9df04f-host\") pod \"node-ca-bjdfl\" (UID: \"582de6bd-0ed1-4a29-b96e-f8825f9df04f\") " pod="openshift-image-registry/node-ca-bjdfl" May 26 19:25:38.222804 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.222655 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20a5cc5f-5de0-4de6-802a-cf1bcb303748-tmp-dir\") pod \"node-resolver-ggpg7\" (UID: \"20a5cc5f-5de0-4de6-802a-cf1bcb303748\") " pod="openshift-dns/node-resolver-ggpg7" May 26 19:25:38.222804 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.222669 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/582de6bd-0ed1-4a29-b96e-f8825f9df04f-host\") pod \"node-ca-bjdfl\" (UID: \"582de6bd-0ed1-4a29-b96e-f8825f9df04f\") " pod="openshift-image-registry/node-ca-bjdfl" May 26 19:25:38.222804 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.222690 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-49zbk\" (UniqueName: \"kubernetes.io/projected/582de6bd-0ed1-4a29-b96e-f8825f9df04f-kube-api-access-49zbk\") pod \"node-ca-bjdfl\" (UID: \"582de6bd-0ed1-4a29-b96e-f8825f9df04f\") " pod="openshift-image-registry/node-ca-bjdfl" May 26 19:25:38.222804 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.222723 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29qhm\" (UniqueName: \"kubernetes.io/projected/20a5cc5f-5de0-4de6-802a-cf1bcb303748-kube-api-access-29qhm\") pod \"node-resolver-ggpg7\" (UID: \"20a5cc5f-5de0-4de6-802a-cf1bcb303748\") " pod="openshift-dns/node-resolver-ggpg7" May 26 19:25:38.222804 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.222750 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/20a5cc5f-5de0-4de6-802a-cf1bcb303748-hosts-file\") pod \"node-resolver-ggpg7\" (UID: \"20a5cc5f-5de0-4de6-802a-cf1bcb303748\") " pod="openshift-dns/node-resolver-ggpg7" May 26 19:25:38.222804 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.222773 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/582de6bd-0ed1-4a29-b96e-f8825f9df04f-serviceca\") pod \"node-ca-bjdfl\" (UID: \"582de6bd-0ed1-4a29-b96e-f8825f9df04f\") " pod="openshift-image-registry/node-ca-bjdfl" May 26 19:25:38.223045 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.222898 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/20a5cc5f-5de0-4de6-802a-cf1bcb303748-hosts-file\") pod \"node-resolver-ggpg7\" (UID: \"20a5cc5f-5de0-4de6-802a-cf1bcb303748\") " pod="openshift-dns/node-resolver-ggpg7" May 26 19:25:38.223045 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.223006 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20a5cc5f-5de0-4de6-802a-cf1bcb303748-tmp-dir\") pod \"node-resolver-ggpg7\" (UID: \"20a5cc5f-5de0-4de6-802a-cf1bcb303748\") " pod="openshift-dns/node-resolver-ggpg7" May 26 19:25:38.223270 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.223250 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/582de6bd-0ed1-4a29-b96e-f8825f9df04f-serviceca\") pod \"node-ca-bjdfl\" (UID: \"582de6bd-0ed1-4a29-b96e-f8825f9df04f\") " pod="openshift-image-registry/node-ca-bjdfl" May 26 19:25:38.231116 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.231088 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29qhm\" (UniqueName: \"kubernetes.io/projected/20a5cc5f-5de0-4de6-802a-cf1bcb303748-kube-api-access-29qhm\") pod \"node-resolver-ggpg7\" (UID: \"20a5cc5f-5de0-4de6-802a-cf1bcb303748\") " pod="openshift-dns/node-resolver-ggpg7" May 26 19:25:38.231606 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.231583 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49zbk\" (UniqueName: \"kubernetes.io/projected/582de6bd-0ed1-4a29-b96e-f8825f9df04f-kube-api-access-49zbk\") pod \"node-ca-bjdfl\" (UID: \"582de6bd-0ed1-4a29-b96e-f8825f9df04f\") " pod="openshift-image-registry/node-ca-bjdfl" May 26 19:25:38.309594 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.309485 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" May 26 19:25:38.317148 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.317122 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" May 26 19:25:38.326960 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.326941 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ggpg7" May 26 19:25:38.328453 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.328432 2578 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 26 19:25:38.330365 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.330349 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nft6f" May 26 19:25:38.336911 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.336890 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mh9ns" May 26 19:25:38.342618 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.342599 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:25:38.344111 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.344082 2578 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 26 19:25:38.348318 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.348289 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-84vtm" May 26 19:25:38.354934 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.354911 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wtj5c" May 26 19:25:38.358465 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.358447 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bjdfl" May 26 19:25:38.619065 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:38.619039 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cdc1bc5_00d9_435b_b4da_1c5352befce9.slice/crio-bada2dac0be5bc82afcd11dd3c3ed088aeb10945b34105cf3f075f4044ca2ec9 WatchSource:0}: Error finding container bada2dac0be5bc82afcd11dd3c3ed088aeb10945b34105cf3f075f4044ca2ec9: Status 404 returned error can't find the container with id bada2dac0be5bc82afcd11dd3c3ed088aeb10945b34105cf3f075f4044ca2ec9 May 26 19:25:38.619621 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:38.619595 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod582de6bd_0ed1_4a29_b96e_f8825f9df04f.slice/crio-fc9045a56de9eeecb5387d86102b9f4f31f916cffd795a458a6dd2418110ce40 WatchSource:0}: Error finding container fc9045a56de9eeecb5387d86102b9f4f31f916cffd795a458a6dd2418110ce40: Status 404 returned error can't find the container with id fc9045a56de9eeecb5387d86102b9f4f31f916cffd795a458a6dd2418110ce40 May 26 19:25:38.620391 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:38.620371 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ba334e_48a4_4886_bcde_21f01d18ec12.slice/crio-9d53b8d8b5238c3314dfd4493c3d5ce99f19ee17f9ec9e9969e5efd72f0d0af6 WatchSource:0}: Error finding container 9d53b8d8b5238c3314dfd4493c3d5ce99f19ee17f9ec9e9969e5efd72f0d0af6: Status 404 returned error can't find the container with id 9d53b8d8b5238c3314dfd4493c3d5ce99f19ee17f9ec9e9969e5efd72f0d0af6 May 26 19:25:38.622866 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:38.622815 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b3e373a_26db_42d4_ae8b_08576159277d.slice/crio-053009b21a1c5c430e5e8d5f89cfc4852da1bf7bdbf9f6a74bc16bc6302e0e77 WatchSource:0}: Error finding container 053009b21a1c5c430e5e8d5f89cfc4852da1bf7bdbf9f6a74bc16bc6302e0e77: Status 404 returned error can't find the container with id 053009b21a1c5c430e5e8d5f89cfc4852da1bf7bdbf9f6a74bc16bc6302e0e77 May 26 19:25:38.624922 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.624848 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs\") pod \"network-metrics-daemon-qsdsm\" (UID: \"6ee8f53e-5d8f-4944-89c4-ed98b8fad590\") " pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:25:38.625031 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:38.625012 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:25:38.625097 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:38.625070 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs podName:6ee8f53e-5d8f-4944-89c4-ed98b8fad590 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:39.625050489 +0000 UTC m=+4.159023264 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs") pod "network-metrics-daemon-qsdsm" (UID: "6ee8f53e-5d8f-4944-89c4-ed98b8fad590") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:25:38.625290 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:38.625270 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc43aa978_84ce_44cf_925a_d7fca81bae38.slice/crio-f8d8937173d58fbae755d4b9476667ee420ffe9782a9f43dfac8dfde5b1d9574 WatchSource:0}: Error finding container f8d8937173d58fbae755d4b9476667ee420ffe9782a9f43dfac8dfde5b1d9574: Status 404 returned error can't find the container with id f8d8937173d58fbae755d4b9476667ee420ffe9782a9f43dfac8dfde5b1d9574 May 26 19:25:38.627151 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:38.626961 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0da33a6_a79c_40bb_ab52_0133a75f2f3a.slice/crio-939f98dfb91dd49e731ce12f12e69c1d9f9e939abcb8aea4197970dc5585896a WatchSource:0}: Error finding container 939f98dfb91dd49e731ce12f12e69c1d9f9e939abcb8aea4197970dc5585896a: Status 404 returned error can't find the container with id 939f98dfb91dd49e731ce12f12e69c1d9f9e939abcb8aea4197970dc5585896a May 26 19:25:38.628230 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:38.628159 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20a5cc5f_5de0_4de6_802a_cf1bcb303748.slice/crio-ab7f47319f8ad54a8991af07843372e641596750d215bcb02a4be413e5412be8 WatchSource:0}: Error finding container ab7f47319f8ad54a8991af07843372e641596750d215bcb02a4be413e5412be8: Status 404 returned error can't find the container with id ab7f47319f8ad54a8991af07843372e641596750d215bcb02a4be413e5412be8 May 26 19:25:38.629494 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:38.628936 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd328c544_5589_4537_81b6_f5caf93f3903.slice/crio-77dec2f8d7b257dc523c1b31dea1b67d71ec8b0943406fc8398fcf5f804b0533 WatchSource:0}: Error finding container 77dec2f8d7b257dc523c1b31dea1b67d71ec8b0943406fc8398fcf5f804b0533: Status 404 returned error can't find the container with id 77dec2f8d7b257dc523c1b31dea1b67d71ec8b0943406fc8398fcf5f804b0533 May 26 19:25:38.630005 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:25:38.629898 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10c865c8_5b1a_4a48_8c45_2155cbdb8323.slice/crio-5e74b082fbb0be4e5c7bf11b1d639e0ab21221012ce8539937c497598746aacd WatchSource:0}: Error finding container 5e74b082fbb0be4e5c7bf11b1d639e0ab21221012ce8539937c497598746aacd: Status 404 returned error can't find the container with id 5e74b082fbb0be4e5c7bf11b1d639e0ab21221012ce8539937c497598746aacd May 26 19:25:38.725446 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:38.725421 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mlnlq\" (UniqueName: \"kubernetes.io/projected/4e8c295a-8845-4441-b1b8-6acb0b485589-kube-api-access-mlnlq\") pod \"network-check-target-87j6z\" (UID: \"4e8c295a-8845-4441-b1b8-6acb0b485589\") " pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:25:38.725582 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:38.725566 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 19:25:38.725659 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:38.725589 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 19:25:38.725659 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:38.725602 2578 projected.go:194] Error preparing data for projected volume kube-api-access-mlnlq for pod openshift-network-diagnostics/network-check-target-87j6z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:25:38.725765 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:38.725661 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e8c295a-8845-4441-b1b8-6acb0b485589-kube-api-access-mlnlq podName:4e8c295a-8845-4441-b1b8-6acb0b485589 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:39.725640685 +0000 UTC m=+4.259613446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mlnlq" (UniqueName: "kubernetes.io/projected/4e8c295a-8845-4441-b1b8-6acb0b485589-kube-api-access-mlnlq") pod "network-check-target-87j6z" (UID: "4e8c295a-8845-4441-b1b8-6acb0b485589") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:25:39.044752 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.044689 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 19:20:37 +0000 UTC" deadline="2028-01-18 04:51:19.09045521 +0000 UTC" May 26 19:25:39.044752 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.044722 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14433h25m40.045736163s" May 26 19:25:39.111836 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.111230 2578 generic.go:358] "Generic (PLEG): container finished" podID="3fc215021d39a93030cc522d33c5e6e8" containerID="669317e7d453240d77cd0de5b690f81f7fb19bf0be9d54a79cabe765620d29b4" exitCode=0 May 26 19:25:39.111836 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.111787 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-192.ec2.internal" event={"ID":"3fc215021d39a93030cc522d33c5e6e8","Type":"ContainerDied","Data":"669317e7d453240d77cd0de5b690f81f7fb19bf0be9d54a79cabe765620d29b4"} May 26 19:25:39.113748 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.113696 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" event={"ID":"10c865c8-5b1a-4a48-8c45-2155cbdb8323","Type":"ContainerStarted","Data":"5e74b082fbb0be4e5c7bf11b1d639e0ab21221012ce8539937c497598746aacd"} May 26 19:25:39.119701 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.119528 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" event={"ID":"d328c544-5589-4537-81b6-f5caf93f3903","Type":"ContainerStarted","Data":"77dec2f8d7b257dc523c1b31dea1b67d71ec8b0943406fc8398fcf5f804b0533"} May 26 19:25:39.125554 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.125494 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ggpg7" event={"ID":"20a5cc5f-5de0-4de6-802a-cf1bcb303748","Type":"ContainerStarted","Data":"ab7f47319f8ad54a8991af07843372e641596750d215bcb02a4be413e5412be8"} May 26 19:25:39.136405 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.136359 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" event={"ID":"f0da33a6-a79c-40bb-ab52-0133a75f2f3a","Type":"ContainerStarted","Data":"939f98dfb91dd49e731ce12f12e69c1d9f9e939abcb8aea4197970dc5585896a"} May 26 19:25:39.154317 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.154250 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bjdfl" event={"ID":"582de6bd-0ed1-4a29-b96e-f8825f9df04f","Type":"ContainerStarted","Data":"fc9045a56de9eeecb5387d86102b9f4f31f916cffd795a458a6dd2418110ce40"} May 26 19:25:39.167883 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.167848 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mh9ns" event={"ID":"26ba334e-48a4-4886-bcde-21f01d18ec12","Type":"ContainerStarted","Data":"9d53b8d8b5238c3314dfd4493c3d5ce99f19ee17f9ec9e9969e5efd72f0d0af6"} May 26 19:25:39.178615 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.178555 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wtj5c" event={"ID":"1cdc1bc5-00d9-435b-b4da-1c5352befce9","Type":"ContainerStarted","Data":"bada2dac0be5bc82afcd11dd3c3ed088aeb10945b34105cf3f075f4044ca2ec9"} May 26 19:25:39.191853 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.191200 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-192.ec2.internal" event={"ID":"9debf8db6ecc45306c3a0d95b6812bb8","Type":"ContainerStarted","Data":"d511bda518e86d62116450d1e47cc765c9e1829fbbbc1f7b9ff219b2d2839ebb"} May 26 19:25:39.202943 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.202877 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-84vtm" event={"ID":"c43aa978-84ce-44cf-925a-d7fca81bae38","Type":"ContainerStarted","Data":"f8d8937173d58fbae755d4b9476667ee420ffe9782a9f43dfac8dfde5b1d9574"} May 26 19:25:39.214335 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.214296 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nft6f" event={"ID":"5b3e373a-26db-42d4-ae8b-08576159277d","Type":"ContainerStarted","Data":"053009b21a1c5c430e5e8d5f89cfc4852da1bf7bdbf9f6a74bc16bc6302e0e77"} May 26 19:25:39.632406 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.632308 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs\") pod \"network-metrics-daemon-qsdsm\" (UID: \"6ee8f53e-5d8f-4944-89c4-ed98b8fad590\") " pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:25:39.632555 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:39.632514 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:25:39.632609 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:39.632582 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs podName:6ee8f53e-5d8f-4944-89c4-ed98b8fad590 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:41.632562398 +0000 UTC m=+6.166535161 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs") pod "network-metrics-daemon-qsdsm" (UID: "6ee8f53e-5d8f-4944-89c4-ed98b8fad590") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:25:39.734201 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.733585 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mlnlq\" (UniqueName: \"kubernetes.io/projected/4e8c295a-8845-4441-b1b8-6acb0b485589-kube-api-access-mlnlq\") pod \"network-check-target-87j6z\" (UID: \"4e8c295a-8845-4441-b1b8-6acb0b485589\") " pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:25:39.734201 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:39.733758 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 19:25:39.734201 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:39.733780 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 19:25:39.734201 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:39.733792 2578 projected.go:194] Error preparing data for projected volume kube-api-access-mlnlq for pod openshift-network-diagnostics/network-check-target-87j6z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:25:39.734201 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:39.733854 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e8c295a-8845-4441-b1b8-6acb0b485589-kube-api-access-mlnlq podName:4e8c295a-8845-4441-b1b8-6acb0b485589 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:41.733835669 +0000 UTC m=+6.267808433 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mlnlq" (UniqueName: "kubernetes.io/projected/4e8c295a-8845-4441-b1b8-6acb0b485589-kube-api-access-mlnlq") pod "network-check-target-87j6z" (UID: "4e8c295a-8845-4441-b1b8-6acb0b485589") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:25:39.786596 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.784912 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-192.ec2.internal" podStartSLOduration=2.784893178 podStartE2EDuration="2.784893178s" podCreationTimestamp="2026-05-26 19:25:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:25:39.207312223 +0000 UTC m=+3.741285011" watchObservedRunningTime="2026-05-26 19:25:39.784893178 +0000 UTC m=+4.318865963" May 26 19:25:39.786596 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.785806 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-nsldl"] May 26 19:25:39.788220 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.787736 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:25:39.788220 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:39.787815 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nsldl" podUID="b26939e2-27a6-4dfa-aaa5-85fe72fafe89" May 26 19:25:39.834809 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.834637 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-kubelet-config\") pod \"global-pull-secret-syncer-nsldl\" (UID: \"b26939e2-27a6-4dfa-aaa5-85fe72fafe89\") " pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:25:39.834809 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.834696 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-dbus\") pod \"global-pull-secret-syncer-nsldl\" (UID: \"b26939e2-27a6-4dfa-aaa5-85fe72fafe89\") " pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:25:39.834809 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.834746 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-original-pull-secret\") pod \"global-pull-secret-syncer-nsldl\" (UID: \"b26939e2-27a6-4dfa-aaa5-85fe72fafe89\") " pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:25:39.937137 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.936150 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-kubelet-config\") pod \"global-pull-secret-syncer-nsldl\" (UID: \"b26939e2-27a6-4dfa-aaa5-85fe72fafe89\") " pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:25:39.937137 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.936210 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-dbus\") pod \"global-pull-secret-syncer-nsldl\" (UID: \"b26939e2-27a6-4dfa-aaa5-85fe72fafe89\") " pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:25:39.937137 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.936239 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-original-pull-secret\") pod \"global-pull-secret-syncer-nsldl\" (UID: \"b26939e2-27a6-4dfa-aaa5-85fe72fafe89\") " pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:25:39.937137 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:39.936479 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 19:25:39.937137 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:39.936546 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-original-pull-secret podName:b26939e2-27a6-4dfa-aaa5-85fe72fafe89 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:40.436526765 +0000 UTC m=+4.970499541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-original-pull-secret") pod "global-pull-secret-syncer-nsldl" (UID: "b26939e2-27a6-4dfa-aaa5-85fe72fafe89") : object "kube-system"/"original-pull-secret" not registered May 26 19:25:39.937137 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.936849 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-kubelet-config\") pod \"global-pull-secret-syncer-nsldl\" (UID: \"b26939e2-27a6-4dfa-aaa5-85fe72fafe89\") " pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:25:39.937137 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:39.937043 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-dbus\") pod \"global-pull-secret-syncer-nsldl\" (UID: \"b26939e2-27a6-4dfa-aaa5-85fe72fafe89\") " pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:25:40.099496 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:40.098775 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:25:40.099496 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:40.098955 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qsdsm" podUID="6ee8f53e-5d8f-4944-89c4-ed98b8fad590" May 26 19:25:40.099496 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:40.099353 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:25:40.099496 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:40.099454 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87j6z" podUID="4e8c295a-8845-4441-b1b8-6acb0b485589" May 26 19:25:40.227784 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:40.227361 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-192.ec2.internal" event={"ID":"3fc215021d39a93030cc522d33c5e6e8","Type":"ContainerStarted","Data":"5aebd938cfd6cad88154a68377450c0c2f212cf0c3f7f0a057d27f607271969d"} May 26 19:25:40.241513 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:40.241438 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-192.ec2.internal" podStartSLOduration=3.24139246 podStartE2EDuration="3.24139246s" podCreationTimestamp="2026-05-26 19:25:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:25:40.24072566 +0000 UTC m=+4.774698447" watchObservedRunningTime="2026-05-26 19:25:40.24139246 +0000 UTC m=+4.775365245" May 26 19:25:40.442588 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:40.441901 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-original-pull-secret\") pod \"global-pull-secret-syncer-nsldl\" (UID: \"b26939e2-27a6-4dfa-aaa5-85fe72fafe89\") " pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:25:40.442588 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:40.442100 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 19:25:40.442588 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:40.442164 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-original-pull-secret podName:b26939e2-27a6-4dfa-aaa5-85fe72fafe89 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:41.442146519 +0000 UTC m=+5.976119286 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-original-pull-secret") pod "global-pull-secret-syncer-nsldl" (UID: "b26939e2-27a6-4dfa-aaa5-85fe72fafe89") : object "kube-system"/"original-pull-secret" not registered May 26 19:25:41.100244 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:41.099631 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:25:41.100244 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:41.099829 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nsldl" podUID="b26939e2-27a6-4dfa-aaa5-85fe72fafe89" May 26 19:25:41.450065 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:41.449971 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-original-pull-secret\") pod \"global-pull-secret-syncer-nsldl\" (UID: \"b26939e2-27a6-4dfa-aaa5-85fe72fafe89\") " pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:25:41.450223 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:41.450150 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 19:25:41.450223 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:41.450215 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-original-pull-secret podName:b26939e2-27a6-4dfa-aaa5-85fe72fafe89 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:43.450194925 +0000 UTC m=+7.984167703 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-original-pull-secret") pod "global-pull-secret-syncer-nsldl" (UID: "b26939e2-27a6-4dfa-aaa5-85fe72fafe89") : object "kube-system"/"original-pull-secret" not registered May 26 19:25:41.652574 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:41.652537 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs\") pod \"network-metrics-daemon-qsdsm\" (UID: \"6ee8f53e-5d8f-4944-89c4-ed98b8fad590\") " pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:25:41.652757 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:41.652722 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:25:41.652824 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:41.652797 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs podName:6ee8f53e-5d8f-4944-89c4-ed98b8fad590 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:45.652776904 +0000 UTC m=+10.186749689 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs") pod "network-metrics-daemon-qsdsm" (UID: "6ee8f53e-5d8f-4944-89c4-ed98b8fad590") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:25:41.753775 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:41.753687 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mlnlq\" (UniqueName: \"kubernetes.io/projected/4e8c295a-8845-4441-b1b8-6acb0b485589-kube-api-access-mlnlq\") pod \"network-check-target-87j6z\" (UID: \"4e8c295a-8845-4441-b1b8-6acb0b485589\") " pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:25:41.753925 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:41.753868 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 19:25:41.753925 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:41.753889 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 19:25:41.753925 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:41.753920 2578 projected.go:194] Error preparing data for projected volume kube-api-access-mlnlq for pod openshift-network-diagnostics/network-check-target-87j6z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:25:41.754088 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:41.753981 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e8c295a-8845-4441-b1b8-6acb0b485589-kube-api-access-mlnlq podName:4e8c295a-8845-4441-b1b8-6acb0b485589 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:45.753962516 +0000 UTC m=+10.287935281 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mlnlq" (UniqueName: "kubernetes.io/projected/4e8c295a-8845-4441-b1b8-6acb0b485589-kube-api-access-mlnlq") pod "network-check-target-87j6z" (UID: "4e8c295a-8845-4441-b1b8-6acb0b485589") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:25:42.099693 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:42.099614 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:25:42.099856 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:42.099748 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87j6z" podUID="4e8c295a-8845-4441-b1b8-6acb0b485589" May 26 19:25:42.099856 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:42.099620 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:25:42.099966 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:42.099921 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qsdsm" podUID="6ee8f53e-5d8f-4944-89c4-ed98b8fad590" May 26 19:25:43.099381 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:43.098831 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:25:43.099381 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:43.098989 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nsldl" podUID="b26939e2-27a6-4dfa-aaa5-85fe72fafe89" May 26 19:25:43.469452 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:43.469374 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-original-pull-secret\") pod \"global-pull-secret-syncer-nsldl\" (UID: \"b26939e2-27a6-4dfa-aaa5-85fe72fafe89\") " pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:25:43.469614 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:43.469549 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 19:25:43.469677 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:43.469643 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-original-pull-secret podName:b26939e2-27a6-4dfa-aaa5-85fe72fafe89 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:47.469623455 +0000 UTC m=+12.003596229 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-original-pull-secret") pod "global-pull-secret-syncer-nsldl" (UID: "b26939e2-27a6-4dfa-aaa5-85fe72fafe89") : object "kube-system"/"original-pull-secret" not registered May 26 19:25:44.099423 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:44.099345 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:25:44.099872 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:44.099491 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87j6z" podUID="4e8c295a-8845-4441-b1b8-6acb0b485589" May 26 19:25:44.099872 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:44.099836 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:25:44.099978 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:44.099935 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qsdsm" podUID="6ee8f53e-5d8f-4944-89c4-ed98b8fad590" May 26 19:25:45.099016 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:45.098904 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:25:45.099184 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:45.099052 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nsldl" podUID="b26939e2-27a6-4dfa-aaa5-85fe72fafe89" May 26 19:25:45.687031 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:45.686994 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs\") pod \"network-metrics-daemon-qsdsm\" (UID: \"6ee8f53e-5d8f-4944-89c4-ed98b8fad590\") " pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:25:45.687489 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:45.687133 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:25:45.687489 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:45.687217 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs podName:6ee8f53e-5d8f-4944-89c4-ed98b8fad590 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:53.687197506 +0000 UTC m=+18.221170270 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs") pod "network-metrics-daemon-qsdsm" (UID: "6ee8f53e-5d8f-4944-89c4-ed98b8fad590") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:25:45.787998 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:45.787969 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mlnlq\" (UniqueName: \"kubernetes.io/projected/4e8c295a-8845-4441-b1b8-6acb0b485589-kube-api-access-mlnlq\") pod \"network-check-target-87j6z\" (UID: \"4e8c295a-8845-4441-b1b8-6acb0b485589\") " pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:25:45.788180 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:45.788148 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 19:25:45.788180 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:45.788172 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 19:25:45.788297 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:45.788186 2578 projected.go:194] Error preparing data for projected volume kube-api-access-mlnlq for pod openshift-network-diagnostics/network-check-target-87j6z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:25:45.788297 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:45.788264 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e8c295a-8845-4441-b1b8-6acb0b485589-kube-api-access-mlnlq podName:4e8c295a-8845-4441-b1b8-6acb0b485589 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:53.78824248 +0000 UTC m=+18.322215249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mlnlq" (UniqueName: "kubernetes.io/projected/4e8c295a-8845-4441-b1b8-6acb0b485589-kube-api-access-mlnlq") pod "network-check-target-87j6z" (UID: "4e8c295a-8845-4441-b1b8-6acb0b485589") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:25:46.100626 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:46.100550 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:25:46.100785 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:46.100671 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qsdsm" podUID="6ee8f53e-5d8f-4944-89c4-ed98b8fad590" May 26 19:25:46.101170 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:46.100868 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:25:46.101170 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:46.100957 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87j6z" podUID="4e8c295a-8845-4441-b1b8-6acb0b485589" May 26 19:25:47.099532 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:47.099496 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:25:47.099916 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:47.099616 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nsldl" podUID="b26939e2-27a6-4dfa-aaa5-85fe72fafe89" May 26 19:25:47.503122 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:47.503044 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-original-pull-secret\") pod \"global-pull-secret-syncer-nsldl\" (UID: \"b26939e2-27a6-4dfa-aaa5-85fe72fafe89\") " pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:25:47.503281 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:47.503208 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 19:25:47.503281 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:47.503279 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-original-pull-secret podName:b26939e2-27a6-4dfa-aaa5-85fe72fafe89 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:55.503264071 +0000 UTC m=+20.037236832 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-original-pull-secret") pod "global-pull-secret-syncer-nsldl" (UID: "b26939e2-27a6-4dfa-aaa5-85fe72fafe89") : object "kube-system"/"original-pull-secret" not registered May 26 19:25:48.098974 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:48.098937 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:25:48.099132 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:48.098977 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:25:48.099132 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:48.099075 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87j6z" podUID="4e8c295a-8845-4441-b1b8-6acb0b485589" May 26 19:25:48.099196 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:48.099175 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qsdsm" podUID="6ee8f53e-5d8f-4944-89c4-ed98b8fad590" May 26 19:25:49.099273 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:49.099192 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:25:49.099654 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:49.099317 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nsldl" podUID="b26939e2-27a6-4dfa-aaa5-85fe72fafe89" May 26 19:25:50.098943 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:50.098903 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:25:50.099129 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:50.098912 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:25:50.099129 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:50.099083 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qsdsm" podUID="6ee8f53e-5d8f-4944-89c4-ed98b8fad590" May 26 19:25:50.099232 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:50.099121 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87j6z" podUID="4e8c295a-8845-4441-b1b8-6acb0b485589" May 26 19:25:51.099408 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:51.099368 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:25:51.099827 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:51.099491 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nsldl" podUID="b26939e2-27a6-4dfa-aaa5-85fe72fafe89" May 26 19:25:52.099461 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:52.099415 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:25:52.099912 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:52.099415 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:25:52.099912 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:52.099552 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87j6z" podUID="4e8c295a-8845-4441-b1b8-6acb0b485589" May 26 19:25:52.099912 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:52.099658 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qsdsm" podUID="6ee8f53e-5d8f-4944-89c4-ed98b8fad590" May 26 19:25:53.099394 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:53.099362 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:25:53.099590 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:53.099485 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nsldl" podUID="b26939e2-27a6-4dfa-aaa5-85fe72fafe89" May 26 19:25:53.749353 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:53.749303 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs\") pod \"network-metrics-daemon-qsdsm\" (UID: \"6ee8f53e-5d8f-4944-89c4-ed98b8fad590\") " pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:25:53.749525 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:53.749458 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:25:53.749525 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:53.749520 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs podName:6ee8f53e-5d8f-4944-89c4-ed98b8fad590 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:09.749503714 +0000 UTC m=+34.283476490 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs") pod "network-metrics-daemon-qsdsm" (UID: "6ee8f53e-5d8f-4944-89c4-ed98b8fad590") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:25:53.850637 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:53.850598 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mlnlq\" (UniqueName: \"kubernetes.io/projected/4e8c295a-8845-4441-b1b8-6acb0b485589-kube-api-access-mlnlq\") pod \"network-check-target-87j6z\" (UID: \"4e8c295a-8845-4441-b1b8-6acb0b485589\") " pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:25:53.850817 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:53.850780 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 19:25:53.850817 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:53.850807 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 19:25:53.850920 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:53.850820 2578 projected.go:194] Error preparing data for projected volume kube-api-access-mlnlq for pod openshift-network-diagnostics/network-check-target-87j6z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:25:53.850920 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:53.850893 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e8c295a-8845-4441-b1b8-6acb0b485589-kube-api-access-mlnlq podName:4e8c295a-8845-4441-b1b8-6acb0b485589 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:09.850876665 +0000 UTC m=+34.384849427 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mlnlq" (UniqueName: "kubernetes.io/projected/4e8c295a-8845-4441-b1b8-6acb0b485589-kube-api-access-mlnlq") pod "network-check-target-87j6z" (UID: "4e8c295a-8845-4441-b1b8-6acb0b485589") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:25:54.099072 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:54.098989 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:25:54.099223 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:54.098990 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:25:54.099223 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:54.099112 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qsdsm" podUID="6ee8f53e-5d8f-4944-89c4-ed98b8fad590" May 26 19:25:54.099223 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:54.099195 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87j6z" podUID="4e8c295a-8845-4441-b1b8-6acb0b485589" May 26 19:25:55.098760 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:55.098734 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:25:55.099183 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:55.098848 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nsldl" podUID="b26939e2-27a6-4dfa-aaa5-85fe72fafe89" May 26 19:25:55.563662 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:55.563433 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-original-pull-secret\") pod \"global-pull-secret-syncer-nsldl\" (UID: \"b26939e2-27a6-4dfa-aaa5-85fe72fafe89\") " pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:25:55.563662 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:55.563601 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 19:25:55.563846 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:55.563686 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-original-pull-secret podName:b26939e2-27a6-4dfa-aaa5-85fe72fafe89 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:11.563662545 +0000 UTC m=+36.097635312 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-original-pull-secret") pod "global-pull-secret-syncer-nsldl" (UID: "b26939e2-27a6-4dfa-aaa5-85fe72fafe89") : object "kube-system"/"original-pull-secret" not registered May 26 19:25:56.101733 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:56.101693 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:25:56.102124 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:56.101693 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:25:56.102124 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:56.101806 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qsdsm" podUID="6ee8f53e-5d8f-4944-89c4-ed98b8fad590" May 26 19:25:56.102124 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:56.101889 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87j6z" podUID="4e8c295a-8845-4441-b1b8-6acb0b485589" May 26 19:25:57.099039 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:57.098807 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:25:57.099162 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:57.099141 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nsldl" podUID="b26939e2-27a6-4dfa-aaa5-85fe72fafe89" May 26 19:25:57.258391 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:57.258364 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" event={"ID":"10c865c8-5b1a-4a48-8c45-2155cbdb8323","Type":"ContainerStarted","Data":"3f7bf9dd1e7a4ef7f5ab6818a2d4cb657ceab64f0eb9b4395a83be05846b8844"} May 26 19:25:57.259595 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:57.259578 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" event={"ID":"d328c544-5589-4537-81b6-f5caf93f3903","Type":"ContainerStarted","Data":"c53528be02032ea3402519d76e055edf846d2e578fc3130322d8fd6d3519fc17"} May 26 19:25:57.260851 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:57.260779 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ggpg7" event={"ID":"20a5cc5f-5de0-4de6-802a-cf1bcb303748","Type":"ContainerStarted","Data":"892b98e8ffb37dfe5257804f9054d9924f18e58ebc210df8a89a91d3bf6af622"} May 26 19:25:57.262995 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:57.262706 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" event={"ID":"f0da33a6-a79c-40bb-ab52-0133a75f2f3a","Type":"ContainerStarted","Data":"f84d63c6413e1875e753ce8c4d0add3c892550e6f39c04f9e0170d832e8474d4"} May 26 19:25:57.263112 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:57.263028 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" event={"ID":"f0da33a6-a79c-40bb-ab52-0133a75f2f3a","Type":"ContainerStarted","Data":"9d90adff5764219f505674ff63fe8f8028b37c4509319c196a92528aaa611526"} May 26 19:25:57.263112 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:57.263061 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" event={"ID":"f0da33a6-a79c-40bb-ab52-0133a75f2f3a","Type":"ContainerStarted","Data":"074c59d6302c0dc69a5801bc010b421d6abd2486d7cfb13049814703f3e44ee3"} May 26 19:25:57.263112 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:57.263076 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" event={"ID":"f0da33a6-a79c-40bb-ab52-0133a75f2f3a","Type":"ContainerStarted","Data":"bdeed103d7e6bcf7859a978e141b9b402d3e9d4e821ebb3c3145ce4555be9ea4"} May 26 19:25:57.266983 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:57.266954 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bjdfl" event={"ID":"582de6bd-0ed1-4a29-b96e-f8825f9df04f","Type":"ContainerStarted","Data":"3343b6e61a15cea7cd60c8d99ecbd61f24acb7bd2ca58ae37256d1c1dec8f25f"} May 26 19:25:57.268076 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:57.268057 2578 generic.go:358] "Generic (PLEG): container finished" podID="1cdc1bc5-00d9-435b-b4da-1c5352befce9" containerID="12abafbed3fe52680998faba74b09b70b62a6e31a1259761917ea9641cbe11e6" exitCode=0 May 26 19:25:57.268171 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:57.268081 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wtj5c" event={"ID":"1cdc1bc5-00d9-435b-b4da-1c5352befce9","Type":"ContainerDied","Data":"12abafbed3fe52680998faba74b09b70b62a6e31a1259761917ea9641cbe11e6"} May 26 19:25:57.269313 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:57.269293 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-84vtm" event={"ID":"c43aa978-84ce-44cf-925a-d7fca81bae38","Type":"ContainerStarted","Data":"6b3feb92bf4abd4a9881e1d2ac3a9975641c63b7a8d508e8b927e954d26c2858"} May 26 19:25:57.270585 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:57.270535 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nft6f" event={"ID":"5b3e373a-26db-42d4-ae8b-08576159277d","Type":"ContainerStarted","Data":"e322703b8dba19fb108ac33e83abe52d286e5bd61e0a49318f0133b57e9147db"} May 26 19:25:57.278900 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:57.278855 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pqc8t" podStartSLOduration=3.152693573 podStartE2EDuration="21.27883793s" podCreationTimestamp="2026-05-26 19:25:36 +0000 UTC" firstStartedPulling="2026-05-26 19:25:38.631438995 +0000 UTC m=+3.165411759" lastFinishedPulling="2026-05-26 19:25:56.757583348 +0000 UTC m=+21.291556116" observedRunningTime="2026-05-26 19:25:57.278653529 +0000 UTC m=+21.812626332" watchObservedRunningTime="2026-05-26 19:25:57.27883793 +0000 UTC m=+21.812810714" May 26 19:25:57.292193 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:57.292154 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-84vtm" podStartSLOduration=7.727686382 podStartE2EDuration="21.292145181s" podCreationTimestamp="2026-05-26 19:25:36 +0000 UTC" firstStartedPulling="2026-05-26 19:25:38.627443448 +0000 UTC m=+3.161416225" lastFinishedPulling="2026-05-26 19:25:52.191902246 +0000 UTC m=+16.725875024" observedRunningTime="2026-05-26 19:25:57.291813146 +0000 UTC m=+21.825785951" watchObservedRunningTime="2026-05-26 19:25:57.292145181 +0000 UTC m=+21.826117943" May 26 19:25:57.349061 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:57.349021 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-nft6f" podStartSLOduration=3.164719935 podStartE2EDuration="21.349009321s" podCreationTimestamp="2026-05-26 19:25:36 +0000 UTC" firstStartedPulling="2026-05-26 19:25:38.624146424 +0000 UTC m=+3.158119187" lastFinishedPulling="2026-05-26 19:25:56.808435795 +0000 UTC m=+21.342408573" observedRunningTime="2026-05-26 19:25:57.348840902 +0000 UTC m=+21.882813685" watchObservedRunningTime="2026-05-26 19:25:57.349009321 +0000 UTC m=+21.882982104" May 26 19:25:57.349372 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:57.349350 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-ggpg7" podStartSLOduration=3.224328378 podStartE2EDuration="21.349343097s" podCreationTimestamp="2026-05-26 19:25:36 +0000 UTC" firstStartedPulling="2026-05-26 19:25:38.63046812 +0000 UTC m=+3.164440889" lastFinishedPulling="2026-05-26 19:25:56.755482845 +0000 UTC m=+21.289455608" observedRunningTime="2026-05-26 19:25:57.327850515 +0000 UTC m=+21.861823298" watchObservedRunningTime="2026-05-26 19:25:57.349343097 +0000 UTC m=+21.883315878" May 26 19:25:57.364128 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:57.364081 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bjdfl" podStartSLOduration=3.231533232 podStartE2EDuration="21.36406564s" podCreationTimestamp="2026-05-26 19:25:36 +0000 UTC" firstStartedPulling="2026-05-26 19:25:38.621249018 +0000 UTC m=+3.155221783" lastFinishedPulling="2026-05-26 19:25:56.753781415 +0000 UTC m=+21.287754191" observedRunningTime="2026-05-26 19:25:57.363819975 +0000 UTC m=+21.897792761" watchObservedRunningTime="2026-05-26 19:25:57.36406564 +0000 UTC m=+21.898038427" May 26 19:25:58.099264 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:58.099061 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:25:58.099392 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:58.099077 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:25:58.099457 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:58.099400 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qsdsm" podUID="6ee8f53e-5d8f-4944-89c4-ed98b8fad590" May 26 19:25:58.099515 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:58.099465 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87j6z" podUID="4e8c295a-8845-4441-b1b8-6acb0b485589" May 26 19:25:58.137959 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:58.137937 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 26 19:25:58.275763 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:58.275661 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" event={"ID":"f0da33a6-a79c-40bb-ab52-0133a75f2f3a","Type":"ContainerStarted","Data":"356891fb509816709042289ac6262c1e40801c010b8d41f542ac70728f3714ad"} May 26 19:25:58.275763 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:58.275702 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" event={"ID":"f0da33a6-a79c-40bb-ab52-0133a75f2f3a","Type":"ContainerStarted","Data":"d4970524204bdeb11d081e622b91176146f650d7b82babfba967265dda3d2fd4"} May 26 19:25:58.276996 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:58.276968 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mh9ns" event={"ID":"26ba334e-48a4-4886-bcde-21f01d18ec12","Type":"ContainerStarted","Data":"606ea01648416f063f72da46c0d9dde8e18325bd776b4ed8a9291258cce6f880"} May 26 19:25:58.278651 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:58.278578 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" event={"ID":"10c865c8-5b1a-4a48-8c45-2155cbdb8323","Type":"ContainerStarted","Data":"c5fa9e6bc9828ba88e5cc79abdcdc4bead77750cc5a8d44e3aaa01d97777bcc0"} May 26 19:25:58.291174 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:58.291130 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mh9ns" podStartSLOduration=4.159210392 podStartE2EDuration="22.291116658s" podCreationTimestamp="2026-05-26 19:25:36 +0000 UTC" firstStartedPulling="2026-05-26 19:25:38.622464128 +0000 UTC m=+3.156436905" lastFinishedPulling="2026-05-26 19:25:56.754370406 +0000 UTC m=+21.288343171" observedRunningTime="2026-05-26 19:25:58.290882148 +0000 UTC m=+22.824854933" watchObservedRunningTime="2026-05-26 19:25:58.291116658 +0000 UTC m=+22.825089442" May 26 19:25:59.077517 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:59.077399 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T19:25:58.137954414Z","UUID":"2e5c4620-6ec0-4dbe-a1e5-6f70da4bb07e","Handler":null,"Name":"","Endpoint":""} May 26 19:25:59.079105 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:59.079087 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 26 19:25:59.079211 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:59.079112 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 26 19:25:59.098929 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:59.098882 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:25:59.099053 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:25:59.098993 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nsldl" podUID="b26939e2-27a6-4dfa-aaa5-85fe72fafe89" May 26 19:25:59.282268 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:25:59.282233 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" event={"ID":"10c865c8-5b1a-4a48-8c45-2155cbdb8323","Type":"ContainerStarted","Data":"fafe33a13e5f45b26c9d7dc54bd71df0fd561c16137cc7ee8af0de8f1f59edab"} May 26 19:26:00.098992 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:00.098962 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:26:00.099154 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:00.099082 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qsdsm" podUID="6ee8f53e-5d8f-4944-89c4-ed98b8fad590" May 26 19:26:00.099154 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:00.099114 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:26:00.099236 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:00.099180 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87j6z" podUID="4e8c295a-8845-4441-b1b8-6acb0b485589" May 26 19:26:00.286833 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:00.286803 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" event={"ID":"f0da33a6-a79c-40bb-ab52-0133a75f2f3a","Type":"ContainerStarted","Data":"aac501fc823e2b77d04fc5a7ddb3d7948be806286e161d6fc0ad9caab71ee15e"} May 26 19:26:01.098978 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:01.098944 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:26:01.099150 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:01.099067 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nsldl" podUID="b26939e2-27a6-4dfa-aaa5-85fe72fafe89" May 26 19:26:01.498951 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:01.498919 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-84vtm" May 26 19:26:01.500044 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:01.500026 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-84vtm" May 26 19:26:01.514335 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:01.514277 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29hbx" podStartSLOduration=5.047619935 podStartE2EDuration="25.514263892s" podCreationTimestamp="2026-05-26 19:25:36 +0000 UTC" firstStartedPulling="2026-05-26 19:25:38.632123232 +0000 UTC m=+3.166096007" lastFinishedPulling="2026-05-26 19:25:59.098767183 +0000 UTC m=+23.632739964" observedRunningTime="2026-05-26 19:25:59.298416635 +0000 UTC m=+23.832389418" watchObservedRunningTime="2026-05-26 19:26:01.514263892 +0000 UTC m=+26.048236676" May 26 19:26:02.099482 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:02.099208 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:26:02.099482 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:02.099245 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:26:02.099670 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:02.099513 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qsdsm" podUID="6ee8f53e-5d8f-4944-89c4-ed98b8fad590" May 26 19:26:02.099670 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:02.099551 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87j6z" podUID="4e8c295a-8845-4441-b1b8-6acb0b485589" May 26 19:26:02.293634 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:02.293598 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" event={"ID":"f0da33a6-a79c-40bb-ab52-0133a75f2f3a","Type":"ContainerStarted","Data":"ae744615587b2b9195c9b86c68771c530d34ee7bb1e19dd92fcd247500e88e2d"} May 26 19:26:02.293941 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:02.293918 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:26:02.293941 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:02.293944 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:26:02.295291 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:02.295271 2578 generic.go:358] "Generic (PLEG): container finished" podID="1cdc1bc5-00d9-435b-b4da-1c5352befce9" containerID="be4abff6d457b218c4078c057fbb86374a992e905d14b6360a4f1d84c5152783" exitCode=0 May 26 19:26:02.295399 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:02.295352 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wtj5c" event={"ID":"1cdc1bc5-00d9-435b-b4da-1c5352befce9","Type":"ContainerDied","Data":"be4abff6d457b218c4078c057fbb86374a992e905d14b6360a4f1d84c5152783"} May 26 19:26:02.295574 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:02.295557 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-84vtm" May 26 19:26:02.295961 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:02.295944 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-84vtm" May 26 19:26:02.309452 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:02.309434 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:26:02.320852 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:02.320816 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" podStartSLOduration=8.112404843 podStartE2EDuration="26.320804878s" podCreationTimestamp="2026-05-26 19:25:36 +0000 UTC" firstStartedPulling="2026-05-26 19:25:38.629133795 +0000 UTC m=+3.163106568" lastFinishedPulling="2026-05-26 19:25:56.837533828 +0000 UTC m=+21.371506603" observedRunningTime="2026-05-26 19:26:02.320257822 +0000 UTC m=+26.854230629" watchObservedRunningTime="2026-05-26 19:26:02.320804878 +0000 UTC m=+26.854777661" May 26 19:26:03.099669 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:03.099140 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:26:03.099669 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:03.099277 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nsldl" podUID="b26939e2-27a6-4dfa-aaa5-85fe72fafe89" May 26 19:26:03.298029 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:03.297994 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:26:03.312585 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:03.312556 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:26:03.832106 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:03.831891 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-87j6z"] May 26 19:26:03.832267 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:03.832148 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:26:03.832267 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:03.832225 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87j6z" podUID="4e8c295a-8845-4441-b1b8-6acb0b485589" May 26 19:26:03.834877 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:03.834855 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qsdsm"] May 26 19:26:03.834979 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:03.834955 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:26:03.835043 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:03.835028 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qsdsm" podUID="6ee8f53e-5d8f-4944-89c4-ed98b8fad590" May 26 19:26:03.848100 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:03.848067 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nsldl"] May 26 19:26:03.848210 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:03.848175 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:26:03.848268 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:03.848250 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nsldl" podUID="b26939e2-27a6-4dfa-aaa5-85fe72fafe89" May 26 19:26:04.300908 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:04.300874 2578 generic.go:358] "Generic (PLEG): container finished" podID="1cdc1bc5-00d9-435b-b4da-1c5352befce9" containerID="3e5083e2223be00401f03e01701a986a81a7b52bd4c40aa16b2b3ebbcec6232b" exitCode=0 May 26 19:26:04.301532 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:04.300968 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wtj5c" event={"ID":"1cdc1bc5-00d9-435b-b4da-1c5352befce9","Type":"ContainerDied","Data":"3e5083e2223be00401f03e01701a986a81a7b52bd4c40aa16b2b3ebbcec6232b"} May 26 19:26:05.099277 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:05.099244 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:26:05.099456 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:05.099377 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qsdsm" podUID="6ee8f53e-5d8f-4944-89c4-ed98b8fad590" May 26 19:26:06.103578 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:06.103494 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:26:06.104209 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:06.103611 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nsldl" podUID="b26939e2-27a6-4dfa-aaa5-85fe72fafe89" May 26 19:26:06.104209 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:06.103635 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:26:06.104209 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:06.103728 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87j6z" podUID="4e8c295a-8845-4441-b1b8-6acb0b485589" May 26 19:26:06.307785 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:06.307755 2578 generic.go:358] "Generic (PLEG): container finished" podID="1cdc1bc5-00d9-435b-b4da-1c5352befce9" containerID="0255897008cd639fb1a186f6ed7b71d04a589d333ad0a2ffb4f8834498cf8180" exitCode=0 May 26 19:26:06.307935 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:06.307797 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wtj5c" event={"ID":"1cdc1bc5-00d9-435b-b4da-1c5352befce9","Type":"ContainerDied","Data":"0255897008cd639fb1a186f6ed7b71d04a589d333ad0a2ffb4f8834498cf8180"} May 26 19:26:07.099584 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:07.099552 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:26:07.099778 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:07.099678 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qsdsm" podUID="6ee8f53e-5d8f-4944-89c4-ed98b8fad590" May 26 19:26:08.099299 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:08.099213 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:26:08.099844 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:08.099360 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87j6z" podUID="4e8c295a-8845-4441-b1b8-6acb0b485589" May 26 19:26:08.099844 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:08.099427 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:26:08.099844 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:08.099555 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nsldl" podUID="b26939e2-27a6-4dfa-aaa5-85fe72fafe89" May 26 19:26:09.098735 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.098701 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:26:09.099018 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:09.098829 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qsdsm" podUID="6ee8f53e-5d8f-4944-89c4-ed98b8fad590" May 26 19:26:09.701675 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.701641 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-192.ec2.internal" event="NodeReady" May 26 19:26:09.702134 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.701763 2578 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 26 19:26:09.751647 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.751276 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-s6nbq"] May 26 19:26:09.758231 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.757165 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s6nbq" May 26 19:26:09.766474 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.759429 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d9w79"] May 26 19:26:09.766474 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.761611 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d9w79" May 26 19:26:09.766474 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.762364 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 26 19:26:09.766474 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.762662 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 26 19:26:09.766474 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.762836 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 26 19:26:09.766474 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.763023 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jhp6d\"" May 26 19:26:09.766474 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.764357 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 26 19:26:09.766474 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.764600 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 26 19:26:09.766474 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.764921 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jtv8f\"" May 26 19:26:09.769891 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.769873 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s6nbq"] May 26 19:26:09.772011 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.771987 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs\") pod \"network-metrics-daemon-qsdsm\" (UID: \"6ee8f53e-5d8f-4944-89c4-ed98b8fad590\") " pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:26:09.772163 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:09.772141 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:26:09.772284 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:09.772202 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs podName:6ee8f53e-5d8f-4944-89c4-ed98b8fad590 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:41.77218451 +0000 UTC m=+66.306157275 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs") pod "network-metrics-daemon-qsdsm" (UID: "6ee8f53e-5d8f-4944-89c4-ed98b8fad590") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 19:26:09.775474 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.775443 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d9w79"] May 26 19:26:09.873214 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.873180 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mlnlq\" (UniqueName: \"kubernetes.io/projected/4e8c295a-8845-4441-b1b8-6acb0b485589-kube-api-access-mlnlq\") pod \"network-check-target-87j6z\" (UID: \"4e8c295a-8845-4441-b1b8-6acb0b485589\") " pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:26:09.873399 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.873224 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert\") pod \"ingress-canary-s6nbq\" (UID: \"508f26c0-895c-41a4-ad07-6119ac41ab6a\") " pod="openshift-ingress-canary/ingress-canary-s6nbq" May 26 19:26:09.873399 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.873259 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls\") pod \"dns-default-d9w79\" (UID: \"3346df9a-a455-49fe-8602-808efc59cadc\") " pod="openshift-dns/dns-default-d9w79" May 26 19:26:09.873399 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.873284 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3346df9a-a455-49fe-8602-808efc59cadc-tmp-dir\") pod \"dns-default-d9w79\" (UID: \"3346df9a-a455-49fe-8602-808efc59cadc\") " pod="openshift-dns/dns-default-d9w79" May 26 19:26:09.873399 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.873357 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6kch\" (UniqueName: \"kubernetes.io/projected/508f26c0-895c-41a4-ad07-6119ac41ab6a-kube-api-access-w6kch\") pod \"ingress-canary-s6nbq\" (UID: \"508f26c0-895c-41a4-ad07-6119ac41ab6a\") " pod="openshift-ingress-canary/ingress-canary-s6nbq" May 26 19:26:09.873399 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:09.873369 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 19:26:09.873399 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:09.873392 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 19:26:09.873399 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.873399 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3346df9a-a455-49fe-8602-808efc59cadc-config-volume\") pod \"dns-default-d9w79\" (UID: \"3346df9a-a455-49fe-8602-808efc59cadc\") " pod="openshift-dns/dns-default-d9w79" May 26 19:26:09.873399 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:09.873407 2578 projected.go:194] Error preparing data for projected volume kube-api-access-mlnlq for pod openshift-network-diagnostics/network-check-target-87j6z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:26:09.873781 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.873430 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zhv7\" (UniqueName: \"kubernetes.io/projected/3346df9a-a455-49fe-8602-808efc59cadc-kube-api-access-4zhv7\") pod \"dns-default-d9w79\" (UID: \"3346df9a-a455-49fe-8602-808efc59cadc\") " pod="openshift-dns/dns-default-d9w79" May 26 19:26:09.873781 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:09.873472 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e8c295a-8845-4441-b1b8-6acb0b485589-kube-api-access-mlnlq podName:4e8c295a-8845-4441-b1b8-6acb0b485589 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:41.873453652 +0000 UTC m=+66.407426414 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mlnlq" (UniqueName: "kubernetes.io/projected/4e8c295a-8845-4441-b1b8-6acb0b485589-kube-api-access-mlnlq") pod "network-check-target-87j6z" (UID: "4e8c295a-8845-4441-b1b8-6acb0b485589") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 19:26:09.974133 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.974051 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6kch\" (UniqueName: \"kubernetes.io/projected/508f26c0-895c-41a4-ad07-6119ac41ab6a-kube-api-access-w6kch\") pod \"ingress-canary-s6nbq\" (UID: \"508f26c0-895c-41a4-ad07-6119ac41ab6a\") " pod="openshift-ingress-canary/ingress-canary-s6nbq" May 26 19:26:09.974133 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.974116 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3346df9a-a455-49fe-8602-808efc59cadc-config-volume\") pod \"dns-default-d9w79\" (UID: \"3346df9a-a455-49fe-8602-808efc59cadc\") " pod="openshift-dns/dns-default-d9w79" May 26 19:26:09.974342 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.974160 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zhv7\" (UniqueName: \"kubernetes.io/projected/3346df9a-a455-49fe-8602-808efc59cadc-kube-api-access-4zhv7\") pod \"dns-default-d9w79\" (UID: \"3346df9a-a455-49fe-8602-808efc59cadc\") " pod="openshift-dns/dns-default-d9w79" May 26 19:26:09.974342 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.974206 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert\") pod \"ingress-canary-s6nbq\" (UID: \"508f26c0-895c-41a4-ad07-6119ac41ab6a\") " pod="openshift-ingress-canary/ingress-canary-s6nbq" May 26 19:26:09.974342 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.974237 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls\") pod \"dns-default-d9w79\" (UID: \"3346df9a-a455-49fe-8602-808efc59cadc\") " pod="openshift-dns/dns-default-d9w79" May 26 19:26:09.974342 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.974258 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3346df9a-a455-49fe-8602-808efc59cadc-tmp-dir\") pod \"dns-default-d9w79\" (UID: \"3346df9a-a455-49fe-8602-808efc59cadc\") " pod="openshift-dns/dns-default-d9w79" May 26 19:26:09.974593 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:09.974388 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 19:26:09.974593 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:09.974441 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 19:26:09.974593 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:09.974445 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert podName:508f26c0-895c-41a4-ad07-6119ac41ab6a nodeName:}" failed. No retries permitted until 2026-05-26 19:26:10.474427308 +0000 UTC m=+35.008400070 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert") pod "ingress-canary-s6nbq" (UID: "508f26c0-895c-41a4-ad07-6119ac41ab6a") : secret "canary-serving-cert" not found May 26 19:26:09.974593 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:09.974519 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls podName:3346df9a-a455-49fe-8602-808efc59cadc nodeName:}" failed. No retries permitted until 2026-05-26 19:26:10.474499541 +0000 UTC m=+35.008472316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls") pod "dns-default-d9w79" (UID: "3346df9a-a455-49fe-8602-808efc59cadc") : secret "dns-default-metrics-tls" not found May 26 19:26:09.974755 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.974719 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3346df9a-a455-49fe-8602-808efc59cadc-tmp-dir\") pod \"dns-default-d9w79\" (UID: \"3346df9a-a455-49fe-8602-808efc59cadc\") " pod="openshift-dns/dns-default-d9w79" May 26 19:26:09.975113 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.974910 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3346df9a-a455-49fe-8602-808efc59cadc-config-volume\") pod \"dns-default-d9w79\" (UID: \"3346df9a-a455-49fe-8602-808efc59cadc\") " pod="openshift-dns/dns-default-d9w79" May 26 19:26:09.984819 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.984796 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zhv7\" (UniqueName: \"kubernetes.io/projected/3346df9a-a455-49fe-8602-808efc59cadc-kube-api-access-4zhv7\") pod \"dns-default-d9w79\" (UID: \"3346df9a-a455-49fe-8602-808efc59cadc\") " pod="openshift-dns/dns-default-d9w79" May 26 19:26:09.984996 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:09.984898 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6kch\" (UniqueName: \"kubernetes.io/projected/508f26c0-895c-41a4-ad07-6119ac41ab6a-kube-api-access-w6kch\") pod \"ingress-canary-s6nbq\" (UID: \"508f26c0-895c-41a4-ad07-6119ac41ab6a\") " pod="openshift-ingress-canary/ingress-canary-s6nbq" May 26 19:26:10.099629 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:10.099596 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:26:10.099806 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:10.099598 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:26:10.102881 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:10.102857 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9g26n\"" May 26 19:26:10.103117 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:10.103104 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 26 19:26:10.103337 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:10.103308 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 26 19:26:10.103409 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:10.103391 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 26 19:26:10.478689 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:10.478655 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls\") pod \"dns-default-d9w79\" (UID: \"3346df9a-a455-49fe-8602-808efc59cadc\") " pod="openshift-dns/dns-default-d9w79" May 26 19:26:10.478879 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:10.478778 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert\") pod \"ingress-canary-s6nbq\" (UID: \"508f26c0-895c-41a4-ad07-6119ac41ab6a\") " pod="openshift-ingress-canary/ingress-canary-s6nbq" May 26 19:26:10.478879 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:10.478818 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 19:26:10.478879 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:10.478866 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 19:26:10.479042 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:10.478895 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls podName:3346df9a-a455-49fe-8602-808efc59cadc nodeName:}" failed. No retries permitted until 2026-05-26 19:26:11.478875095 +0000 UTC m=+36.012847872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls") pod "dns-default-d9w79" (UID: "3346df9a-a455-49fe-8602-808efc59cadc") : secret "dns-default-metrics-tls" not found May 26 19:26:10.479042 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:10.478912 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert podName:508f26c0-895c-41a4-ad07-6119ac41ab6a nodeName:}" failed. No retries permitted until 2026-05-26 19:26:11.478905129 +0000 UTC m=+36.012877894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert") pod "ingress-canary-s6nbq" (UID: "508f26c0-895c-41a4-ad07-6119ac41ab6a") : secret "canary-serving-cert" not found May 26 19:26:11.098918 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:11.098886 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:26:11.101696 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:11.101669 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 26 19:26:11.101987 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:11.101963 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z9trh\"" May 26 19:26:11.487635 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:11.487590 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls\") pod \"dns-default-d9w79\" (UID: \"3346df9a-a455-49fe-8602-808efc59cadc\") " pod="openshift-dns/dns-default-d9w79" May 26 19:26:11.487814 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:11.487717 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert\") pod \"ingress-canary-s6nbq\" (UID: \"508f26c0-895c-41a4-ad07-6119ac41ab6a\") " pod="openshift-ingress-canary/ingress-canary-s6nbq" May 26 19:26:11.487814 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:11.487761 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 19:26:11.487923 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:11.487818 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 19:26:11.487923 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:11.487838 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls podName:3346df9a-a455-49fe-8602-808efc59cadc nodeName:}" failed. No retries permitted until 2026-05-26 19:26:13.487820044 +0000 UTC m=+38.021792809 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls") pod "dns-default-d9w79" (UID: "3346df9a-a455-49fe-8602-808efc59cadc") : secret "dns-default-metrics-tls" not found May 26 19:26:11.487923 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:11.487867 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert podName:508f26c0-895c-41a4-ad07-6119ac41ab6a nodeName:}" failed. No retries permitted until 2026-05-26 19:26:13.487851035 +0000 UTC m=+38.021823821 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert") pod "ingress-canary-s6nbq" (UID: "508f26c0-895c-41a4-ad07-6119ac41ab6a") : secret "canary-serving-cert" not found May 26 19:26:11.588383 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:11.588346 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-original-pull-secret\") pod \"global-pull-secret-syncer-nsldl\" (UID: \"b26939e2-27a6-4dfa-aaa5-85fe72fafe89\") " pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:26:11.590758 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:11.590729 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b26939e2-27a6-4dfa-aaa5-85fe72fafe89-original-pull-secret\") pod \"global-pull-secret-syncer-nsldl\" (UID: \"b26939e2-27a6-4dfa-aaa5-85fe72fafe89\") " pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:26:11.611694 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:11.611667 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nsldl" May 26 19:26:12.247894 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:12.247866 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nsldl"] May 26 19:26:12.301003 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:26:12.300964 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb26939e2_27a6_4dfa_aaa5_85fe72fafe89.slice/crio-e8b7e71b159e383917bbbaabda5a5f64342bdb676a8a47d7b8b4a6fd01101c79 WatchSource:0}: Error finding container e8b7e71b159e383917bbbaabda5a5f64342bdb676a8a47d7b8b4a6fd01101c79: Status 404 returned error can't find the container with id e8b7e71b159e383917bbbaabda5a5f64342bdb676a8a47d7b8b4a6fd01101c79 May 26 19:26:12.319049 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:12.319020 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nsldl" event={"ID":"b26939e2-27a6-4dfa-aaa5-85fe72fafe89","Type":"ContainerStarted","Data":"e8b7e71b159e383917bbbaabda5a5f64342bdb676a8a47d7b8b4a6fd01101c79"} May 26 19:26:13.323887 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:13.323670 2578 generic.go:358] "Generic (PLEG): container finished" podID="1cdc1bc5-00d9-435b-b4da-1c5352befce9" containerID="35b88a26b588214a41e65f02842204613f105340e5cf42a7ff99c82fd7350087" exitCode=0 May 26 19:26:13.324249 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:13.323753 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wtj5c" event={"ID":"1cdc1bc5-00d9-435b-b4da-1c5352befce9","Type":"ContainerDied","Data":"35b88a26b588214a41e65f02842204613f105340e5cf42a7ff99c82fd7350087"} May 26 19:26:13.501068 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:13.501037 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert\") pod \"ingress-canary-s6nbq\" (UID: \"508f26c0-895c-41a4-ad07-6119ac41ab6a\") " pod="openshift-ingress-canary/ingress-canary-s6nbq" May 26 19:26:13.501213 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:13.501094 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls\") pod \"dns-default-d9w79\" (UID: \"3346df9a-a455-49fe-8602-808efc59cadc\") " pod="openshift-dns/dns-default-d9w79" May 26 19:26:13.501285 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:13.501249 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 19:26:13.501285 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:13.501265 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 19:26:13.501443 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:13.501338 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert podName:508f26c0-895c-41a4-ad07-6119ac41ab6a nodeName:}" failed. No retries permitted until 2026-05-26 19:26:17.501302491 +0000 UTC m=+42.035275267 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert") pod "ingress-canary-s6nbq" (UID: "508f26c0-895c-41a4-ad07-6119ac41ab6a") : secret "canary-serving-cert" not found May 26 19:26:13.501443 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:13.501359 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls podName:3346df9a-a455-49fe-8602-808efc59cadc nodeName:}" failed. No retries permitted until 2026-05-26 19:26:17.501349591 +0000 UTC m=+42.035322356 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls") pod "dns-default-d9w79" (UID: "3346df9a-a455-49fe-8602-808efc59cadc") : secret "dns-default-metrics-tls" not found May 26 19:26:14.328498 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:14.328465 2578 generic.go:358] "Generic (PLEG): container finished" podID="1cdc1bc5-00d9-435b-b4da-1c5352befce9" containerID="940aec74e78c558a7a02dcd579c1acca27ddb8ba93dc4499e32ddeee5cabecf1" exitCode=0 May 26 19:26:14.328945 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:14.328516 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wtj5c" event={"ID":"1cdc1bc5-00d9-435b-b4da-1c5352befce9","Type":"ContainerDied","Data":"940aec74e78c558a7a02dcd579c1acca27ddb8ba93dc4499e32ddeee5cabecf1"} May 26 19:26:15.334313 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:15.334277 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wtj5c" event={"ID":"1cdc1bc5-00d9-435b-b4da-1c5352befce9","Type":"ContainerStarted","Data":"48d731afb1b99abc7d201fb19afb39f4374967848417802328f6330d96cc7527"} May 26 19:26:15.358951 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:15.358893 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wtj5c" podStartSLOduration=5.647681629 podStartE2EDuration="39.358876142s" podCreationTimestamp="2026-05-26 19:25:36 +0000 UTC" firstStartedPulling="2026-05-26 19:25:38.620774296 +0000 UTC m=+3.154747077" lastFinishedPulling="2026-05-26 19:26:12.331968829 +0000 UTC m=+36.865941590" observedRunningTime="2026-05-26 19:26:15.358860455 +0000 UTC m=+39.892833227" watchObservedRunningTime="2026-05-26 19:26:15.358876142 +0000 UTC m=+39.892848927" May 26 19:26:16.338542 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:16.338508 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nsldl" event={"ID":"b26939e2-27a6-4dfa-aaa5-85fe72fafe89","Type":"ContainerStarted","Data":"d1358eb3a1dcbe643d37df25b77acdc185ad804e3f9a8d45bdd211a6df7df71c"} May 26 19:26:16.352803 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:16.352738 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nsldl" podStartSLOduration=33.498189147 podStartE2EDuration="37.352720601s" podCreationTimestamp="2026-05-26 19:25:39 +0000 UTC" firstStartedPulling="2026-05-26 19:26:12.309088416 +0000 UTC m=+36.843061200" lastFinishedPulling="2026-05-26 19:26:16.163619889 +0000 UTC m=+40.697592654" observedRunningTime="2026-05-26 19:26:16.352287276 +0000 UTC m=+40.886260064" watchObservedRunningTime="2026-05-26 19:26:16.352720601 +0000 UTC m=+40.886693386" May 26 19:26:17.530843 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:17.530809 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert\") pod \"ingress-canary-s6nbq\" (UID: \"508f26c0-895c-41a4-ad07-6119ac41ab6a\") " pod="openshift-ingress-canary/ingress-canary-s6nbq" May 26 19:26:17.530843 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:17.530855 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls\") pod \"dns-default-d9w79\" (UID: \"3346df9a-a455-49fe-8602-808efc59cadc\") " pod="openshift-dns/dns-default-d9w79" May 26 19:26:17.531237 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:17.530942 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 19:26:17.531237 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:17.530949 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 19:26:17.531237 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:17.530992 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls podName:3346df9a-a455-49fe-8602-808efc59cadc nodeName:}" failed. No retries permitted until 2026-05-26 19:26:25.530978567 +0000 UTC m=+50.064951329 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls") pod "dns-default-d9w79" (UID: "3346df9a-a455-49fe-8602-808efc59cadc") : secret "dns-default-metrics-tls" not found May 26 19:26:17.531237 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:17.531005 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert podName:508f26c0-895c-41a4-ad07-6119ac41ab6a nodeName:}" failed. No retries permitted until 2026-05-26 19:26:25.53099939 +0000 UTC m=+50.064972152 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert") pod "ingress-canary-s6nbq" (UID: "508f26c0-895c-41a4-ad07-6119ac41ab6a") : secret "canary-serving-cert" not found May 26 19:26:25.586783 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:25.586741 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert\") pod \"ingress-canary-s6nbq\" (UID: \"508f26c0-895c-41a4-ad07-6119ac41ab6a\") " pod="openshift-ingress-canary/ingress-canary-s6nbq" May 26 19:26:25.586783 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:25.586789 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls\") pod \"dns-default-d9w79\" (UID: \"3346df9a-a455-49fe-8602-808efc59cadc\") " pod="openshift-dns/dns-default-d9w79" May 26 19:26:25.587307 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:25.586912 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 19:26:25.587307 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:25.586991 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert podName:508f26c0-895c-41a4-ad07-6119ac41ab6a nodeName:}" failed. No retries permitted until 2026-05-26 19:26:41.586973124 +0000 UTC m=+66.120945891 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert") pod "ingress-canary-s6nbq" (UID: "508f26c0-895c-41a4-ad07-6119ac41ab6a") : secret "canary-serving-cert" not found May 26 19:26:25.587307 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:25.586914 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 19:26:25.587307 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:25.587088 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls podName:3346df9a-a455-49fe-8602-808efc59cadc nodeName:}" failed. No retries permitted until 2026-05-26 19:26:41.587069028 +0000 UTC m=+66.121041793 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls") pod "dns-default-d9w79" (UID: "3346df9a-a455-49fe-8602-808efc59cadc") : secret "dns-default-metrics-tls" not found May 26 19:26:31.056775 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.056742 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6594c59fdc-26mxj"] May 26 19:26:31.060924 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.060897 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:31.063316 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.063296 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 26 19:26:31.063445 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.063307 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 26 19:26:31.063445 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.063306 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dljqb\"" May 26 19:26:31.063534 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.063467 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 26 19:26:31.068533 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.068513 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 26 19:26:31.070677 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.070658 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6594c59fdc-26mxj"] May 26 19:26:31.124580 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.124546 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d65f72d3-f87e-4df0-830b-cd3a68f45e30-ca-trust-extracted\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:31.124580 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.124577 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-bound-sa-token\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:31.124810 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.124612 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d65f72d3-f87e-4df0-830b-cd3a68f45e30-image-registry-private-configuration\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:31.124810 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.124630 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:31.124810 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.124702 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d65f72d3-f87e-4df0-830b-cd3a68f45e30-installation-pull-secrets\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:31.124810 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.124734 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vltpz\" (UniqueName: \"kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-kube-api-access-vltpz\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:31.125008 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.124822 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-certificates\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:31.125008 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.124851 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d65f72d3-f87e-4df0-830b-cd3a68f45e30-trusted-ca\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:31.226060 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.226015 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d65f72d3-f87e-4df0-830b-cd3a68f45e30-image-registry-private-configuration\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:31.226060 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.226066 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:31.226235 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.226185 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d65f72d3-f87e-4df0-830b-cd3a68f45e30-installation-pull-secrets\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:31.226235 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.226207 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vltpz\" (UniqueName: \"kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-kube-api-access-vltpz\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:31.226363 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.226274 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-certificates\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:31.226363 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:31.226305 2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 26 19:26:31.226363 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:31.226341 2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6594c59fdc-26mxj: secret "image-registry-tls" not found May 26 19:26:31.226494 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:31.226405 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls podName:d65f72d3-f87e-4df0-830b-cd3a68f45e30 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:31.726381954 +0000 UTC m=+56.260354716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls") pod "image-registry-6594c59fdc-26mxj" (UID: "d65f72d3-f87e-4df0-830b-cd3a68f45e30") : secret "image-registry-tls" not found May 26 19:26:31.226494 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.226306 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d65f72d3-f87e-4df0-830b-cd3a68f45e30-trusted-ca\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:31.226494 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.226475 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d65f72d3-f87e-4df0-830b-cd3a68f45e30-ca-trust-extracted\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:31.226627 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.226505 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-bound-sa-token\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:31.226844 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.226818 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d65f72d3-f87e-4df0-830b-cd3a68f45e30-ca-trust-extracted\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:31.226967 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.226947 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-certificates\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:31.227278 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.227261 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d65f72d3-f87e-4df0-830b-cd3a68f45e30-trusted-ca\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:31.229616 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.229587 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d65f72d3-f87e-4df0-830b-cd3a68f45e30-image-registry-private-configuration\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:31.229616 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.229609 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d65f72d3-f87e-4df0-830b-cd3a68f45e30-installation-pull-secrets\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:31.234980 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.234958 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vltpz\" (UniqueName: \"kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-kube-api-access-vltpz\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:31.235056 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.235007 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-bound-sa-token\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:31.729865 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:31.729819 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:31.730053 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:31.729965 2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 26 19:26:31.730053 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:31.729984 2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6594c59fdc-26mxj: secret "image-registry-tls" not found May 26 19:26:31.730053 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:31.730049 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls podName:d65f72d3-f87e-4df0-830b-cd3a68f45e30 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:32.73003333 +0000 UTC m=+57.264006093 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls") pod "image-registry-6594c59fdc-26mxj" (UID: "d65f72d3-f87e-4df0-830b-cd3a68f45e30") : secret "image-registry-tls" not found May 26 19:26:32.737915 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:32.737877 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:32.738275 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:32.738033 2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 26 19:26:32.738275 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:32.738052 2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6594c59fdc-26mxj: secret "image-registry-tls" not found May 26 19:26:32.738275 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:32.738116 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls podName:d65f72d3-f87e-4df0-830b-cd3a68f45e30 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:34.738100064 +0000 UTC m=+59.272072826 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls") pod "image-registry-6594c59fdc-26mxj" (UID: "d65f72d3-f87e-4df0-830b-cd3a68f45e30") : secret "image-registry-tls" not found May 26 19:26:34.753047 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:34.753011 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:34.753425 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:34.753163 2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 26 19:26:34.753425 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:34.753180 2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6594c59fdc-26mxj: secret "image-registry-tls" not found May 26 19:26:34.753425 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:34.753235 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls podName:d65f72d3-f87e-4df0-830b-cd3a68f45e30 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:38.753218886 +0000 UTC m=+63.287191652 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls") pod "image-registry-6594c59fdc-26mxj" (UID: "d65f72d3-f87e-4df0-830b-cd3a68f45e30") : secret "image-registry-tls" not found May 26 19:26:35.317441 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:35.317412 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k89dv" May 26 19:26:38.777255 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:38.777213 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:38.777631 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:38.777395 2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 26 19:26:38.777631 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:38.777410 2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6594c59fdc-26mxj: secret "image-registry-tls" not found May 26 19:26:38.777631 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:38.777463 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls podName:d65f72d3-f87e-4df0-830b-cd3a68f45e30 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:46.777448054 +0000 UTC m=+71.311420817 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls") pod "image-registry-6594c59fdc-26mxj" (UID: "d65f72d3-f87e-4df0-830b-cd3a68f45e30") : secret "image-registry-tls" not found May 26 19:26:41.596530 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:41.596497 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert\") pod \"ingress-canary-s6nbq\" (UID: \"508f26c0-895c-41a4-ad07-6119ac41ab6a\") " pod="openshift-ingress-canary/ingress-canary-s6nbq" May 26 19:26:41.596530 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:41.596535 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls\") pod \"dns-default-d9w79\" (UID: \"3346df9a-a455-49fe-8602-808efc59cadc\") " pod="openshift-dns/dns-default-d9w79" May 26 19:26:41.596966 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:41.596632 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 19:26:41.596966 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:41.596656 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 19:26:41.596966 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:41.596680 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls podName:3346df9a-a455-49fe-8602-808efc59cadc nodeName:}" failed. No retries permitted until 2026-05-26 19:27:13.596667405 +0000 UTC m=+98.130640168 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls") pod "dns-default-d9w79" (UID: "3346df9a-a455-49fe-8602-808efc59cadc") : secret "dns-default-metrics-tls" not found May 26 19:26:41.596966 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:41.596721 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert podName:508f26c0-895c-41a4-ad07-6119ac41ab6a nodeName:}" failed. No retries permitted until 2026-05-26 19:27:13.596704461 +0000 UTC m=+98.130677237 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert") pod "ingress-canary-s6nbq" (UID: "508f26c0-895c-41a4-ad07-6119ac41ab6a") : secret "canary-serving-cert" not found May 26 19:26:41.797540 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:41.797502 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs\") pod \"network-metrics-daemon-qsdsm\" (UID: \"6ee8f53e-5d8f-4944-89c4-ed98b8fad590\") " pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:26:41.800104 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:41.800087 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 26 19:26:41.808059 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:41.808038 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 26 19:26:41.808112 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:41.808099 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs podName:6ee8f53e-5d8f-4944-89c4-ed98b8fad590 nodeName:}" failed. No retries permitted until 2026-05-26 19:27:45.808083381 +0000 UTC m=+130.342056143 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs") pod "network-metrics-daemon-qsdsm" (UID: "6ee8f53e-5d8f-4944-89c4-ed98b8fad590") : secret "metrics-daemon-secret" not found May 26 19:26:41.898085 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:41.898055 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mlnlq\" (UniqueName: \"kubernetes.io/projected/4e8c295a-8845-4441-b1b8-6acb0b485589-kube-api-access-mlnlq\") pod \"network-check-target-87j6z\" (UID: \"4e8c295a-8845-4441-b1b8-6acb0b485589\") " pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:26:41.900864 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:41.900845 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 26 19:26:41.911186 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:41.911167 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 26 19:26:41.921581 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:41.921556 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlnlq\" (UniqueName: \"kubernetes.io/projected/4e8c295a-8845-4441-b1b8-6acb0b485589-kube-api-access-mlnlq\") pod \"network-check-target-87j6z\" (UID: \"4e8c295a-8845-4441-b1b8-6acb0b485589\") " pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:26:42.219801 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:42.219712 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9g26n\"" May 26 19:26:42.227921 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:42.227885 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:26:42.345048 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:42.344882 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-87j6z"] May 26 19:26:42.347680 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:26:42.347656 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e8c295a_8845_4441_b1b8_6acb0b485589.slice/crio-1a546766a31f592e2c7d91bc03dd793c00b3458a5b546569c34384bf88daa97f WatchSource:0}: Error finding container 1a546766a31f592e2c7d91bc03dd793c00b3458a5b546569c34384bf88daa97f: Status 404 returned error can't find the container with id 1a546766a31f592e2c7d91bc03dd793c00b3458a5b546569c34384bf88daa97f May 26 19:26:42.389313 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:42.389283 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-87j6z" event={"ID":"4e8c295a-8845-4441-b1b8-6acb0b485589","Type":"ContainerStarted","Data":"1a546766a31f592e2c7d91bc03dd793c00b3458a5b546569c34384bf88daa97f"} May 26 19:26:45.396308 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:45.396278 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-87j6z" event={"ID":"4e8c295a-8845-4441-b1b8-6acb0b485589","Type":"ContainerStarted","Data":"2c572e4df96239bb430f0da228e36826509e94774367addf106b7a345861637f"} May 26 19:26:45.412193 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:45.412154 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-87j6z" podStartSLOduration=66.669697538 podStartE2EDuration="1m9.41214244s" podCreationTimestamp="2026-05-26 19:25:36 +0000 UTC" firstStartedPulling="2026-05-26 19:26:42.349898882 +0000 UTC m=+66.883871644" lastFinishedPulling="2026-05-26 19:26:45.09234378 +0000 UTC m=+69.626316546" observedRunningTime="2026-05-26 19:26:45.411580614 +0000 UTC m=+69.945553397" watchObservedRunningTime="2026-05-26 19:26:45.41214244 +0000 UTC m=+69.946115217" May 26 19:26:46.398134 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:46.398102 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:26:46.835566 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:26:46.835473 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:26:46.835702 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:46.835614 2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 26 19:26:46.835702 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:46.835631 2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6594c59fdc-26mxj: secret "image-registry-tls" not found May 26 19:26:46.835702 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:26:46.835686 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls podName:d65f72d3-f87e-4df0-830b-cd3a68f45e30 nodeName:}" failed. No retries permitted until 2026-05-26 19:27:02.835670796 +0000 UTC m=+87.369643558 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls") pod "image-registry-6594c59fdc-26mxj" (UID: "d65f72d3-f87e-4df0-830b-cd3a68f45e30") : secret "image-registry-tls" not found May 26 19:27:02.850562 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:27:02.850521 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:27:02.851168 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:27:02.850704 2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 26 19:27:02.851168 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:27:02.850728 2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6594c59fdc-26mxj: secret "image-registry-tls" not found May 26 19:27:02.851168 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:27:02.850803 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls podName:d65f72d3-f87e-4df0-830b-cd3a68f45e30 nodeName:}" failed. No retries permitted until 2026-05-26 19:27:34.850781718 +0000 UTC m=+119.384754501 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls") pod "image-registry-6594c59fdc-26mxj" (UID: "d65f72d3-f87e-4df0-830b-cd3a68f45e30") : secret "image-registry-tls" not found May 26 19:27:13.622130 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:27:13.622096 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert\") pod \"ingress-canary-s6nbq\" (UID: \"508f26c0-895c-41a4-ad07-6119ac41ab6a\") " pod="openshift-ingress-canary/ingress-canary-s6nbq" May 26 19:27:13.622130 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:27:13.622137 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls\") pod \"dns-default-d9w79\" (UID: \"3346df9a-a455-49fe-8602-808efc59cadc\") " pod="openshift-dns/dns-default-d9w79" May 26 19:27:13.622622 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:27:13.622236 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 19:27:13.622622 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:27:13.622237 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 19:27:13.622622 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:27:13.622295 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls podName:3346df9a-a455-49fe-8602-808efc59cadc nodeName:}" failed. No retries permitted until 2026-05-26 19:28:17.622275869 +0000 UTC m=+162.156248656 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls") pod "dns-default-d9w79" (UID: "3346df9a-a455-49fe-8602-808efc59cadc") : secret "dns-default-metrics-tls" not found May 26 19:27:13.622622 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:27:13.622309 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert podName:508f26c0-895c-41a4-ad07-6119ac41ab6a nodeName:}" failed. No retries permitted until 2026-05-26 19:28:17.622303457 +0000 UTC m=+162.156276225 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert") pod "ingress-canary-s6nbq" (UID: "508f26c0-895c-41a4-ad07-6119ac41ab6a") : secret "canary-serving-cert" not found May 26 19:27:17.402763 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:27:17.402731 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-87j6z" May 26 19:27:34.865782 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:27:34.865732 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls\") pod \"image-registry-6594c59fdc-26mxj\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:27:34.866177 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:27:34.865889 2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 26 19:27:34.866177 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:27:34.865903 2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6594c59fdc-26mxj: secret "image-registry-tls" not found May 26 19:27:34.866177 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:27:34.865963 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls podName:d65f72d3-f87e-4df0-830b-cd3a68f45e30 nodeName:}" failed. No retries permitted until 2026-05-26 19:28:38.865944902 +0000 UTC m=+183.399917675 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls") pod "image-registry-6594c59fdc-26mxj" (UID: "d65f72d3-f87e-4df0-830b-cd3a68f45e30") : secret "image-registry-tls" not found May 26 19:27:45.847275 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:27:45.847223 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs\") pod \"network-metrics-daemon-qsdsm\" (UID: \"6ee8f53e-5d8f-4944-89c4-ed98b8fad590\") " pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:27:45.847751 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:27:45.847384 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 26 19:27:45.847751 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:27:45.847450 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs podName:6ee8f53e-5d8f-4944-89c4-ed98b8fad590 nodeName:}" failed. No retries permitted until 2026-05-26 19:29:47.847432659 +0000 UTC m=+252.381405421 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs") pod "network-metrics-daemon-qsdsm" (UID: "6ee8f53e-5d8f-4944-89c4-ed98b8fad590") : secret "metrics-daemon-secret" not found May 26 19:28:02.549540 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:02.549514 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ggpg7_20a5cc5f-5de0-4de6-802a-cf1bcb303748/dns-node-resolver/0.log" May 26 19:28:03.750334 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:03.750298 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bjdfl_582de6bd-0ed1-4a29-b96e-f8825f9df04f/node-ca/0.log" May 26 19:28:07.180299 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.180265 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dbpt4"] May 26 19:28:07.183122 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.183098 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dbpt4" May 26 19:28:07.184177 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.184154 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-qfn7h"] May 26 19:28:07.185939 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.185922 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 26 19:28:07.186201 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.186179 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 26 19:28:07.186290 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.186211 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 26 19:28:07.186290 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.186276 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-bjvg5\"" May 26 19:28:07.186395 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.186213 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 26 19:28:07.186731 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.186713 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-qzlrj"] May 26 19:28:07.186878 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.186853 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qfn7h" May 26 19:28:07.189161 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.189144 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-z9ms9\"" May 26 19:28:07.189351 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.189315 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 26 19:28:07.189585 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.189571 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 26 19:28:07.189668 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.189589 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qzlrj" May 26 19:28:07.189668 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.189591 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 26 19:28:07.191832 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.191814 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 26 19:28:07.191939 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.191922 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 26 19:28:07.191985 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.191942 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bfhpw\"" May 26 19:28:07.192067 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.191996 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 26 19:28:07.192115 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.192092 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 26 19:28:07.196169 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.196147 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dbpt4"] May 26 19:28:07.196930 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.196913 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-qzlrj"] May 26 19:28:07.198903 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.198863 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-qfn7h"] May 26 19:28:07.296364 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.296317 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjfb6\" (UniqueName: \"kubernetes.io/projected/c32b7df0-3951-4635-b58d-9ac153849aba-kube-api-access-pjfb6\") pod \"service-ca-operator-57b5b68b8-qzlrj\" (UID: \"c32b7df0-3951-4635-b58d-9ac153849aba\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qzlrj" May 26 19:28:07.296520 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.296370 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5da566c-d02a-4260-9b09-280863b75669-config\") pod \"kube-storage-version-migrator-operator-565644f49-dbpt4\" (UID: \"e5da566c-d02a-4260-9b09-280863b75669\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dbpt4" May 26 19:28:07.296520 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.296462 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srhpc\" (UniqueName: \"kubernetes.io/projected/bd713a4f-1798-4e71-902d-161329b7ac8e-kube-api-access-srhpc\") pod \"cluster-samples-operator-697587599-qfn7h\" (UID: \"bd713a4f-1798-4e71-902d-161329b7ac8e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qfn7h" May 26 19:28:07.296520 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.296487 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c32b7df0-3951-4635-b58d-9ac153849aba-serving-cert\") pod \"service-ca-operator-57b5b68b8-qzlrj\" (UID: \"c32b7df0-3951-4635-b58d-9ac153849aba\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qzlrj" May 26 19:28:07.296520 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.296504 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c32b7df0-3951-4635-b58d-9ac153849aba-config\") pod \"service-ca-operator-57b5b68b8-qzlrj\" (UID: \"c32b7df0-3951-4635-b58d-9ac153849aba\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qzlrj" May 26 19:28:07.296649 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.296547 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5da566c-d02a-4260-9b09-280863b75669-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-dbpt4\" (UID: \"e5da566c-d02a-4260-9b09-280863b75669\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dbpt4" May 26 19:28:07.296649 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.296570 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd713a4f-1798-4e71-902d-161329b7ac8e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-qfn7h\" (UID: \"bd713a4f-1798-4e71-902d-161329b7ac8e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qfn7h" May 26 19:28:07.296649 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.296588 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9p8q\" (UniqueName: \"kubernetes.io/projected/e5da566c-d02a-4260-9b09-280863b75669-kube-api-access-m9p8q\") pod \"kube-storage-version-migrator-operator-565644f49-dbpt4\" (UID: \"e5da566c-d02a-4260-9b09-280863b75669\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dbpt4" May 26 19:28:07.397077 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.397044 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5da566c-d02a-4260-9b09-280863b75669-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-dbpt4\" (UID: \"e5da566c-d02a-4260-9b09-280863b75669\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dbpt4" May 26 19:28:07.397077 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.397078 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd713a4f-1798-4e71-902d-161329b7ac8e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-qfn7h\" (UID: \"bd713a4f-1798-4e71-902d-161329b7ac8e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qfn7h" May 26 19:28:07.397243 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.397100 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m9p8q\" (UniqueName: \"kubernetes.io/projected/e5da566c-d02a-4260-9b09-280863b75669-kube-api-access-m9p8q\") pod \"kube-storage-version-migrator-operator-565644f49-dbpt4\" (UID: \"e5da566c-d02a-4260-9b09-280863b75669\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dbpt4" May 26 19:28:07.397243 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.397137 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pjfb6\" (UniqueName: \"kubernetes.io/projected/c32b7df0-3951-4635-b58d-9ac153849aba-kube-api-access-pjfb6\") pod \"service-ca-operator-57b5b68b8-qzlrj\" (UID: \"c32b7df0-3951-4635-b58d-9ac153849aba\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qzlrj" May 26 19:28:07.397243 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.397168 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5da566c-d02a-4260-9b09-280863b75669-config\") pod \"kube-storage-version-migrator-operator-565644f49-dbpt4\" (UID: \"e5da566c-d02a-4260-9b09-280863b75669\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dbpt4" May 26 19:28:07.397243 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:07.397191 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 19:28:07.397243 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.397223 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-srhpc\" (UniqueName: \"kubernetes.io/projected/bd713a4f-1798-4e71-902d-161329b7ac8e-kube-api-access-srhpc\") pod \"cluster-samples-operator-697587599-qfn7h\" (UID: \"bd713a4f-1798-4e71-902d-161329b7ac8e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qfn7h" May 26 19:28:07.397503 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.397248 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c32b7df0-3951-4635-b58d-9ac153849aba-serving-cert\") pod \"service-ca-operator-57b5b68b8-qzlrj\" (UID: \"c32b7df0-3951-4635-b58d-9ac153849aba\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qzlrj" May 26 19:28:07.397503 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.397271 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c32b7df0-3951-4635-b58d-9ac153849aba-config\") pod \"service-ca-operator-57b5b68b8-qzlrj\" (UID: \"c32b7df0-3951-4635-b58d-9ac153849aba\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qzlrj" May 26 19:28:07.397503 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:07.397285 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd713a4f-1798-4e71-902d-161329b7ac8e-samples-operator-tls podName:bd713a4f-1798-4e71-902d-161329b7ac8e nodeName:}" failed. No retries permitted until 2026-05-26 19:28:07.897265492 +0000 UTC m=+152.431238262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bd713a4f-1798-4e71-902d-161329b7ac8e-samples-operator-tls") pod "cluster-samples-operator-697587599-qfn7h" (UID: "bd713a4f-1798-4e71-902d-161329b7ac8e") : secret "samples-operator-tls" not found May 26 19:28:07.397849 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.397829 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5da566c-d02a-4260-9b09-280863b75669-config\") pod \"kube-storage-version-migrator-operator-565644f49-dbpt4\" (UID: \"e5da566c-d02a-4260-9b09-280863b75669\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dbpt4" May 26 19:28:07.397930 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.397891 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c32b7df0-3951-4635-b58d-9ac153849aba-config\") pod \"service-ca-operator-57b5b68b8-qzlrj\" (UID: \"c32b7df0-3951-4635-b58d-9ac153849aba\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qzlrj" May 26 19:28:07.399361 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.399340 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5da566c-d02a-4260-9b09-280863b75669-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-dbpt4\" (UID: \"e5da566c-d02a-4260-9b09-280863b75669\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dbpt4" May 26 19:28:07.399435 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.399422 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c32b7df0-3951-4635-b58d-9ac153849aba-serving-cert\") pod \"service-ca-operator-57b5b68b8-qzlrj\" (UID: \"c32b7df0-3951-4635-b58d-9ac153849aba\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qzlrj" May 26 19:28:07.407994 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.407973 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9p8q\" (UniqueName: \"kubernetes.io/projected/e5da566c-d02a-4260-9b09-280863b75669-kube-api-access-m9p8q\") pod \"kube-storage-version-migrator-operator-565644f49-dbpt4\" (UID: \"e5da566c-d02a-4260-9b09-280863b75669\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dbpt4" May 26 19:28:07.408440 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.408421 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srhpc\" (UniqueName: \"kubernetes.io/projected/bd713a4f-1798-4e71-902d-161329b7ac8e-kube-api-access-srhpc\") pod \"cluster-samples-operator-697587599-qfn7h\" (UID: \"bd713a4f-1798-4e71-902d-161329b7ac8e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qfn7h" May 26 19:28:07.408542 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.408441 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjfb6\" (UniqueName: \"kubernetes.io/projected/c32b7df0-3951-4635-b58d-9ac153849aba-kube-api-access-pjfb6\") pod \"service-ca-operator-57b5b68b8-qzlrj\" (UID: \"c32b7df0-3951-4635-b58d-9ac153849aba\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qzlrj" May 26 19:28:07.494220 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.494135 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dbpt4" May 26 19:28:07.506176 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.506153 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qzlrj" May 26 19:28:07.619666 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.619631 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dbpt4"] May 26 19:28:07.622660 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:28:07.622635 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5da566c_d02a_4260_9b09_280863b75669.slice/crio-40e236bd91219beeb33c26bfd7038e1487098768d3aa1b254cae57e62551e371 WatchSource:0}: Error finding container 40e236bd91219beeb33c26bfd7038e1487098768d3aa1b254cae57e62551e371: Status 404 returned error can't find the container with id 40e236bd91219beeb33c26bfd7038e1487098768d3aa1b254cae57e62551e371 May 26 19:28:07.638079 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.638059 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-qzlrj"] May 26 19:28:07.640725 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:28:07.640703 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc32b7df0_3951_4635_b58d_9ac153849aba.slice/crio-893cd0fc583318e9d9a7b25e817380148a59d1d2bb835f55b4a74ab5f33bcac9 WatchSource:0}: Error finding container 893cd0fc583318e9d9a7b25e817380148a59d1d2bb835f55b4a74ab5f33bcac9: Status 404 returned error can't find the container with id 893cd0fc583318e9d9a7b25e817380148a59d1d2bb835f55b4a74ab5f33bcac9 May 26 19:28:07.900658 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:07.900621 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd713a4f-1798-4e71-902d-161329b7ac8e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-qfn7h\" (UID: \"bd713a4f-1798-4e71-902d-161329b7ac8e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qfn7h" May 26 19:28:07.900833 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:07.900758 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 19:28:07.900894 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:07.900840 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd713a4f-1798-4e71-902d-161329b7ac8e-samples-operator-tls podName:bd713a4f-1798-4e71-902d-161329b7ac8e nodeName:}" failed. No retries permitted until 2026-05-26 19:28:08.900819096 +0000 UTC m=+153.434791860 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bd713a4f-1798-4e71-902d-161329b7ac8e-samples-operator-tls") pod "cluster-samples-operator-697587599-qfn7h" (UID: "bd713a4f-1798-4e71-902d-161329b7ac8e") : secret "samples-operator-tls" not found May 26 19:28:08.546480 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:08.546443 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dbpt4" event={"ID":"e5da566c-d02a-4260-9b09-280863b75669","Type":"ContainerStarted","Data":"40e236bd91219beeb33c26bfd7038e1487098768d3aa1b254cae57e62551e371"} May 26 19:28:08.548340 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:08.548295 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qzlrj" event={"ID":"c32b7df0-3951-4635-b58d-9ac153849aba","Type":"ContainerStarted","Data":"893cd0fc583318e9d9a7b25e817380148a59d1d2bb835f55b4a74ab5f33bcac9"} May 26 19:28:08.907211 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:08.907176 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd713a4f-1798-4e71-902d-161329b7ac8e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-qfn7h\" (UID: \"bd713a4f-1798-4e71-902d-161329b7ac8e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qfn7h" May 26 19:28:08.907398 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:08.907336 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 19:28:08.907398 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:08.907397 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd713a4f-1798-4e71-902d-161329b7ac8e-samples-operator-tls podName:bd713a4f-1798-4e71-902d-161329b7ac8e nodeName:}" failed. No retries permitted until 2026-05-26 19:28:10.907382438 +0000 UTC m=+155.441355200 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bd713a4f-1798-4e71-902d-161329b7ac8e-samples-operator-tls") pod "cluster-samples-operator-697587599-qfn7h" (UID: "bd713a4f-1798-4e71-902d-161329b7ac8e") : secret "samples-operator-tls" not found May 26 19:28:10.554099 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:10.554061 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qzlrj" event={"ID":"c32b7df0-3951-4635-b58d-9ac153849aba","Type":"ContainerStarted","Data":"66b08a217a0e5fe9feb8d30126a982dad9adc8489bb0c0a5dde7e1342f3fe836"} May 26 19:28:10.555479 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:10.555452 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dbpt4" event={"ID":"e5da566c-d02a-4260-9b09-280863b75669","Type":"ContainerStarted","Data":"30eb85e357b757fa13eb5dae8ea012bbb9541616687bc049d7cd6988b1e4bba4"} May 26 19:28:10.569303 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:10.569264 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qzlrj" podStartSLOduration=1.3065549459999999 podStartE2EDuration="3.569253037s" podCreationTimestamp="2026-05-26 19:28:07 +0000 UTC" firstStartedPulling="2026-05-26 19:28:07.642224308 +0000 UTC m=+152.176197074" lastFinishedPulling="2026-05-26 19:28:09.904922402 +0000 UTC m=+154.438895165" observedRunningTime="2026-05-26 19:28:10.568601922 +0000 UTC m=+155.102574727" watchObservedRunningTime="2026-05-26 19:28:10.569253037 +0000 UTC m=+155.103225825" May 26 19:28:10.582970 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:10.582926 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dbpt4" podStartSLOduration=1.3001215369999999 podStartE2EDuration="3.582911772s" podCreationTimestamp="2026-05-26 19:28:07 +0000 UTC" firstStartedPulling="2026-05-26 19:28:07.624346297 +0000 UTC m=+152.158319059" lastFinishedPulling="2026-05-26 19:28:09.907136518 +0000 UTC m=+154.441109294" observedRunningTime="2026-05-26 19:28:10.582773503 +0000 UTC m=+155.116746286" watchObservedRunningTime="2026-05-26 19:28:10.582911772 +0000 UTC m=+155.116884554" May 26 19:28:10.923857 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:10.923825 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd713a4f-1798-4e71-902d-161329b7ac8e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-qfn7h\" (UID: \"bd713a4f-1798-4e71-902d-161329b7ac8e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qfn7h" May 26 19:28:10.924040 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:10.924016 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 19:28:10.924111 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:10.924100 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd713a4f-1798-4e71-902d-161329b7ac8e-samples-operator-tls podName:bd713a4f-1798-4e71-902d-161329b7ac8e nodeName:}" failed. No retries permitted until 2026-05-26 19:28:14.924079212 +0000 UTC m=+159.458051980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bd713a4f-1798-4e71-902d-161329b7ac8e-samples-operator-tls") pod "cluster-samples-operator-697587599-qfn7h" (UID: "bd713a4f-1798-4e71-902d-161329b7ac8e") : secret "samples-operator-tls" not found May 26 19:28:11.289035 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:11.288950 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-fdvw4"] May 26 19:28:11.292130 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:11.292110 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-fdvw4" May 26 19:28:11.294839 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:11.294819 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 26 19:28:11.294942 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:11.294887 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jp8q9\"" May 26 19:28:11.294942 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:11.294820 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 26 19:28:11.301246 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:11.301226 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-fdvw4"] May 26 19:28:11.328100 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:11.328077 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qbcn\" (UniqueName: \"kubernetes.io/projected/6fd28605-975d-4692-895c-c54c654a244e-kube-api-access-2qbcn\") pod \"migrator-b985f5d89-fdvw4\" (UID: \"6fd28605-975d-4692-895c-c54c654a244e\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-fdvw4" May 26 19:28:11.429133 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:11.429095 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2qbcn\" (UniqueName: \"kubernetes.io/projected/6fd28605-975d-4692-895c-c54c654a244e-kube-api-access-2qbcn\") pod \"migrator-b985f5d89-fdvw4\" (UID: \"6fd28605-975d-4692-895c-c54c654a244e\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-fdvw4" May 26 19:28:11.440934 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:11.440909 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qbcn\" (UniqueName: \"kubernetes.io/projected/6fd28605-975d-4692-895c-c54c654a244e-kube-api-access-2qbcn\") pod \"migrator-b985f5d89-fdvw4\" (UID: \"6fd28605-975d-4692-895c-c54c654a244e\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-fdvw4" May 26 19:28:11.600315 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:11.600232 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-fdvw4" May 26 19:28:11.718259 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:11.718226 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-fdvw4"] May 26 19:28:11.721406 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:28:11.721379 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd28605_975d_4692_895c_c54c654a244e.slice/crio-0f9d63a7a7678bda5c186af845b3824d7b43a68ed508beb20020c5df9335e1a5 WatchSource:0}: Error finding container 0f9d63a7a7678bda5c186af845b3824d7b43a68ed508beb20020c5df9335e1a5: Status 404 returned error can't find the container with id 0f9d63a7a7678bda5c186af845b3824d7b43a68ed508beb20020c5df9335e1a5 May 26 19:28:12.560225 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:12.560195 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-fdvw4" event={"ID":"6fd28605-975d-4692-895c-c54c654a244e","Type":"ContainerStarted","Data":"0f9d63a7a7678bda5c186af845b3824d7b43a68ed508beb20020c5df9335e1a5"} May 26 19:28:12.784674 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:12.784642 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-s6nbq" podUID="508f26c0-895c-41a4-ad07-6119ac41ab6a" May 26 19:28:12.790808 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:12.790779 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-d9w79" podUID="3346df9a-a455-49fe-8602-808efc59cadc" May 26 19:28:13.563561 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:13.563523 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-fdvw4" event={"ID":"6fd28605-975d-4692-895c-c54c654a244e","Type":"ContainerStarted","Data":"c4869e8443dd6c6d793997272a63f315a95f0a977f9064887a279f1af65b0306"} May 26 19:28:13.563561 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:13.563558 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d9w79" May 26 19:28:13.563743 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:13.563568 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-fdvw4" event={"ID":"6fd28605-975d-4692-895c-c54c654a244e","Type":"ContainerStarted","Data":"0278d698ec706ed9d916f0c029526e1054b0d43bf6ab43ef773175d6bbbd96ea"} May 26 19:28:13.563931 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:13.563913 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s6nbq" May 26 19:28:13.580845 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:13.580802 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-fdvw4" podStartSLOduration=1.6954152489999998 podStartE2EDuration="2.580790406s" podCreationTimestamp="2026-05-26 19:28:11 +0000 UTC" firstStartedPulling="2026-05-26 19:28:11.723779521 +0000 UTC m=+156.257752286" lastFinishedPulling="2026-05-26 19:28:12.609154681 +0000 UTC m=+157.143127443" observedRunningTime="2026-05-26 19:28:13.579912762 +0000 UTC m=+158.113885698" watchObservedRunningTime="2026-05-26 19:28:13.580790406 +0000 UTC m=+158.114763189" May 26 19:28:14.109403 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:14.109367 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qsdsm" podUID="6ee8f53e-5d8f-4944-89c4-ed98b8fad590" May 26 19:28:14.211397 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:14.211363 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kcfsc"] May 26 19:28:14.214589 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:14.214574 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kcfsc" May 26 19:28:14.216827 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:14.216803 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xvgwn\"" May 26 19:28:14.216942 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:14.216812 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 26 19:28:14.217875 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:14.217852 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 26 19:28:14.217875 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:14.217868 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 26 19:28:14.218039 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:14.217918 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 26 19:28:14.224201 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:14.224180 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kcfsc"] May 26 19:28:14.252922 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:14.252897 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/20b0cef4-e410-41b5-a73e-516948fe3616-crio-socket\") pod \"insights-runtime-extractor-kcfsc\" (UID: \"20b0cef4-e410-41b5-a73e-516948fe3616\") " pod="openshift-insights/insights-runtime-extractor-kcfsc" May 26 19:28:14.253063 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:14.252937 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fn88\" (UniqueName: \"kubernetes.io/projected/20b0cef4-e410-41b5-a73e-516948fe3616-kube-api-access-7fn88\") pod \"insights-runtime-extractor-kcfsc\" (UID: \"20b0cef4-e410-41b5-a73e-516948fe3616\") " pod="openshift-insights/insights-runtime-extractor-kcfsc" May 26 19:28:14.253063 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:14.252965 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/20b0cef4-e410-41b5-a73e-516948fe3616-data-volume\") pod \"insights-runtime-extractor-kcfsc\" (UID: \"20b0cef4-e410-41b5-a73e-516948fe3616\") " pod="openshift-insights/insights-runtime-extractor-kcfsc" May 26 19:28:14.253173 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:14.253057 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20b0cef4-e410-41b5-a73e-516948fe3616-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kcfsc\" (UID: \"20b0cef4-e410-41b5-a73e-516948fe3616\") " pod="openshift-insights/insights-runtime-extractor-kcfsc" May 26 19:28:14.253173 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:14.253092 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20b0cef4-e410-41b5-a73e-516948fe3616-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kcfsc\" (UID: \"20b0cef4-e410-41b5-a73e-516948fe3616\") " pod="openshift-insights/insights-runtime-extractor-kcfsc" May 26 19:28:14.354331 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:14.354302 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/20b0cef4-e410-41b5-a73e-516948fe3616-crio-socket\") pod \"insights-runtime-extractor-kcfsc\" (UID: \"20b0cef4-e410-41b5-a73e-516948fe3616\") " pod="openshift-insights/insights-runtime-extractor-kcfsc" May 26 19:28:14.354464 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:14.354361 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7fn88\" (UniqueName: \"kubernetes.io/projected/20b0cef4-e410-41b5-a73e-516948fe3616-kube-api-access-7fn88\") pod \"insights-runtime-extractor-kcfsc\" (UID: \"20b0cef4-e410-41b5-a73e-516948fe3616\") " pod="openshift-insights/insights-runtime-extractor-kcfsc" May 26 19:28:14.354464 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:14.354407 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/20b0cef4-e410-41b5-a73e-516948fe3616-data-volume\") pod \"insights-runtime-extractor-kcfsc\" (UID: \"20b0cef4-e410-41b5-a73e-516948fe3616\") " pod="openshift-insights/insights-runtime-extractor-kcfsc" May 26 19:28:14.354464 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:14.354421 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/20b0cef4-e410-41b5-a73e-516948fe3616-crio-socket\") pod \"insights-runtime-extractor-kcfsc\" (UID: \"20b0cef4-e410-41b5-a73e-516948fe3616\") " pod="openshift-insights/insights-runtime-extractor-kcfsc" May 26 19:28:14.354614 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:14.354457 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20b0cef4-e410-41b5-a73e-516948fe3616-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kcfsc\" (UID: \"20b0cef4-e410-41b5-a73e-516948fe3616\") " pod="openshift-insights/insights-runtime-extractor-kcfsc" May 26 19:28:14.354614 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:14.354604 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20b0cef4-e410-41b5-a73e-516948fe3616-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kcfsc\" (UID: \"20b0cef4-e410-41b5-a73e-516948fe3616\") " pod="openshift-insights/insights-runtime-extractor-kcfsc" May 26 19:28:14.354718 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:14.354702 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 26 19:28:14.354772 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:14.354765 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20b0cef4-e410-41b5-a73e-516948fe3616-insights-runtime-extractor-tls podName:20b0cef4-e410-41b5-a73e-516948fe3616 nodeName:}" failed. No retries permitted until 2026-05-26 19:28:14.854750375 +0000 UTC m=+159.388723137 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/20b0cef4-e410-41b5-a73e-516948fe3616-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kcfsc" (UID: "20b0cef4-e410-41b5-a73e-516948fe3616") : secret "insights-runtime-extractor-tls" not found May 26 19:28:14.354835 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:14.354816 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/20b0cef4-e410-41b5-a73e-516948fe3616-data-volume\") pod \"insights-runtime-extractor-kcfsc\" (UID: \"20b0cef4-e410-41b5-a73e-516948fe3616\") " pod="openshift-insights/insights-runtime-extractor-kcfsc" May 26 19:28:14.355043 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:14.355029 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20b0cef4-e410-41b5-a73e-516948fe3616-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kcfsc\" (UID: \"20b0cef4-e410-41b5-a73e-516948fe3616\") " pod="openshift-insights/insights-runtime-extractor-kcfsc" May 26 19:28:14.362721 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:14.362664 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fn88\" (UniqueName: \"kubernetes.io/projected/20b0cef4-e410-41b5-a73e-516948fe3616-kube-api-access-7fn88\") pod \"insights-runtime-extractor-kcfsc\" (UID: \"20b0cef4-e410-41b5-a73e-516948fe3616\") " pod="openshift-insights/insights-runtime-extractor-kcfsc" May 26 19:28:14.857894 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:14.857860 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20b0cef4-e410-41b5-a73e-516948fe3616-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kcfsc\" (UID: \"20b0cef4-e410-41b5-a73e-516948fe3616\") " pod="openshift-insights/insights-runtime-extractor-kcfsc" May 26 19:28:14.858054 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:14.858003 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 26 19:28:14.858103 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:14.858094 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20b0cef4-e410-41b5-a73e-516948fe3616-insights-runtime-extractor-tls podName:20b0cef4-e410-41b5-a73e-516948fe3616 nodeName:}" failed. No retries permitted until 2026-05-26 19:28:15.85807825 +0000 UTC m=+160.392051012 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/20b0cef4-e410-41b5-a73e-516948fe3616-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kcfsc" (UID: "20b0cef4-e410-41b5-a73e-516948fe3616") : secret "insights-runtime-extractor-tls" not found May 26 19:28:14.958334 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:14.958291 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd713a4f-1798-4e71-902d-161329b7ac8e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-qfn7h\" (UID: \"bd713a4f-1798-4e71-902d-161329b7ac8e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qfn7h" May 26 19:28:14.958488 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:14.958436 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 19:28:14.958532 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:14.958501 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd713a4f-1798-4e71-902d-161329b7ac8e-samples-operator-tls podName:bd713a4f-1798-4e71-902d-161329b7ac8e nodeName:}" failed. No retries permitted until 2026-05-26 19:28:22.958485646 +0000 UTC m=+167.492458412 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bd713a4f-1798-4e71-902d-161329b7ac8e-samples-operator-tls") pod "cluster-samples-operator-697587599-qfn7h" (UID: "bd713a4f-1798-4e71-902d-161329b7ac8e") : secret "samples-operator-tls" not found May 26 19:28:15.864334 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:15.864301 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20b0cef4-e410-41b5-a73e-516948fe3616-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kcfsc\" (UID: \"20b0cef4-e410-41b5-a73e-516948fe3616\") " pod="openshift-insights/insights-runtime-extractor-kcfsc" May 26 19:28:15.864705 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:15.864453 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 26 19:28:15.864705 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:15.864516 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20b0cef4-e410-41b5-a73e-516948fe3616-insights-runtime-extractor-tls podName:20b0cef4-e410-41b5-a73e-516948fe3616 nodeName:}" failed. No retries permitted until 2026-05-26 19:28:17.864499806 +0000 UTC m=+162.398472593 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/20b0cef4-e410-41b5-a73e-516948fe3616-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kcfsc" (UID: "20b0cef4-e410-41b5-a73e-516948fe3616") : secret "insights-runtime-extractor-tls" not found May 26 19:28:17.677257 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:17.677225 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert\") pod \"ingress-canary-s6nbq\" (UID: \"508f26c0-895c-41a4-ad07-6119ac41ab6a\") " pod="openshift-ingress-canary/ingress-canary-s6nbq" May 26 19:28:17.677257 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:17.677261 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls\") pod \"dns-default-d9w79\" (UID: \"3346df9a-a455-49fe-8602-808efc59cadc\") " pod="openshift-dns/dns-default-d9w79" May 26 19:28:17.677667 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:17.677391 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 19:28:17.677667 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:17.677391 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 19:28:17.677667 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:17.677441 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls podName:3346df9a-a455-49fe-8602-808efc59cadc nodeName:}" failed. No retries permitted until 2026-05-26 19:30:19.677428501 +0000 UTC m=+284.211401263 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls") pod "dns-default-d9w79" (UID: "3346df9a-a455-49fe-8602-808efc59cadc") : secret "dns-default-metrics-tls" not found May 26 19:28:17.677667 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:17.677454 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert podName:508f26c0-895c-41a4-ad07-6119ac41ab6a nodeName:}" failed. No retries permitted until 2026-05-26 19:30:19.67744864 +0000 UTC m=+284.211421401 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert") pod "ingress-canary-s6nbq" (UID: "508f26c0-895c-41a4-ad07-6119ac41ab6a") : secret "canary-serving-cert" not found May 26 19:28:17.878807 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:17.878761 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20b0cef4-e410-41b5-a73e-516948fe3616-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kcfsc\" (UID: \"20b0cef4-e410-41b5-a73e-516948fe3616\") " pod="openshift-insights/insights-runtime-extractor-kcfsc" May 26 19:28:17.878990 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:17.878911 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 26 19:28:17.878990 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:17.878980 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20b0cef4-e410-41b5-a73e-516948fe3616-insights-runtime-extractor-tls podName:20b0cef4-e410-41b5-a73e-516948fe3616 nodeName:}" failed. No retries permitted until 2026-05-26 19:28:21.878965006 +0000 UTC m=+166.412937773 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/20b0cef4-e410-41b5-a73e-516948fe3616-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kcfsc" (UID: "20b0cef4-e410-41b5-a73e-516948fe3616") : secret "insights-runtime-extractor-tls" not found May 26 19:28:21.910966 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:21.910927 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20b0cef4-e410-41b5-a73e-516948fe3616-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kcfsc\" (UID: \"20b0cef4-e410-41b5-a73e-516948fe3616\") " pod="openshift-insights/insights-runtime-extractor-kcfsc" May 26 19:28:21.911384 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:21.911044 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 26 19:28:21.911384 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:21.911103 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20b0cef4-e410-41b5-a73e-516948fe3616-insights-runtime-extractor-tls podName:20b0cef4-e410-41b5-a73e-516948fe3616 nodeName:}" failed. No retries permitted until 2026-05-26 19:28:29.911088952 +0000 UTC m=+174.445061714 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/20b0cef4-e410-41b5-a73e-516948fe3616-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kcfsc" (UID: "20b0cef4-e410-41b5-a73e-516948fe3616") : secret "insights-runtime-extractor-tls" not found May 26 19:28:23.017658 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:23.017620 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd713a4f-1798-4e71-902d-161329b7ac8e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-qfn7h\" (UID: \"bd713a4f-1798-4e71-902d-161329b7ac8e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qfn7h" May 26 19:28:23.020015 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:23.019991 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd713a4f-1798-4e71-902d-161329b7ac8e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-qfn7h\" (UID: \"bd713a4f-1798-4e71-902d-161329b7ac8e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qfn7h" May 26 19:28:23.101057 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:23.101024 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qfn7h" May 26 19:28:23.214965 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:23.214925 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-qfn7h"] May 26 19:28:23.586160 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:23.586129 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qfn7h" event={"ID":"bd713a4f-1798-4e71-902d-161329b7ac8e","Type":"ContainerStarted","Data":"3d12049420ca40d81a2c8de8fb4a519283e3e871575401bf4dd2cea8b7c9fbcd"} May 26 19:28:25.592607 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:25.592527 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qfn7h" event={"ID":"bd713a4f-1798-4e71-902d-161329b7ac8e","Type":"ContainerStarted","Data":"cbfe9fd0848206093ca09fb699e41cec972c53210bb0142cbad36a018e2f48b5"} May 26 19:28:25.592607 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:25.592564 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qfn7h" event={"ID":"bd713a4f-1798-4e71-902d-161329b7ac8e","Type":"ContainerStarted","Data":"18f1ced52b02dc072a8488763ca91f2b3cf3db940ed3e7ea0a2d0797a25f058a"} May 26 19:28:25.608116 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:25.608076 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qfn7h" podStartSLOduration=16.691154695 podStartE2EDuration="18.608065487s" podCreationTimestamp="2026-05-26 19:28:07 +0000 UTC" firstStartedPulling="2026-05-26 19:28:23.253197482 +0000 UTC m=+167.787170244" lastFinishedPulling="2026-05-26 19:28:25.170108271 +0000 UTC m=+169.704081036" observedRunningTime="2026-05-26 19:28:25.607661666 +0000 UTC m=+170.141634462" watchObservedRunningTime="2026-05-26 19:28:25.608065487 +0000 UTC m=+170.142038270" May 26 19:28:28.099674 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:28.099640 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:28:29.971461 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:29.971413 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20b0cef4-e410-41b5-a73e-516948fe3616-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kcfsc\" (UID: \"20b0cef4-e410-41b5-a73e-516948fe3616\") " pod="openshift-insights/insights-runtime-extractor-kcfsc" May 26 19:28:29.973652 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:29.973629 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20b0cef4-e410-41b5-a73e-516948fe3616-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kcfsc\" (UID: \"20b0cef4-e410-41b5-a73e-516948fe3616\") " pod="openshift-insights/insights-runtime-extractor-kcfsc" May 26 19:28:30.123580 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:30.123547 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kcfsc" May 26 19:28:30.239883 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:30.239799 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kcfsc"] May 26 19:28:30.243418 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:28:30.243376 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20b0cef4_e410_41b5_a73e_516948fe3616.slice/crio-005f3edbc85b70f28ab04e3ae5ee3135d55db4d27e9a1532744cbc59f88550e5 WatchSource:0}: Error finding container 005f3edbc85b70f28ab04e3ae5ee3135d55db4d27e9a1532744cbc59f88550e5: Status 404 returned error can't find the container with id 005f3edbc85b70f28ab04e3ae5ee3135d55db4d27e9a1532744cbc59f88550e5 May 26 19:28:30.605435 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:30.605312 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kcfsc" event={"ID":"20b0cef4-e410-41b5-a73e-516948fe3616","Type":"ContainerStarted","Data":"3051f5dbe1dde8bd843c294f38de475284ce8eba453fe6bb81fa0ea42f6110d5"} May 26 19:28:30.605435 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:30.605378 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kcfsc" event={"ID":"20b0cef4-e410-41b5-a73e-516948fe3616","Type":"ContainerStarted","Data":"005f3edbc85b70f28ab04e3ae5ee3135d55db4d27e9a1532744cbc59f88550e5"} May 26 19:28:31.609396 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:31.609360 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kcfsc" event={"ID":"20b0cef4-e410-41b5-a73e-516948fe3616","Type":"ContainerStarted","Data":"19e552ba38e17543e1a49a6b89387541cffd4c151d6008e7b3e2543f917fb3ee"} May 26 19:28:33.619102 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:33.619065 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kcfsc" event={"ID":"20b0cef4-e410-41b5-a73e-516948fe3616","Type":"ContainerStarted","Data":"c950b5e7889704c7c3af68efd3c0c4a69933f3b6edd4b0d92842115074c66c5a"} May 26 19:28:33.635674 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:33.635626 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kcfsc" podStartSLOduration=16.892318879 podStartE2EDuration="19.635612474s" podCreationTimestamp="2026-05-26 19:28:14 +0000 UTC" firstStartedPulling="2026-05-26 19:28:30.293576564 +0000 UTC m=+174.827549325" lastFinishedPulling="2026-05-26 19:28:33.036870155 +0000 UTC m=+177.570842920" observedRunningTime="2026-05-26 19:28:33.634460901 +0000 UTC m=+178.168433686" watchObservedRunningTime="2026-05-26 19:28:33.635612474 +0000 UTC m=+178.169585258" May 26 19:28:34.070053 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:34.070016 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" podUID="d65f72d3-f87e-4df0-830b-cd3a68f45e30" May 26 19:28:34.482667 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:34.482635 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6594c59fdc-26mxj"] May 26 19:28:34.591036 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:34.591002 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-ff7jc"] May 26 19:28:34.593970 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:34.593950 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-ff7jc" May 26 19:28:34.596251 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:34.596231 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 26 19:28:34.596363 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:34.596235 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 26 19:28:34.596363 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:34.596294 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-k4xqp\"" May 26 19:28:34.604752 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:34.604732 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-ff7jc"] May 26 19:28:34.620968 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:34.620951 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:28:34.621233 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:34.621188 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" podUID="d65f72d3-f87e-4df0-830b-cd3a68f45e30" May 26 19:28:34.705571 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:34.705536 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26vp2\" (UniqueName: \"kubernetes.io/projected/4f8b8e1d-613a-42d9-be26-7d0e14b5dc41-kube-api-access-26vp2\") pod \"downloads-57bd96b888-ff7jc\" (UID: \"4f8b8e1d-613a-42d9-be26-7d0e14b5dc41\") " pod="openshift-console/downloads-57bd96b888-ff7jc" May 26 19:28:34.807176 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:34.807096 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-26vp2\" (UniqueName: \"kubernetes.io/projected/4f8b8e1d-613a-42d9-be26-7d0e14b5dc41-kube-api-access-26vp2\") pod \"downloads-57bd96b888-ff7jc\" (UID: \"4f8b8e1d-613a-42d9-be26-7d0e14b5dc41\") " pod="openshift-console/downloads-57bd96b888-ff7jc" May 26 19:28:34.814715 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:34.814692 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26vp2\" (UniqueName: \"kubernetes.io/projected/4f8b8e1d-613a-42d9-be26-7d0e14b5dc41-kube-api-access-26vp2\") pod \"downloads-57bd96b888-ff7jc\" (UID: \"4f8b8e1d-613a-42d9-be26-7d0e14b5dc41\") " pod="openshift-console/downloads-57bd96b888-ff7jc" May 26 19:28:34.903412 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:34.903379 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-ff7jc" May 26 19:28:35.025044 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:35.025013 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-ff7jc"] May 26 19:28:35.027729 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:28:35.027703 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f8b8e1d_613a_42d9_be26_7d0e14b5dc41.slice/crio-45e05d73423ade8e61582fdc817a3ce6a42d6e3a27cb2a55648a292e4660eebc WatchSource:0}: Error finding container 45e05d73423ade8e61582fdc817a3ce6a42d6e3a27cb2a55648a292e4660eebc: Status 404 returned error can't find the container with id 45e05d73423ade8e61582fdc817a3ce6a42d6e3a27cb2a55648a292e4660eebc May 26 19:28:35.624296 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:35.624266 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-ff7jc" event={"ID":"4f8b8e1d-613a-42d9-be26-7d0e14b5dc41","Type":"ContainerStarted","Data":"45e05d73423ade8e61582fdc817a3ce6a42d6e3a27cb2a55648a292e4660eebc"} May 26 19:28:35.624296 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:35.624285 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:28:35.628414 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:35.628395 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:28:35.715505 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:35.715473 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vltpz\" (UniqueName: \"kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-kube-api-access-vltpz\") pod \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " May 26 19:28:35.715505 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:35.715512 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-bound-sa-token\") pod \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " May 26 19:28:35.715735 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:35.715547 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d65f72d3-f87e-4df0-830b-cd3a68f45e30-image-registry-private-configuration\") pod \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " May 26 19:28:35.715735 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:35.715574 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d65f72d3-f87e-4df0-830b-cd3a68f45e30-ca-trust-extracted\") pod \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " May 26 19:28:35.715735 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:35.715610 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-certificates\") pod \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " May 26 19:28:35.715735 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:35.715642 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d65f72d3-f87e-4df0-830b-cd3a68f45e30-installation-pull-secrets\") pod \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " May 26 19:28:35.715735 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:35.715669 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d65f72d3-f87e-4df0-830b-cd3a68f45e30-trusted-ca\") pod \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\" (UID: \"d65f72d3-f87e-4df0-830b-cd3a68f45e30\") " May 26 19:28:35.716193 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:35.716143 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d65f72d3-f87e-4df0-830b-cd3a68f45e30" (UID: "d65f72d3-f87e-4df0-830b-cd3a68f45e30"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 19:28:35.716193 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:35.716170 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d65f72d3-f87e-4df0-830b-cd3a68f45e30-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d65f72d3-f87e-4df0-830b-cd3a68f45e30" (UID: "d65f72d3-f87e-4df0-830b-cd3a68f45e30"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:28:35.716392 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:35.716337 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d65f72d3-f87e-4df0-830b-cd3a68f45e30-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d65f72d3-f87e-4df0-830b-cd3a68f45e30" (UID: "d65f72d3-f87e-4df0-830b-cd3a68f45e30"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 19:28:35.718195 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:35.718102 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d65f72d3-f87e-4df0-830b-cd3a68f45e30" (UID: "d65f72d3-f87e-4df0-830b-cd3a68f45e30"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:28:35.718195 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:35.718128 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d65f72d3-f87e-4df0-830b-cd3a68f45e30-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d65f72d3-f87e-4df0-830b-cd3a68f45e30" (UID: "d65f72d3-f87e-4df0-830b-cd3a68f45e30"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:28:35.718391 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:35.718252 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d65f72d3-f87e-4df0-830b-cd3a68f45e30-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d65f72d3-f87e-4df0-830b-cd3a68f45e30" (UID: "d65f72d3-f87e-4df0-830b-cd3a68f45e30"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:28:35.718391 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:35.718372 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-kube-api-access-vltpz" (OuterVolumeSpecName: "kube-api-access-vltpz") pod "d65f72d3-f87e-4df0-830b-cd3a68f45e30" (UID: "d65f72d3-f87e-4df0-830b-cd3a68f45e30"). InnerVolumeSpecName "kube-api-access-vltpz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:28:35.816999 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:35.816970 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-certificates\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:28:35.816999 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:35.816999 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d65f72d3-f87e-4df0-830b-cd3a68f45e30-installation-pull-secrets\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:28:35.817191 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:35.817013 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d65f72d3-f87e-4df0-830b-cd3a68f45e30-trusted-ca\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:28:35.817191 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:35.817025 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vltpz\" (UniqueName: \"kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-kube-api-access-vltpz\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:28:35.817191 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:35.817037 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-bound-sa-token\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:28:35.817191 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:35.817049 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d65f72d3-f87e-4df0-830b-cd3a68f45e30-image-registry-private-configuration\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:28:35.817191 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:35.817062 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d65f72d3-f87e-4df0-830b-cd3a68f45e30-ca-trust-extracted\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:28:36.626863 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:36.626832 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6594c59fdc-26mxj" May 26 19:28:36.655408 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:36.655374 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6594c59fdc-26mxj"] May 26 19:28:36.664502 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:36.664467 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6594c59fdc-26mxj"] May 26 19:28:36.824962 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:36.824928 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d65f72d3-f87e-4df0-830b-cd3a68f45e30-registry-tls\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:28:38.103266 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:38.103225 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d65f72d3-f87e-4df0-830b-cd3a68f45e30" path="/var/lib/kubelet/pods/d65f72d3-f87e-4df0-830b-cd3a68f45e30/volumes" May 26 19:28:39.079591 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:39.079550 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-jjgpv"] May 26 19:28:39.084107 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:39.084085 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjgpv" May 26 19:28:39.086710 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:39.086686 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 26 19:28:39.086841 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:39.086726 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 26 19:28:39.086841 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:39.086731 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 26 19:28:39.087773 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:39.087752 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 26 19:28:39.087908 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:39.087819 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 26 19:28:39.087908 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:39.087861 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jjtvr\"" May 26 19:28:39.091233 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:39.091211 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-jjgpv"] May 26 19:28:39.245646 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:39.245612 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c341c15c-dd66-4ef9-9b86-aaf5a30bf57f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-jjgpv\" (UID: \"c341c15c-dd66-4ef9-9b86-aaf5a30bf57f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjgpv" May 26 19:28:39.246058 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:39.245675 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c341c15c-dd66-4ef9-9b86-aaf5a30bf57f-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-jjgpv\" (UID: \"c341c15c-dd66-4ef9-9b86-aaf5a30bf57f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjgpv" May 26 19:28:39.246058 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:39.245714 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c341c15c-dd66-4ef9-9b86-aaf5a30bf57f-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-jjgpv\" (UID: \"c341c15c-dd66-4ef9-9b86-aaf5a30bf57f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjgpv" May 26 19:28:39.246058 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:39.245740 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnr99\" (UniqueName: \"kubernetes.io/projected/c341c15c-dd66-4ef9-9b86-aaf5a30bf57f-kube-api-access-jnr99\") pod \"prometheus-operator-7779bbdd78-jjgpv\" (UID: \"c341c15c-dd66-4ef9-9b86-aaf5a30bf57f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjgpv" May 26 19:28:39.347234 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:39.347145 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c341c15c-dd66-4ef9-9b86-aaf5a30bf57f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-jjgpv\" (UID: \"c341c15c-dd66-4ef9-9b86-aaf5a30bf57f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjgpv" May 26 19:28:39.347234 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:39.347198 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c341c15c-dd66-4ef9-9b86-aaf5a30bf57f-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-jjgpv\" (UID: \"c341c15c-dd66-4ef9-9b86-aaf5a30bf57f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjgpv" May 26 19:28:39.347445 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:39.347235 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c341c15c-dd66-4ef9-9b86-aaf5a30bf57f-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-jjgpv\" (UID: \"c341c15c-dd66-4ef9-9b86-aaf5a30bf57f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjgpv" May 26 19:28:39.347445 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:39.347261 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jnr99\" (UniqueName: \"kubernetes.io/projected/c341c15c-dd66-4ef9-9b86-aaf5a30bf57f-kube-api-access-jnr99\") pod \"prometheus-operator-7779bbdd78-jjgpv\" (UID: \"c341c15c-dd66-4ef9-9b86-aaf5a30bf57f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjgpv" May 26 19:28:39.347981 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:39.347942 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c341c15c-dd66-4ef9-9b86-aaf5a30bf57f-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-jjgpv\" (UID: \"c341c15c-dd66-4ef9-9b86-aaf5a30bf57f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjgpv" May 26 19:28:39.349894 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:39.349874 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c341c15c-dd66-4ef9-9b86-aaf5a30bf57f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-jjgpv\" (UID: \"c341c15c-dd66-4ef9-9b86-aaf5a30bf57f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjgpv" May 26 19:28:39.349998 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:39.349983 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c341c15c-dd66-4ef9-9b86-aaf5a30bf57f-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-jjgpv\" (UID: \"c341c15c-dd66-4ef9-9b86-aaf5a30bf57f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjgpv" May 26 19:28:39.360827 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:39.360799 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnr99\" (UniqueName: \"kubernetes.io/projected/c341c15c-dd66-4ef9-9b86-aaf5a30bf57f-kube-api-access-jnr99\") pod \"prometheus-operator-7779bbdd78-jjgpv\" (UID: \"c341c15c-dd66-4ef9-9b86-aaf5a30bf57f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjgpv" May 26 19:28:39.395024 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:39.394994 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjgpv" May 26 19:28:39.530870 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:39.530829 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-jjgpv"] May 26 19:28:39.534949 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:28:39.534907 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc341c15c_dd66_4ef9_9b86_aaf5a30bf57f.slice/crio-8503fe26a5ae3bd3f58daa832ca2eddf3f39a90ff7358da137594a4961ee0175 WatchSource:0}: Error finding container 8503fe26a5ae3bd3f58daa832ca2eddf3f39a90ff7358da137594a4961ee0175: Status 404 returned error can't find the container with id 8503fe26a5ae3bd3f58daa832ca2eddf3f39a90ff7358da137594a4961ee0175 May 26 19:28:39.635687 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:39.635656 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjgpv" event={"ID":"c341c15c-dd66-4ef9-9b86-aaf5a30bf57f","Type":"ContainerStarted","Data":"8503fe26a5ae3bd3f58daa832ca2eddf3f39a90ff7358da137594a4961ee0175"} May 26 19:28:41.643721 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:41.643685 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjgpv" event={"ID":"c341c15c-dd66-4ef9-9b86-aaf5a30bf57f","Type":"ContainerStarted","Data":"e2877ca73f6cb9498cf715f40a2e5cded5987b616ca7488bab0de6be6304f17d"} May 26 19:28:41.644187 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:41.643727 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjgpv" event={"ID":"c341c15c-dd66-4ef9-9b86-aaf5a30bf57f","Type":"ContainerStarted","Data":"d852cb007dc43fcd4bfe09ed7863b12c8d901d2f9fd42677c445cfedb34d3599"} May 26 19:28:41.660318 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:41.660272 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-jjgpv" podStartSLOduration=0.892187525 podStartE2EDuration="2.66025794s" podCreationTimestamp="2026-05-26 19:28:39 +0000 UTC" firstStartedPulling="2026-05-26 19:28:39.536980095 +0000 UTC m=+184.070952857" lastFinishedPulling="2026-05-26 19:28:41.305050497 +0000 UTC m=+185.839023272" observedRunningTime="2026-05-26 19:28:41.658944677 +0000 UTC m=+186.192917462" watchObservedRunningTime="2026-05-26 19:28:41.66025794 +0000 UTC m=+186.194230723" May 26 19:28:43.397076 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.397047 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-x8z9m"] May 26 19:28:43.401951 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.401853 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-x8z9m" May 26 19:28:43.404101 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.404077 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 26 19:28:43.404206 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.404127 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 26 19:28:43.404206 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.404135 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-b7mjp\"" May 26 19:28:43.408368 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.408054 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-x8z9m"] May 26 19:28:43.416402 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.416382 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj"] May 26 19:28:43.422177 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.422160 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj" May 26 19:28:43.424953 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.424902 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 26 19:28:43.424953 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.424939 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 26 19:28:43.425132 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.424985 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7sq9v\"" May 26 19:28:43.425185 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.425175 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 26 19:28:43.432039 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.432007 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj"] May 26 19:28:43.440276 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.440253 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f47x8"] May 26 19:28:43.445856 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.445838 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.447982 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.447962 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gkhmx\"" May 26 19:28:43.448077 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.447962 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 26 19:28:43.448077 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.448043 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 26 19:28:43.448077 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.448056 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 26 19:28:43.485872 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.485847 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d4ee97d-ba1e-479e-a42c-eb682fc511bf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-x8z9m\" (UID: \"6d4ee97d-ba1e-479e-a42c-eb682fc511bf\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x8z9m" May 26 19:28:43.486001 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.485877 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d4ee97d-ba1e-479e-a42c-eb682fc511bf-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-x8z9m\" (UID: \"6d4ee97d-ba1e-479e-a42c-eb682fc511bf\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x8z9m" May 26 19:28:43.486001 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.485958 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqxzc\" (UniqueName: \"kubernetes.io/projected/6d4ee97d-ba1e-479e-a42c-eb682fc511bf-kube-api-access-tqxzc\") pod \"openshift-state-metrics-9c959559f-x8z9m\" (UID: \"6d4ee97d-ba1e-479e-a42c-eb682fc511bf\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x8z9m" May 26 19:28:43.486001 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.485998 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d4ee97d-ba1e-479e-a42c-eb682fc511bf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-x8z9m\" (UID: \"6d4ee97d-ba1e-479e-a42c-eb682fc511bf\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x8z9m" May 26 19:28:43.586336 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.586278 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95db239a-8064-4562-bc79-24aceb39eabc-node-exporter-wtmp\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.586512 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.586345 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tqxzc\" (UniqueName: \"kubernetes.io/projected/6d4ee97d-ba1e-479e-a42c-eb682fc511bf-kube-api-access-tqxzc\") pod \"openshift-state-metrics-9c959559f-x8z9m\" (UID: \"6d4ee97d-ba1e-479e-a42c-eb682fc511bf\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x8z9m" May 26 19:28:43.586512 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.586378 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56b5862b-6b1c-4902-b40c-ef9022c5f5b5-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-rcpxj\" (UID: \"56b5862b-6b1c-4902-b40c-ef9022c5f5b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj" May 26 19:28:43.586512 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.586406 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/56b5862b-6b1c-4902-b40c-ef9022c5f5b5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-rcpxj\" (UID: \"56b5862b-6b1c-4902-b40c-ef9022c5f5b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj" May 26 19:28:43.586678 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.586504 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfdtm\" (UniqueName: \"kubernetes.io/projected/56b5862b-6b1c-4902-b40c-ef9022c5f5b5-kube-api-access-tfdtm\") pod \"kube-state-metrics-54fd6bc5c4-rcpxj\" (UID: \"56b5862b-6b1c-4902-b40c-ef9022c5f5b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj" May 26 19:28:43.586678 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.586546 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95db239a-8064-4562-bc79-24aceb39eabc-node-exporter-tls\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.586678 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.586613 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95db239a-8064-4562-bc79-24aceb39eabc-root\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.586678 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.586648 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95db239a-8064-4562-bc79-24aceb39eabc-node-exporter-accelerators-collector-config\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.586874 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.586688 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95db239a-8064-4562-bc79-24aceb39eabc-metrics-client-ca\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.586874 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.586731 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d4ee97d-ba1e-479e-a42c-eb682fc511bf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-x8z9m\" (UID: \"6d4ee97d-ba1e-479e-a42c-eb682fc511bf\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x8z9m" May 26 19:28:43.586874 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.586755 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95db239a-8064-4562-bc79-24aceb39eabc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.586874 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.586778 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d4ee97d-ba1e-479e-a42c-eb682fc511bf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-x8z9m\" (UID: \"6d4ee97d-ba1e-479e-a42c-eb682fc511bf\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x8z9m" May 26 19:28:43.586874 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.586797 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d4ee97d-ba1e-479e-a42c-eb682fc511bf-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-x8z9m\" (UID: \"6d4ee97d-ba1e-479e-a42c-eb682fc511bf\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x8z9m" May 26 19:28:43.586874 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.586823 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95db239a-8064-4562-bc79-24aceb39eabc-sys\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.586874 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:43.586830 2578 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 26 19:28:43.586874 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.586849 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56b5862b-6b1c-4902-b40c-ef9022c5f5b5-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-rcpxj\" (UID: \"56b5862b-6b1c-4902-b40c-ef9022c5f5b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj" May 26 19:28:43.587265 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:43.586905 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4ee97d-ba1e-479e-a42c-eb682fc511bf-openshift-state-metrics-tls podName:6d4ee97d-ba1e-479e-a42c-eb682fc511bf nodeName:}" failed. No retries permitted until 2026-05-26 19:28:44.086875171 +0000 UTC m=+188.620847932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6d4ee97d-ba1e-479e-a42c-eb682fc511bf-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-x8z9m" (UID: "6d4ee97d-ba1e-479e-a42c-eb682fc511bf") : secret "openshift-state-metrics-tls" not found May 26 19:28:43.587265 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.586931 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tddnc\" (UniqueName: \"kubernetes.io/projected/95db239a-8064-4562-bc79-24aceb39eabc-kube-api-access-tddnc\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.587265 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.586954 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95db239a-8064-4562-bc79-24aceb39eabc-node-exporter-textfile\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.587265 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.586992 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56b5862b-6b1c-4902-b40c-ef9022c5f5b5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-rcpxj\" (UID: \"56b5862b-6b1c-4902-b40c-ef9022c5f5b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj" May 26 19:28:43.587265 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.587033 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/56b5862b-6b1c-4902-b40c-ef9022c5f5b5-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-rcpxj\" (UID: \"56b5862b-6b1c-4902-b40c-ef9022c5f5b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj" May 26 19:28:43.588037 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.588016 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d4ee97d-ba1e-479e-a42c-eb682fc511bf-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-x8z9m\" (UID: \"6d4ee97d-ba1e-479e-a42c-eb682fc511bf\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x8z9m" May 26 19:28:43.589722 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.589698 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d4ee97d-ba1e-479e-a42c-eb682fc511bf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-x8z9m\" (UID: \"6d4ee97d-ba1e-479e-a42c-eb682fc511bf\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x8z9m" May 26 19:28:43.594904 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.594871 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqxzc\" (UniqueName: \"kubernetes.io/projected/6d4ee97d-ba1e-479e-a42c-eb682fc511bf-kube-api-access-tqxzc\") pod \"openshift-state-metrics-9c959559f-x8z9m\" (UID: \"6d4ee97d-ba1e-479e-a42c-eb682fc511bf\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x8z9m" May 26 19:28:43.687790 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.687708 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56b5862b-6b1c-4902-b40c-ef9022c5f5b5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-rcpxj\" (UID: \"56b5862b-6b1c-4902-b40c-ef9022c5f5b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj" May 26 19:28:43.687790 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.687759 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/56b5862b-6b1c-4902-b40c-ef9022c5f5b5-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-rcpxj\" (UID: \"56b5862b-6b1c-4902-b40c-ef9022c5f5b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj" May 26 19:28:43.687990 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.687929 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95db239a-8064-4562-bc79-24aceb39eabc-node-exporter-wtmp\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.687990 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.687968 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56b5862b-6b1c-4902-b40c-ef9022c5f5b5-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-rcpxj\" (UID: \"56b5862b-6b1c-4902-b40c-ef9022c5f5b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj" May 26 19:28:43.688101 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.687996 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/56b5862b-6b1c-4902-b40c-ef9022c5f5b5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-rcpxj\" (UID: \"56b5862b-6b1c-4902-b40c-ef9022c5f5b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj" May 26 19:28:43.688101 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.688033 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tfdtm\" (UniqueName: \"kubernetes.io/projected/56b5862b-6b1c-4902-b40c-ef9022c5f5b5-kube-api-access-tfdtm\") pod \"kube-state-metrics-54fd6bc5c4-rcpxj\" (UID: \"56b5862b-6b1c-4902-b40c-ef9022c5f5b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj" May 26 19:28:43.688101 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.688061 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95db239a-8064-4562-bc79-24aceb39eabc-node-exporter-tls\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.688247 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.688102 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95db239a-8064-4562-bc79-24aceb39eabc-root\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.688247 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.688116 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95db239a-8064-4562-bc79-24aceb39eabc-node-exporter-wtmp\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.688247 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.688138 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95db239a-8064-4562-bc79-24aceb39eabc-node-exporter-accelerators-collector-config\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.688247 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.688154 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/56b5862b-6b1c-4902-b40c-ef9022c5f5b5-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-rcpxj\" (UID: \"56b5862b-6b1c-4902-b40c-ef9022c5f5b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj" May 26 19:28:43.688247 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.688183 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95db239a-8064-4562-bc79-24aceb39eabc-metrics-client-ca\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.688587 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.688261 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95db239a-8064-4562-bc79-24aceb39eabc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.688587 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:43.688286 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 26 19:28:43.688587 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.688297 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95db239a-8064-4562-bc79-24aceb39eabc-sys\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.688587 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.688342 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56b5862b-6b1c-4902-b40c-ef9022c5f5b5-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-rcpxj\" (UID: \"56b5862b-6b1c-4902-b40c-ef9022c5f5b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj" May 26 19:28:43.688587 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:43.688380 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95db239a-8064-4562-bc79-24aceb39eabc-node-exporter-tls podName:95db239a-8064-4562-bc79-24aceb39eabc nodeName:}" failed. No retries permitted until 2026-05-26 19:28:44.1883589 +0000 UTC m=+188.722331681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/95db239a-8064-4562-bc79-24aceb39eabc-node-exporter-tls") pod "node-exporter-f47x8" (UID: "95db239a-8064-4562-bc79-24aceb39eabc") : secret "node-exporter-tls" not found May 26 19:28:43.688587 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.688414 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tddnc\" (UniqueName: \"kubernetes.io/projected/95db239a-8064-4562-bc79-24aceb39eabc-kube-api-access-tddnc\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.688587 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.688447 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95db239a-8064-4562-bc79-24aceb39eabc-node-exporter-textfile\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.688989 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.688693 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95db239a-8064-4562-bc79-24aceb39eabc-root\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.688989 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.688724 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95db239a-8064-4562-bc79-24aceb39eabc-node-exporter-textfile\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.688989 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.688729 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95db239a-8064-4562-bc79-24aceb39eabc-node-exporter-accelerators-collector-config\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.688989 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.688802 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95db239a-8064-4562-bc79-24aceb39eabc-sys\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.688989 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.688802 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/56b5862b-6b1c-4902-b40c-ef9022c5f5b5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-rcpxj\" (UID: \"56b5862b-6b1c-4902-b40c-ef9022c5f5b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj" May 26 19:28:43.688989 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.688935 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56b5862b-6b1c-4902-b40c-ef9022c5f5b5-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-rcpxj\" (UID: \"56b5862b-6b1c-4902-b40c-ef9022c5f5b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj" May 26 19:28:43.689353 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.689275 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95db239a-8064-4562-bc79-24aceb39eabc-metrics-client-ca\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.690873 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.690849 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56b5862b-6b1c-4902-b40c-ef9022c5f5b5-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-rcpxj\" (UID: \"56b5862b-6b1c-4902-b40c-ef9022c5f5b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj" May 26 19:28:43.690991 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.690948 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56b5862b-6b1c-4902-b40c-ef9022c5f5b5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-rcpxj\" (UID: \"56b5862b-6b1c-4902-b40c-ef9022c5f5b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj" May 26 19:28:43.691165 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.691142 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95db239a-8064-4562-bc79-24aceb39eabc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.696896 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.696874 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfdtm\" (UniqueName: \"kubernetes.io/projected/56b5862b-6b1c-4902-b40c-ef9022c5f5b5-kube-api-access-tfdtm\") pod \"kube-state-metrics-54fd6bc5c4-rcpxj\" (UID: \"56b5862b-6b1c-4902-b40c-ef9022c5f5b5\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj" May 26 19:28:43.697004 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.696930 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tddnc\" (UniqueName: \"kubernetes.io/projected/95db239a-8064-4562-bc79-24aceb39eabc-kube-api-access-tddnc\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:43.731217 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.731185 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj" May 26 19:28:43.876953 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:43.876843 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj"] May 26 19:28:43.879582 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:28:43.879549 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56b5862b_6b1c_4902_b40c_ef9022c5f5b5.slice/crio-8f335dbc6de4089cdcdf2333d67759c72ef7e1a9348fafb8989e769bdda7d2d0 WatchSource:0}: Error finding container 8f335dbc6de4089cdcdf2333d67759c72ef7e1a9348fafb8989e769bdda7d2d0: Status 404 returned error can't find the container with id 8f335dbc6de4089cdcdf2333d67759c72ef7e1a9348fafb8989e769bdda7d2d0 May 26 19:28:44.092573 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.092499 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d4ee97d-ba1e-479e-a42c-eb682fc511bf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-x8z9m\" (UID: \"6d4ee97d-ba1e-479e-a42c-eb682fc511bf\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x8z9m" May 26 19:28:44.094772 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.094754 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d4ee97d-ba1e-479e-a42c-eb682fc511bf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-x8z9m\" (UID: \"6d4ee97d-ba1e-479e-a42c-eb682fc511bf\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x8z9m" May 26 19:28:44.193782 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.193749 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95db239a-8064-4562-bc79-24aceb39eabc-node-exporter-tls\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:44.196005 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.195981 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95db239a-8064-4562-bc79-24aceb39eabc-node-exporter-tls\") pod \"node-exporter-f47x8\" (UID: \"95db239a-8064-4562-bc79-24aceb39eabc\") " pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:44.311339 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.311298 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-x8z9m" May 26 19:28:44.359753 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.359721 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f47x8" May 26 19:28:44.372842 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:28:44.372793 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95db239a_8064_4562_bc79_24aceb39eabc.slice/crio-fc1ef2133f010a7a4de9def92877ae5ab39df8c0e679f84d049112bbea998da3 WatchSource:0}: Error finding container fc1ef2133f010a7a4de9def92877ae5ab39df8c0e679f84d049112bbea998da3: Status 404 returned error can't find the container with id fc1ef2133f010a7a4de9def92877ae5ab39df8c0e679f84d049112bbea998da3 May 26 19:28:44.446549 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.446512 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-x8z9m"] May 26 19:28:44.451708 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:28:44.451676 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d4ee97d_ba1e_479e_a42c_eb682fc511bf.slice/crio-737d01ee3401f0d83b571e9b48aa11498e6149db671af45586a0cbf831e1dbe4 WatchSource:0}: Error finding container 737d01ee3401f0d83b571e9b48aa11498e6149db671af45586a0cbf831e1dbe4: Status 404 returned error can't find the container with id 737d01ee3401f0d83b571e9b48aa11498e6149db671af45586a0cbf831e1dbe4 May 26 19:28:44.478306 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.478264 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 19:28:44.506525 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.506497 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 19:28:44.506709 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.506691 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.509350 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.509290 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 26 19:28:44.509936 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.509660 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 26 19:28:44.509936 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.509699 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 26 19:28:44.509936 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.509732 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 26 19:28:44.509936 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.509908 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 26 19:28:44.510191 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.509979 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dx87d\"" May 26 19:28:44.510191 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.510091 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 26 19:28:44.510191 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.510170 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 26 19:28:44.510886 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.510865 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 26 19:28:44.510986 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.510871 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 26 19:28:44.598764 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.598734 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-config-out\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.598894 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.598816 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.598894 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.598866 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.599013 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.598896 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-web-config\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.599013 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.598933 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.599013 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.598950 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-config-volume\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.599013 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.598967 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.599013 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.598983 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.599013 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.599000 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.599334 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.599018 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.599334 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.599033 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs47q\" (UniqueName: \"kubernetes.io/projected/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-kube-api-access-xs47q\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.599334 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.599069 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.599334 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.599095 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.654232 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.654197 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f47x8" event={"ID":"95db239a-8064-4562-bc79-24aceb39eabc","Type":"ContainerStarted","Data":"fc1ef2133f010a7a4de9def92877ae5ab39df8c0e679f84d049112bbea998da3"} May 26 19:28:44.656711 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.656630 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-x8z9m" event={"ID":"6d4ee97d-ba1e-479e-a42c-eb682fc511bf","Type":"ContainerStarted","Data":"4bdc661b4be57dee829988022069d051a550e81dd2622e81027badb1a190cddd"} May 26 19:28:44.656711 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.656662 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-x8z9m" event={"ID":"6d4ee97d-ba1e-479e-a42c-eb682fc511bf","Type":"ContainerStarted","Data":"293736dbf425002c47d303d70aa1dcbf86c257f478327cefab77219b26334cc1"} May 26 19:28:44.656711 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.656676 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-x8z9m" event={"ID":"6d4ee97d-ba1e-479e-a42c-eb682fc511bf","Type":"ContainerStarted","Data":"737d01ee3401f0d83b571e9b48aa11498e6149db671af45586a0cbf831e1dbe4"} May 26 19:28:44.657893 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.657860 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj" event={"ID":"56b5862b-6b1c-4902-b40c-ef9022c5f5b5","Type":"ContainerStarted","Data":"8f335dbc6de4089cdcdf2333d67759c72ef7e1a9348fafb8989e769bdda7d2d0"} May 26 19:28:44.700188 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.700151 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.700366 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.700209 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-config-out\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.700366 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.700266 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.700366 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.700310 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.700366 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.700359 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-web-config\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.700583 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.700388 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.700583 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.700414 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-config-volume\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.700583 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.700440 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.700583 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.700466 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.700583 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.700497 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.700894 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:44.700603 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-alertmanager-trusted-ca-bundle podName:fb4ea5e7-8ba5-4e11-9b69-934af418e93c nodeName:}" failed. No retries permitted until 2026-05-26 19:28:45.200579346 +0000 UTC m=+189.734552129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "fb4ea5e7-8ba5-4e11-9b69-934af418e93c") : configmap references non-existent config key: ca-bundle.crt May 26 19:28:44.701293 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.701215 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.701926 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.701901 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.702177 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.702155 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.702267 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.702198 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xs47q\" (UniqueName: \"kubernetes.io/projected/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-kube-api-access-xs47q\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.702267 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.702260 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.704069 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.704018 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-web-config\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.704906 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.704861 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.705282 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.705220 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.706876 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.705846 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-config-volume\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.706876 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.705946 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.706876 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.706452 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-config-out\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.706876 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.706459 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.706876 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.706566 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.710751 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.710680 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.712613 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.712592 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs47q\" (UniqueName: \"kubernetes.io/projected/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-kube-api-access-xs47q\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:44.985485 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.985439 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-567b7686fc-fjlq2"] May 26 19:28:44.987786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.987757 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567b7686fc-fjlq2" May 26 19:28:44.990572 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.990538 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 26 19:28:44.990948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.990927 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 26 19:28:44.991106 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.991083 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qg2z5\"" May 26 19:28:44.991198 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.991130 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 26 19:28:44.991400 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.991383 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 26 19:28:44.992947 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.992786 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 26 19:28:44.999627 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:44.999585 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-567b7686fc-fjlq2"] May 26 19:28:45.105822 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.105763 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4vks\" (UniqueName: \"kubernetes.io/projected/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-kube-api-access-w4vks\") pod \"console-567b7686fc-fjlq2\" (UID: \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\") " pod="openshift-console/console-567b7686fc-fjlq2" May 26 19:28:45.106023 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.105898 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-console-oauth-config\") pod \"console-567b7686fc-fjlq2\" (UID: \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\") " pod="openshift-console/console-567b7686fc-fjlq2" May 26 19:28:45.106122 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.106047 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-oauth-serving-cert\") pod \"console-567b7686fc-fjlq2\" (UID: \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\") " pod="openshift-console/console-567b7686fc-fjlq2" May 26 19:28:45.106197 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.106170 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-console-config\") pod \"console-567b7686fc-fjlq2\" (UID: \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\") " pod="openshift-console/console-567b7686fc-fjlq2" May 26 19:28:45.106258 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.106202 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-service-ca\") pod \"console-567b7686fc-fjlq2\" (UID: \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\") " pod="openshift-console/console-567b7686fc-fjlq2" May 26 19:28:45.106258 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.106228 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-console-serving-cert\") pod \"console-567b7686fc-fjlq2\" (UID: \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\") " pod="openshift-console/console-567b7686fc-fjlq2" May 26 19:28:45.206949 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.206909 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:45.207121 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.206968 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-oauth-serving-cert\") pod \"console-567b7686fc-fjlq2\" (UID: \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\") " pod="openshift-console/console-567b7686fc-fjlq2" May 26 19:28:45.207200 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.207165 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-console-config\") pod \"console-567b7686fc-fjlq2\" (UID: \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\") " pod="openshift-console/console-567b7686fc-fjlq2" May 26 19:28:45.207255 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.207215 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-service-ca\") pod \"console-567b7686fc-fjlq2\" (UID: \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\") " pod="openshift-console/console-567b7686fc-fjlq2" May 26 19:28:45.207308 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.207264 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-console-serving-cert\") pod \"console-567b7686fc-fjlq2\" (UID: \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\") " pod="openshift-console/console-567b7686fc-fjlq2" May 26 19:28:45.207389 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.207345 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w4vks\" (UniqueName: \"kubernetes.io/projected/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-kube-api-access-w4vks\") pod \"console-567b7686fc-fjlq2\" (UID: \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\") " pod="openshift-console/console-567b7686fc-fjlq2" May 26 19:28:45.207389 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.207378 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-console-oauth-config\") pod \"console-567b7686fc-fjlq2\" (UID: \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\") " pod="openshift-console/console-567b7686fc-fjlq2" May 26 19:28:45.207809 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.207758 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-oauth-serving-cert\") pod \"console-567b7686fc-fjlq2\" (UID: \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\") " pod="openshift-console/console-567b7686fc-fjlq2" May 26 19:28:45.207980 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.207954 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:45.208196 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.208145 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-service-ca\") pod \"console-567b7686fc-fjlq2\" (UID: \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\") " pod="openshift-console/console-567b7686fc-fjlq2" May 26 19:28:45.208196 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.208162 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-console-config\") pod \"console-567b7686fc-fjlq2\" (UID: \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\") " pod="openshift-console/console-567b7686fc-fjlq2" May 26 19:28:45.213865 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.213662 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-console-oauth-config\") pod \"console-567b7686fc-fjlq2\" (UID: \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\") " pod="openshift-console/console-567b7686fc-fjlq2" May 26 19:28:45.214470 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.214448 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-console-serving-cert\") pod \"console-567b7686fc-fjlq2\" (UID: \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\") " pod="openshift-console/console-567b7686fc-fjlq2" May 26 19:28:45.221063 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.221021 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4vks\" (UniqueName: \"kubernetes.io/projected/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-kube-api-access-w4vks\") pod \"console-567b7686fc-fjlq2\" (UID: \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\") " pod="openshift-console/console-567b7686fc-fjlq2" May 26 19:28:45.303505 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.303416 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567b7686fc-fjlq2" May 26 19:28:45.429685 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.429400 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 26 19:28:45.487459 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.487133 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4"] May 26 19:28:45.495745 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.495716 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:45.499043 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.498723 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 26 19:28:45.499043 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.498871 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 26 19:28:45.499043 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.498944 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 26 19:28:45.500726 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.499449 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 26 19:28:45.500726 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.499694 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-c9ktl\"" May 26 19:28:45.500726 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.500197 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7jfe99lgtps2n\"" May 26 19:28:45.500726 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.500406 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 26 19:28:45.501373 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.501312 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4"] May 26 19:28:45.610972 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.610752 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/aa143360-9d1f-4c98-b904-3625128bb74f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7cdf89bb4f-28xz4\" (UID: \"aa143360-9d1f-4c98-b904-3625128bb74f\") " pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:45.610972 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.610795 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/aa143360-9d1f-4c98-b904-3625128bb74f-secret-grpc-tls\") pod \"thanos-querier-7cdf89bb4f-28xz4\" (UID: \"aa143360-9d1f-4c98-b904-3625128bb74f\") " pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:45.610972 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.610821 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/aa143360-9d1f-4c98-b904-3625128bb74f-secret-thanos-querier-tls\") pod \"thanos-querier-7cdf89bb4f-28xz4\" (UID: \"aa143360-9d1f-4c98-b904-3625128bb74f\") " pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:45.610972 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.610934 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aa143360-9d1f-4c98-b904-3625128bb74f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7cdf89bb4f-28xz4\" (UID: \"aa143360-9d1f-4c98-b904-3625128bb74f\") " pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:45.611289 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.610980 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnf8q\" (UniqueName: \"kubernetes.io/projected/aa143360-9d1f-4c98-b904-3625128bb74f-kube-api-access-dnf8q\") pod \"thanos-querier-7cdf89bb4f-28xz4\" (UID: \"aa143360-9d1f-4c98-b904-3625128bb74f\") " pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:45.611289 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.611053 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/aa143360-9d1f-4c98-b904-3625128bb74f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7cdf89bb4f-28xz4\" (UID: \"aa143360-9d1f-4c98-b904-3625128bb74f\") " pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:45.611289 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.611096 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa143360-9d1f-4c98-b904-3625128bb74f-metrics-client-ca\") pod \"thanos-querier-7cdf89bb4f-28xz4\" (UID: \"aa143360-9d1f-4c98-b904-3625128bb74f\") " pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:45.611289 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.611144 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aa143360-9d1f-4c98-b904-3625128bb74f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7cdf89bb4f-28xz4\" (UID: \"aa143360-9d1f-4c98-b904-3625128bb74f\") " pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:45.711749 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.711715 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/aa143360-9d1f-4c98-b904-3625128bb74f-secret-thanos-querier-tls\") pod \"thanos-querier-7cdf89bb4f-28xz4\" (UID: \"aa143360-9d1f-4c98-b904-3625128bb74f\") " pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:45.711908 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.711772 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aa143360-9d1f-4c98-b904-3625128bb74f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7cdf89bb4f-28xz4\" (UID: \"aa143360-9d1f-4c98-b904-3625128bb74f\") " pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:45.711908 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.711818 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dnf8q\" (UniqueName: \"kubernetes.io/projected/aa143360-9d1f-4c98-b904-3625128bb74f-kube-api-access-dnf8q\") pod \"thanos-querier-7cdf89bb4f-28xz4\" (UID: \"aa143360-9d1f-4c98-b904-3625128bb74f\") " pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:45.711908 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.711887 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/aa143360-9d1f-4c98-b904-3625128bb74f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7cdf89bb4f-28xz4\" (UID: \"aa143360-9d1f-4c98-b904-3625128bb74f\") " pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:45.712062 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.711932 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa143360-9d1f-4c98-b904-3625128bb74f-metrics-client-ca\") pod \"thanos-querier-7cdf89bb4f-28xz4\" (UID: \"aa143360-9d1f-4c98-b904-3625128bb74f\") " pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:45.712191 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.712151 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aa143360-9d1f-4c98-b904-3625128bb74f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7cdf89bb4f-28xz4\" (UID: \"aa143360-9d1f-4c98-b904-3625128bb74f\") " pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:45.712342 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.712234 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/aa143360-9d1f-4c98-b904-3625128bb74f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7cdf89bb4f-28xz4\" (UID: \"aa143360-9d1f-4c98-b904-3625128bb74f\") " pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:45.712342 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.712267 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/aa143360-9d1f-4c98-b904-3625128bb74f-secret-grpc-tls\") pod \"thanos-querier-7cdf89bb4f-28xz4\" (UID: \"aa143360-9d1f-4c98-b904-3625128bb74f\") " pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:45.712735 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.712673 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa143360-9d1f-4c98-b904-3625128bb74f-metrics-client-ca\") pod \"thanos-querier-7cdf89bb4f-28xz4\" (UID: \"aa143360-9d1f-4c98-b904-3625128bb74f\") " pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:45.714719 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.714697 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/aa143360-9d1f-4c98-b904-3625128bb74f-secret-thanos-querier-tls\") pod \"thanos-querier-7cdf89bb4f-28xz4\" (UID: \"aa143360-9d1f-4c98-b904-3625128bb74f\") " pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:45.714950 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.714930 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aa143360-9d1f-4c98-b904-3625128bb74f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7cdf89bb4f-28xz4\" (UID: \"aa143360-9d1f-4c98-b904-3625128bb74f\") " pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:45.715154 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.715123 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/aa143360-9d1f-4c98-b904-3625128bb74f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7cdf89bb4f-28xz4\" (UID: \"aa143360-9d1f-4c98-b904-3625128bb74f\") " pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:45.715703 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.715654 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/aa143360-9d1f-4c98-b904-3625128bb74f-secret-grpc-tls\") pod \"thanos-querier-7cdf89bb4f-28xz4\" (UID: \"aa143360-9d1f-4c98-b904-3625128bb74f\") " pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:45.715929 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.715908 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/aa143360-9d1f-4c98-b904-3625128bb74f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7cdf89bb4f-28xz4\" (UID: \"aa143360-9d1f-4c98-b904-3625128bb74f\") " pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:45.715993 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.715957 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aa143360-9d1f-4c98-b904-3625128bb74f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7cdf89bb4f-28xz4\" (UID: \"aa143360-9d1f-4c98-b904-3625128bb74f\") " pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:45.722172 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.722150 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnf8q\" (UniqueName: \"kubernetes.io/projected/aa143360-9d1f-4c98-b904-3625128bb74f-kube-api-access-dnf8q\") pod \"thanos-querier-7cdf89bb4f-28xz4\" (UID: \"aa143360-9d1f-4c98-b904-3625128bb74f\") " pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:45.810184 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:45.810145 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:28:47.808265 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.808228 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-9f456bbb-626mn"] May 26 19:28:47.811125 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.811099 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:28:47.814778 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.814586 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 26 19:28:47.814778 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.814604 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 26 19:28:47.814778 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.814629 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-jivm6oti33v9\"" May 26 19:28:47.814778 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.814680 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 26 19:28:47.814778 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.814732 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 26 19:28:47.814778 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.814585 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-q479n\"" May 26 19:28:47.821021 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.820998 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-9f456bbb-626mn"] May 26 19:28:47.832482 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.832457 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3dca64ef-e955-4cef-a8d4-193fe2378c11-secret-metrics-server-client-certs\") pod \"metrics-server-9f456bbb-626mn\" (UID: \"3dca64ef-e955-4cef-a8d4-193fe2378c11\") " pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:28:47.832593 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.832511 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3dca64ef-e955-4cef-a8d4-193fe2378c11-audit-log\") pod \"metrics-server-9f456bbb-626mn\" (UID: \"3dca64ef-e955-4cef-a8d4-193fe2378c11\") " pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:28:47.832593 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.832529 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn5ln\" (UniqueName: \"kubernetes.io/projected/3dca64ef-e955-4cef-a8d4-193fe2378c11-kube-api-access-wn5ln\") pod \"metrics-server-9f456bbb-626mn\" (UID: \"3dca64ef-e955-4cef-a8d4-193fe2378c11\") " pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:28:47.832593 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.832585 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3dca64ef-e955-4cef-a8d4-193fe2378c11-client-ca-bundle\") pod \"metrics-server-9f456bbb-626mn\" (UID: \"3dca64ef-e955-4cef-a8d4-193fe2378c11\") " pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:28:47.832772 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.832615 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3dca64ef-e955-4cef-a8d4-193fe2378c11-secret-metrics-server-tls\") pod \"metrics-server-9f456bbb-626mn\" (UID: \"3dca64ef-e955-4cef-a8d4-193fe2378c11\") " pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:28:47.832772 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.832651 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3dca64ef-e955-4cef-a8d4-193fe2378c11-metrics-server-audit-profiles\") pod \"metrics-server-9f456bbb-626mn\" (UID: \"3dca64ef-e955-4cef-a8d4-193fe2378c11\") " pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:28:47.832772 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.832689 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dca64ef-e955-4cef-a8d4-193fe2378c11-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9f456bbb-626mn\" (UID: \"3dca64ef-e955-4cef-a8d4-193fe2378c11\") " pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:28:47.933505 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.933475 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3dca64ef-e955-4cef-a8d4-193fe2378c11-client-ca-bundle\") pod \"metrics-server-9f456bbb-626mn\" (UID: \"3dca64ef-e955-4cef-a8d4-193fe2378c11\") " pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:28:47.933505 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.933511 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3dca64ef-e955-4cef-a8d4-193fe2378c11-secret-metrics-server-tls\") pod \"metrics-server-9f456bbb-626mn\" (UID: \"3dca64ef-e955-4cef-a8d4-193fe2378c11\") " pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:28:47.933741 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.933539 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3dca64ef-e955-4cef-a8d4-193fe2378c11-metrics-server-audit-profiles\") pod \"metrics-server-9f456bbb-626mn\" (UID: \"3dca64ef-e955-4cef-a8d4-193fe2378c11\") " pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:28:47.933741 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.933569 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dca64ef-e955-4cef-a8d4-193fe2378c11-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9f456bbb-626mn\" (UID: \"3dca64ef-e955-4cef-a8d4-193fe2378c11\") " pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:28:47.933741 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.933613 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3dca64ef-e955-4cef-a8d4-193fe2378c11-secret-metrics-server-client-certs\") pod \"metrics-server-9f456bbb-626mn\" (UID: \"3dca64ef-e955-4cef-a8d4-193fe2378c11\") " pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:28:47.933741 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.933649 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3dca64ef-e955-4cef-a8d4-193fe2378c11-audit-log\") pod \"metrics-server-9f456bbb-626mn\" (UID: \"3dca64ef-e955-4cef-a8d4-193fe2378c11\") " pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:28:47.933741 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.933674 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wn5ln\" (UniqueName: \"kubernetes.io/projected/3dca64ef-e955-4cef-a8d4-193fe2378c11-kube-api-access-wn5ln\") pod \"metrics-server-9f456bbb-626mn\" (UID: \"3dca64ef-e955-4cef-a8d4-193fe2378c11\") " pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:28:47.934113 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.934084 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3dca64ef-e955-4cef-a8d4-193fe2378c11-audit-log\") pod \"metrics-server-9f456bbb-626mn\" (UID: \"3dca64ef-e955-4cef-a8d4-193fe2378c11\") " pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:28:47.934679 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.934621 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dca64ef-e955-4cef-a8d4-193fe2378c11-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9f456bbb-626mn\" (UID: \"3dca64ef-e955-4cef-a8d4-193fe2378c11\") " pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:28:47.934780 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.934759 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3dca64ef-e955-4cef-a8d4-193fe2378c11-metrics-server-audit-profiles\") pod \"metrics-server-9f456bbb-626mn\" (UID: \"3dca64ef-e955-4cef-a8d4-193fe2378c11\") " pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:28:47.936577 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.936553 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3dca64ef-e955-4cef-a8d4-193fe2378c11-secret-metrics-server-tls\") pod \"metrics-server-9f456bbb-626mn\" (UID: \"3dca64ef-e955-4cef-a8d4-193fe2378c11\") " pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:28:47.936672 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.936601 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3dca64ef-e955-4cef-a8d4-193fe2378c11-client-ca-bundle\") pod \"metrics-server-9f456bbb-626mn\" (UID: \"3dca64ef-e955-4cef-a8d4-193fe2378c11\") " pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:28:47.936820 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.936793 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3dca64ef-e955-4cef-a8d4-193fe2378c11-secret-metrics-server-client-certs\") pod \"metrics-server-9f456bbb-626mn\" (UID: \"3dca64ef-e955-4cef-a8d4-193fe2378c11\") " pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:28:47.941100 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:47.941076 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn5ln\" (UniqueName: \"kubernetes.io/projected/3dca64ef-e955-4cef-a8d4-193fe2378c11-kube-api-access-wn5ln\") pod \"metrics-server-9f456bbb-626mn\" (UID: \"3dca64ef-e955-4cef-a8d4-193fe2378c11\") " pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:28:48.123519 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:48.123434 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:28:48.183975 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:48.183942 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-qkbhh"] May 26 19:28:48.187028 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:48.186997 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-qkbhh" May 26 19:28:48.189752 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:48.189723 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 26 19:28:48.189971 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:48.189950 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-v5z9g\"" May 26 19:28:48.194837 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:48.194815 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-qkbhh"] May 26 19:28:48.236107 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:48.236072 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff768363-8e4e-44c8-8b36-7077f16b5128-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-qkbhh\" (UID: \"ff768363-8e4e-44c8-8b36-7077f16b5128\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-qkbhh" May 26 19:28:48.337167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:48.337135 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff768363-8e4e-44c8-8b36-7077f16b5128-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-qkbhh\" (UID: \"ff768363-8e4e-44c8-8b36-7077f16b5128\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-qkbhh" May 26 19:28:48.337359 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:48.337278 2578 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 26 19:28:48.337418 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:48.337367 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff768363-8e4e-44c8-8b36-7077f16b5128-monitoring-plugin-cert podName:ff768363-8e4e-44c8-8b36-7077f16b5128 nodeName:}" failed. No retries permitted until 2026-05-26 19:28:48.837346323 +0000 UTC m=+193.371319087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/ff768363-8e4e-44c8-8b36-7077f16b5128-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-qkbhh" (UID: "ff768363-8e4e-44c8-8b36-7077f16b5128") : secret "monitoring-plugin-cert" not found May 26 19:28:48.843598 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:48.843551 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff768363-8e4e-44c8-8b36-7077f16b5128-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-qkbhh\" (UID: \"ff768363-8e4e-44c8-8b36-7077f16b5128\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-qkbhh" May 26 19:28:48.844002 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:48.843703 2578 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 26 19:28:48.844002 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:28:48.843788 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff768363-8e4e-44c8-8b36-7077f16b5128-monitoring-plugin-cert podName:ff768363-8e4e-44c8-8b36-7077f16b5128 nodeName:}" failed. No retries permitted until 2026-05-26 19:28:49.84376989 +0000 UTC m=+194.377742653 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/ff768363-8e4e-44c8-8b36-7077f16b5128-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-qkbhh" (UID: "ff768363-8e4e-44c8-8b36-7077f16b5128") : secret "monitoring-plugin-cert" not found May 26 19:28:49.852970 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:49.852928 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff768363-8e4e-44c8-8b36-7077f16b5128-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-qkbhh\" (UID: \"ff768363-8e4e-44c8-8b36-7077f16b5128\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-qkbhh" May 26 19:28:49.855789 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:49.855762 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff768363-8e4e-44c8-8b36-7077f16b5128-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-qkbhh\" (UID: \"ff768363-8e4e-44c8-8b36-7077f16b5128\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-qkbhh" May 26 19:28:50.001040 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:50.000524 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-qkbhh" May 26 19:28:53.031811 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:53.029026 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-567b7686fc-fjlq2"] May 26 19:28:53.052197 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:28:53.052168 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod643a91e9_4863_45ee_bcdc_84a6d6f38fb5.slice/crio-7f16ce9ff46fa60953a90067baf02c5811f9a4a05ad8871dbcd2fbfc6ec40e4b WatchSource:0}: Error finding container 7f16ce9ff46fa60953a90067baf02c5811f9a4a05ad8871dbcd2fbfc6ec40e4b: Status 404 returned error can't find the container with id 7f16ce9ff46fa60953a90067baf02c5811f9a4a05ad8871dbcd2fbfc6ec40e4b May 26 19:28:53.112262 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:53.112151 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 19:28:53.119357 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:28:53.119241 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb4ea5e7_8ba5_4e11_9b69_934af418e93c.slice/crio-134398b56d860a887a294767bfaf2e404ea5971c69328d6460244eaf5c6d6c55 WatchSource:0}: Error finding container 134398b56d860a887a294767bfaf2e404ea5971c69328d6460244eaf5c6d6c55: Status 404 returned error can't find the container with id 134398b56d860a887a294767bfaf2e404ea5971c69328d6460244eaf5c6d6c55 May 26 19:28:53.171481 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:53.171440 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4"] May 26 19:28:53.179009 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:28:53.178954 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa143360_9d1f_4c98_b904_3625128bb74f.slice/crio-58f8b0fe50c95798381a04b88ba406c48c3987327016d0dd22860453f5147206 WatchSource:0}: Error finding container 58f8b0fe50c95798381a04b88ba406c48c3987327016d0dd22860453f5147206: Status 404 returned error can't find the container with id 58f8b0fe50c95798381a04b88ba406c48c3987327016d0dd22860453f5147206 May 26 19:28:53.340773 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:53.340718 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-qkbhh"] May 26 19:28:53.343860 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:28:53.343565 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff768363_8e4e_44c8_8b36_7077f16b5128.slice/crio-4eef7cd367976120fdb0a6d0f69f35f045e4f85cf88e9693e6e491b9fe3c2b92 WatchSource:0}: Error finding container 4eef7cd367976120fdb0a6d0f69f35f045e4f85cf88e9693e6e491b9fe3c2b92: Status 404 returned error can't find the container with id 4eef7cd367976120fdb0a6d0f69f35f045e4f85cf88e9693e6e491b9fe3c2b92 May 26 19:28:53.344411 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:53.344000 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-9f456bbb-626mn"] May 26 19:28:53.347893 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:28:53.347848 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dca64ef_e955_4cef_a8d4_193fe2378c11.slice/crio-53219be1aa01b7233afdb4bd1fa0c155ac0dad6b1b79392dabe9fbf11dfc0b51 WatchSource:0}: Error finding container 53219be1aa01b7233afdb4bd1fa0c155ac0dad6b1b79392dabe9fbf11dfc0b51: Status 404 returned error can't find the container with id 53219be1aa01b7233afdb4bd1fa0c155ac0dad6b1b79392dabe9fbf11dfc0b51 May 26 19:28:53.686924 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:53.686129 2578 generic.go:358] "Generic (PLEG): container finished" podID="95db239a-8064-4562-bc79-24aceb39eabc" containerID="0f4af501a15e55d3043361772d96a2c5dae2f832ea7a86d093e1be5f3af14a90" exitCode=0 May 26 19:28:53.686924 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:53.686338 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f47x8" event={"ID":"95db239a-8064-4562-bc79-24aceb39eabc","Type":"ContainerDied","Data":"0f4af501a15e55d3043361772d96a2c5dae2f832ea7a86d093e1be5f3af14a90"} May 26 19:28:53.691351 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:53.691233 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-x8z9m" event={"ID":"6d4ee97d-ba1e-479e-a42c-eb682fc511bf","Type":"ContainerStarted","Data":"8d8a6a86bdc2f078a8391ccfab2b12be16c0e79f0f9840be66f3b837758a291a"} May 26 19:28:53.695430 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:53.695313 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj" event={"ID":"56b5862b-6b1c-4902-b40c-ef9022c5f5b5","Type":"ContainerStarted","Data":"7483671ccf576c81b6b67ef9b9aae8eea6d131c3b3d759420657c8e8f7911148"} May 26 19:28:53.695430 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:53.695366 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj" event={"ID":"56b5862b-6b1c-4902-b40c-ef9022c5f5b5","Type":"ContainerStarted","Data":"5b0309a6fd95b7e8fa17ede293d50788d7bb5e5de30a42add5a6c2985ac79c66"} May 26 19:28:53.695430 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:53.695384 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj" event={"ID":"56b5862b-6b1c-4902-b40c-ef9022c5f5b5","Type":"ContainerStarted","Data":"472f39f89c472efac5a71d8f418ad90fc50461e6f3887665481873e2c8f507fd"} May 26 19:28:53.697664 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:53.697542 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-ff7jc" event={"ID":"4f8b8e1d-613a-42d9-be26-7d0e14b5dc41","Type":"ContainerStarted","Data":"cddd7284f78aeb0af9e4f734209bce9fb0d068b95420bf6fb367b62125eda65a"} May 26 19:28:53.697950 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:53.697919 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-ff7jc" May 26 19:28:53.699475 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:53.699450 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-qkbhh" event={"ID":"ff768363-8e4e-44c8-8b36-7077f16b5128","Type":"ContainerStarted","Data":"4eef7cd367976120fdb0a6d0f69f35f045e4f85cf88e9693e6e491b9fe3c2b92"} May 26 19:28:53.710337 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:53.710193 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-ff7jc" May 26 19:28:53.710987 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:53.710953 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" event={"ID":"aa143360-9d1f-4c98-b904-3625128bb74f","Type":"ContainerStarted","Data":"58f8b0fe50c95798381a04b88ba406c48c3987327016d0dd22860453f5147206"} May 26 19:28:53.713098 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:53.713002 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567b7686fc-fjlq2" event={"ID":"643a91e9-4863-45ee-bcdc-84a6d6f38fb5","Type":"ContainerStarted","Data":"7f16ce9ff46fa60953a90067baf02c5811f9a4a05ad8871dbcd2fbfc6ec40e4b"} May 26 19:28:53.715433 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:53.715382 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-9f456bbb-626mn" event={"ID":"3dca64ef-e955-4cef-a8d4-193fe2378c11","Type":"ContainerStarted","Data":"53219be1aa01b7233afdb4bd1fa0c155ac0dad6b1b79392dabe9fbf11dfc0b51"} May 26 19:28:53.718459 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:53.718420 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb4ea5e7-8ba5-4e11-9b69-934af418e93c","Type":"ContainerStarted","Data":"134398b56d860a887a294767bfaf2e404ea5971c69328d6460244eaf5c6d6c55"} May 26 19:28:53.723213 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:53.722288 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-ff7jc" podStartSLOduration=1.798770183 podStartE2EDuration="19.722272448s" podCreationTimestamp="2026-05-26 19:28:34 +0000 UTC" firstStartedPulling="2026-05-26 19:28:35.029531468 +0000 UTC m=+179.563504229" lastFinishedPulling="2026-05-26 19:28:52.953033717 +0000 UTC m=+197.487006494" observedRunningTime="2026-05-26 19:28:53.721000906 +0000 UTC m=+198.254973693" watchObservedRunningTime="2026-05-26 19:28:53.722272448 +0000 UTC m=+198.256245233" May 26 19:28:53.737940 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:53.737885 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rcpxj" podStartSLOduration=1.779377469 podStartE2EDuration="10.737865723s" podCreationTimestamp="2026-05-26 19:28:43 +0000 UTC" firstStartedPulling="2026-05-26 19:28:43.881591509 +0000 UTC m=+188.415564285" lastFinishedPulling="2026-05-26 19:28:52.840079775 +0000 UTC m=+197.374052539" observedRunningTime="2026-05-26 19:28:53.736369873 +0000 UTC m=+198.270342660" watchObservedRunningTime="2026-05-26 19:28:53.737865723 +0000 UTC m=+198.271838509" May 26 19:28:53.754332 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:53.754261 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-x8z9m" podStartSLOduration=2.528664359 podStartE2EDuration="10.754246034s" podCreationTimestamp="2026-05-26 19:28:43 +0000 UTC" firstStartedPulling="2026-05-26 19:28:44.647045165 +0000 UTC m=+189.181017929" lastFinishedPulling="2026-05-26 19:28:52.872626827 +0000 UTC m=+197.406599604" observedRunningTime="2026-05-26 19:28:53.752113408 +0000 UTC m=+198.286086205" watchObservedRunningTime="2026-05-26 19:28:53.754246034 +0000 UTC m=+198.288218817" May 26 19:28:54.580366 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.578918 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-968596b7b-5kd6n"] May 26 19:28:54.587067 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.587040 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-968596b7b-5kd6n" May 26 19:28:54.594771 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.594694 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-968596b7b-5kd6n"] May 26 19:28:54.605764 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.605495 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 26 19:28:54.705896 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.705843 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f1621de-0454-4795-aafc-c463c5aeaada-console-oauth-config\") pod \"console-968596b7b-5kd6n\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " pod="openshift-console/console-968596b7b-5kd6n" May 26 19:28:54.706087 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.705941 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f1621de-0454-4795-aafc-c463c5aeaada-console-serving-cert\") pod \"console-968596b7b-5kd6n\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " pod="openshift-console/console-968596b7b-5kd6n" May 26 19:28:54.706087 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.705977 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1621de-0454-4795-aafc-c463c5aeaada-service-ca\") pod \"console-968596b7b-5kd6n\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " pod="openshift-console/console-968596b7b-5kd6n" May 26 19:28:54.706087 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.706043 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f1621de-0454-4795-aafc-c463c5aeaada-console-config\") pod \"console-968596b7b-5kd6n\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " pod="openshift-console/console-968596b7b-5kd6n" May 26 19:28:54.706087 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.706068 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f1621de-0454-4795-aafc-c463c5aeaada-trusted-ca-bundle\") pod \"console-968596b7b-5kd6n\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " pod="openshift-console/console-968596b7b-5kd6n" May 26 19:28:54.706290 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.706130 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbbgb\" (UniqueName: \"kubernetes.io/projected/2f1621de-0454-4795-aafc-c463c5aeaada-kube-api-access-fbbgb\") pod \"console-968596b7b-5kd6n\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " pod="openshift-console/console-968596b7b-5kd6n" May 26 19:28:54.706290 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.706178 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f1621de-0454-4795-aafc-c463c5aeaada-oauth-serving-cert\") pod \"console-968596b7b-5kd6n\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " pod="openshift-console/console-968596b7b-5kd6n" May 26 19:28:54.732606 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.732167 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f47x8" event={"ID":"95db239a-8064-4562-bc79-24aceb39eabc","Type":"ContainerStarted","Data":"8abdbd0da4b0185fbce7806ce1376db140741264c18153f5f7f3d1d3c73a2fd7"} May 26 19:28:54.732606 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.732214 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f47x8" event={"ID":"95db239a-8064-4562-bc79-24aceb39eabc","Type":"ContainerStarted","Data":"3214d8b0327ec3cbbe58d39e9023e7bcfbfdd4582b07d095096aec3993cbe022"} May 26 19:28:54.753050 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.752200 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f47x8" podStartSLOduration=3.261071105 podStartE2EDuration="11.752179463s" podCreationTimestamp="2026-05-26 19:28:43 +0000 UTC" firstStartedPulling="2026-05-26 19:28:44.376119297 +0000 UTC m=+188.910092072" lastFinishedPulling="2026-05-26 19:28:52.867227654 +0000 UTC m=+197.401200430" observedRunningTime="2026-05-26 19:28:54.750766652 +0000 UTC m=+199.284739440" watchObservedRunningTime="2026-05-26 19:28:54.752179463 +0000 UTC m=+199.286152257" May 26 19:28:54.811428 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.807814 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f1621de-0454-4795-aafc-c463c5aeaada-console-config\") pod \"console-968596b7b-5kd6n\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " pod="openshift-console/console-968596b7b-5kd6n" May 26 19:28:54.811428 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.807859 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f1621de-0454-4795-aafc-c463c5aeaada-trusted-ca-bundle\") pod \"console-968596b7b-5kd6n\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " pod="openshift-console/console-968596b7b-5kd6n" May 26 19:28:54.811428 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.807988 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fbbgb\" (UniqueName: \"kubernetes.io/projected/2f1621de-0454-4795-aafc-c463c5aeaada-kube-api-access-fbbgb\") pod \"console-968596b7b-5kd6n\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " pod="openshift-console/console-968596b7b-5kd6n" May 26 19:28:54.811428 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.808645 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f1621de-0454-4795-aafc-c463c5aeaada-oauth-serving-cert\") pod \"console-968596b7b-5kd6n\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " pod="openshift-console/console-968596b7b-5kd6n" May 26 19:28:54.811428 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.808713 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f1621de-0454-4795-aafc-c463c5aeaada-console-oauth-config\") pod \"console-968596b7b-5kd6n\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " pod="openshift-console/console-968596b7b-5kd6n" May 26 19:28:54.811428 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.808862 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f1621de-0454-4795-aafc-c463c5aeaada-console-serving-cert\") pod \"console-968596b7b-5kd6n\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " pod="openshift-console/console-968596b7b-5kd6n" May 26 19:28:54.811428 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.808909 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1621de-0454-4795-aafc-c463c5aeaada-service-ca\") pod \"console-968596b7b-5kd6n\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " pod="openshift-console/console-968596b7b-5kd6n" May 26 19:28:54.811428 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.810191 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f1621de-0454-4795-aafc-c463c5aeaada-trusted-ca-bundle\") pod \"console-968596b7b-5kd6n\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " pod="openshift-console/console-968596b7b-5kd6n" May 26 19:28:54.811428 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.811121 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1621de-0454-4795-aafc-c463c5aeaada-service-ca\") pod \"console-968596b7b-5kd6n\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " pod="openshift-console/console-968596b7b-5kd6n" May 26 19:28:54.812750 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.811787 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f1621de-0454-4795-aafc-c463c5aeaada-console-config\") pod \"console-968596b7b-5kd6n\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " pod="openshift-console/console-968596b7b-5kd6n" May 26 19:28:54.812931 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.812913 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f1621de-0454-4795-aafc-c463c5aeaada-oauth-serving-cert\") pod \"console-968596b7b-5kd6n\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " pod="openshift-console/console-968596b7b-5kd6n" May 26 19:28:54.816110 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.815745 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f1621de-0454-4795-aafc-c463c5aeaada-console-oauth-config\") pod \"console-968596b7b-5kd6n\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " pod="openshift-console/console-968596b7b-5kd6n" May 26 19:28:54.816110 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.816068 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f1621de-0454-4795-aafc-c463c5aeaada-console-serving-cert\") pod \"console-968596b7b-5kd6n\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " pod="openshift-console/console-968596b7b-5kd6n" May 26 19:28:54.823555 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.822212 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbbgb\" (UniqueName: \"kubernetes.io/projected/2f1621de-0454-4795-aafc-c463c5aeaada-kube-api-access-fbbgb\") pod \"console-968596b7b-5kd6n\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " pod="openshift-console/console-968596b7b-5kd6n" May 26 19:28:54.915392 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:54.914938 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-968596b7b-5kd6n" May 26 19:28:59.642977 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:59.642947 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-968596b7b-5kd6n"] May 26 19:28:59.645472 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:28:59.645442 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f1621de_0454_4795_aafc_c463c5aeaada.slice/crio-922deababbe3e9a903e50966b16b696054f0f36cd82bd2f39d53c7d4b0253d94 WatchSource:0}: Error finding container 922deababbe3e9a903e50966b16b696054f0f36cd82bd2f39d53c7d4b0253d94: Status 404 returned error can't find the container with id 922deababbe3e9a903e50966b16b696054f0f36cd82bd2f39d53c7d4b0253d94 May 26 19:28:59.751963 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:59.751913 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-968596b7b-5kd6n" event={"ID":"2f1621de-0454-4795-aafc-c463c5aeaada","Type":"ContainerStarted","Data":"922deababbe3e9a903e50966b16b696054f0f36cd82bd2f39d53c7d4b0253d94"} May 26 19:28:59.753180 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:59.753106 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-qkbhh" event={"ID":"ff768363-8e4e-44c8-8b36-7077f16b5128","Type":"ContainerStarted","Data":"1a8fc39679cd9d1e88505e82092de8f67c1dbe83c59a902f61ae572f051548bd"} May 26 19:28:59.753578 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:59.753528 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-qkbhh" May 26 19:28:59.755166 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:59.755032 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-9f456bbb-626mn" event={"ID":"3dca64ef-e955-4cef-a8d4-193fe2378c11","Type":"ContainerStarted","Data":"d999cac87a668cb97a5b345ea23143a1f0d378f12d8a2f6821867de031b6c628"} May 26 19:28:59.756886 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:59.756863 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb4ea5e7-8ba5-4e11-9b69-934af418e93c","Type":"ContainerStarted","Data":"a76cf9fef1c8ec713137046b93d14e7db53f64f1de8a1808ee3ce60039ecc664"} May 26 19:28:59.758767 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:59.758712 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" event={"ID":"aa143360-9d1f-4c98-b904-3625128bb74f","Type":"ContainerStarted","Data":"01c65a886956da3379d4c0c94fbf1c89efa6f1e34d779f2ddee5f3fd70bc4d1c"} May 26 19:28:59.760103 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:59.760079 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-qkbhh" May 26 19:28:59.768145 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:59.768052 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-qkbhh" podStartSLOduration=5.628391713 podStartE2EDuration="11.768036746s" podCreationTimestamp="2026-05-26 19:28:48 +0000 UTC" firstStartedPulling="2026-05-26 19:28:53.345486917 +0000 UTC m=+197.879459685" lastFinishedPulling="2026-05-26 19:28:59.485131942 +0000 UTC m=+204.019104718" observedRunningTime="2026-05-26 19:28:59.76738602 +0000 UTC m=+204.301358807" watchObservedRunningTime="2026-05-26 19:28:59.768036746 +0000 UTC m=+204.302009532" May 26 19:28:59.806420 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:28:59.806367 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-9f456bbb-626mn" podStartSLOduration=6.670846828 podStartE2EDuration="12.806350055s" podCreationTimestamp="2026-05-26 19:28:47 +0000 UTC" firstStartedPulling="2026-05-26 19:28:53.349702389 +0000 UTC m=+197.883675151" lastFinishedPulling="2026-05-26 19:28:59.485205599 +0000 UTC m=+204.019178378" observedRunningTime="2026-05-26 19:28:59.8052785 +0000 UTC m=+204.339251323" watchObservedRunningTime="2026-05-26 19:28:59.806350055 +0000 UTC m=+204.340322840" May 26 19:29:00.763684 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:00.763649 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-968596b7b-5kd6n" event={"ID":"2f1621de-0454-4795-aafc-c463c5aeaada","Type":"ContainerStarted","Data":"89ea164426c201a8cdff7664851382b798eda0071617f55ec8d51b04b7652f16"} May 26 19:29:00.765191 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:00.765158 2578 generic.go:358] "Generic (PLEG): container finished" podID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerID="a76cf9fef1c8ec713137046b93d14e7db53f64f1de8a1808ee3ce60039ecc664" exitCode=0 May 26 19:29:00.765314 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:00.765250 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb4ea5e7-8ba5-4e11-9b69-934af418e93c","Type":"ContainerDied","Data":"a76cf9fef1c8ec713137046b93d14e7db53f64f1de8a1808ee3ce60039ecc664"} May 26 19:29:00.767424 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:00.767399 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" event={"ID":"aa143360-9d1f-4c98-b904-3625128bb74f","Type":"ContainerStarted","Data":"176fa0a3ef5899ed2d11c861f9a3b8e765a071aa96fd42990c8d0a2e9585504c"} May 26 19:29:00.767534 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:00.767428 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" event={"ID":"aa143360-9d1f-4c98-b904-3625128bb74f","Type":"ContainerStarted","Data":"c74211ef160b27cf4aa4668bd4385997b45f13221d10e3588fca2c3f5f76b4cf"} May 26 19:29:00.768748 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:00.768720 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567b7686fc-fjlq2" event={"ID":"643a91e9-4863-45ee-bcdc-84a6d6f38fb5","Type":"ContainerStarted","Data":"2b84da0f9fd1bf29dc3c9e85b8c69086f7f4f171c6079c31e292e64c7e37453b"} May 26 19:29:00.782804 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:00.782755 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-968596b7b-5kd6n" podStartSLOduration=6.163413069 podStartE2EDuration="6.78274079s" podCreationTimestamp="2026-05-26 19:28:54 +0000 UTC" firstStartedPulling="2026-05-26 19:28:59.647769302 +0000 UTC m=+204.181742078" lastFinishedPulling="2026-05-26 19:29:00.267097029 +0000 UTC m=+204.801069799" observedRunningTime="2026-05-26 19:29:00.780901686 +0000 UTC m=+205.314874483" watchObservedRunningTime="2026-05-26 19:29:00.78274079 +0000 UTC m=+205.316713780" May 26 19:29:00.797923 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:00.797883 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-567b7686fc-fjlq2" podStartSLOduration=9.981077565 podStartE2EDuration="16.797871275s" podCreationTimestamp="2026-05-26 19:28:44 +0000 UTC" firstStartedPulling="2026-05-26 19:28:53.05686416 +0000 UTC m=+197.590836936" lastFinishedPulling="2026-05-26 19:28:59.873657872 +0000 UTC m=+204.407630646" observedRunningTime="2026-05-26 19:29:00.796414338 +0000 UTC m=+205.330387122" watchObservedRunningTime="2026-05-26 19:29:00.797871275 +0000 UTC m=+205.331844058" May 26 19:29:02.776450 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:02.776412 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" event={"ID":"aa143360-9d1f-4c98-b904-3625128bb74f","Type":"ContainerStarted","Data":"32429d3aa3ff0781f6022019b1d57d99ae2b91bac734f29dc09b3cf5ba374a5d"} May 26 19:29:02.776450 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:02.776450 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" event={"ID":"aa143360-9d1f-4c98-b904-3625128bb74f","Type":"ContainerStarted","Data":"8d4404c2bf0c28f24f11329de708d532257ab77d43aed772085f567fe6424095"} May 26 19:29:02.776877 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:02.776466 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" event={"ID":"aa143360-9d1f-4c98-b904-3625128bb74f","Type":"ContainerStarted","Data":"54a3a0a80b2ae8e1160020ca1e531318cf146cdeb0c29d4af5c4c8884de5b79f"} May 26 19:29:02.776877 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:02.776605 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:29:02.799098 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:02.799055 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" podStartSLOduration=9.237077133 podStartE2EDuration="17.79904255s" podCreationTimestamp="2026-05-26 19:28:45 +0000 UTC" firstStartedPulling="2026-05-26 19:28:53.181121117 +0000 UTC m=+197.715093885" lastFinishedPulling="2026-05-26 19:29:01.74308654 +0000 UTC m=+206.277059302" observedRunningTime="2026-05-26 19:29:02.796619158 +0000 UTC m=+207.330591953" watchObservedRunningTime="2026-05-26 19:29:02.79904255 +0000 UTC m=+207.333015333" May 26 19:29:04.788381 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:04.788351 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb4ea5e7-8ba5-4e11-9b69-934af418e93c","Type":"ContainerStarted","Data":"7ed906ad766b231e5e2a3426294a553031a4b816784b34a1e95c87b291848b47"} May 26 19:29:04.788381 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:04.788383 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb4ea5e7-8ba5-4e11-9b69-934af418e93c","Type":"ContainerStarted","Data":"ae03a69894f7fcca776c6b008a4f39509894064d16d161aa147956beada80a1d"} May 26 19:29:04.788712 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:04.788392 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb4ea5e7-8ba5-4e11-9b69-934af418e93c","Type":"ContainerStarted","Data":"7d43ed7bea363235b68d4b7652c684739b7f5a75585b03d4fa701e33c9c5655c"} May 26 19:29:04.788712 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:04.788401 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb4ea5e7-8ba5-4e11-9b69-934af418e93c","Type":"ContainerStarted","Data":"fa374e6c0bc2d56954a8c183a6d75df9a5a92fd230b86e3121a24ac27cd50e0e"} May 26 19:29:04.916097 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:04.916061 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-968596b7b-5kd6n" May 26 19:29:04.916215 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:04.916125 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-968596b7b-5kd6n" May 26 19:29:04.917432 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:04.917399 2578 patch_prober.go:28] interesting pod/console-968596b7b-5kd6n container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= May 26 19:29:04.917531 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:04.917452 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-968596b7b-5kd6n" podUID="2f1621de-0454-4795-aafc-c463c5aeaada" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" May 26 19:29:05.304305 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:05.304270 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-567b7686fc-fjlq2" May 26 19:29:05.304566 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:05.304318 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-567b7686fc-fjlq2" May 26 19:29:05.305706 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:05.305675 2578 patch_prober.go:28] interesting pod/console-567b7686fc-fjlq2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= May 26 19:29:05.305824 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:05.305722 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-567b7686fc-fjlq2" podUID="643a91e9-4863-45ee-bcdc-84a6d6f38fb5" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" May 26 19:29:05.794553 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:05.794512 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb4ea5e7-8ba5-4e11-9b69-934af418e93c","Type":"ContainerStarted","Data":"2f9cefda0e2e04a008883db2d1dab27c207eec658475af912e689f75fe20cc02"} May 26 19:29:05.794990 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:05.794560 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb4ea5e7-8ba5-4e11-9b69-934af418e93c","Type":"ContainerStarted","Data":"c1bf6aaa8d4de9fcb72a069b9497c5bdfc3bea1626c48655aea58803169c2df2"} May 26 19:29:05.820671 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:05.820629 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=10.865150305 podStartE2EDuration="21.820615014s" podCreationTimestamp="2026-05-26 19:28:44 +0000 UTC" firstStartedPulling="2026-05-26 19:28:53.122286422 +0000 UTC m=+197.656259203" lastFinishedPulling="2026-05-26 19:29:04.077751147 +0000 UTC m=+208.611723912" observedRunningTime="2026-05-26 19:29:05.819220797 +0000 UTC m=+210.353193583" watchObservedRunningTime="2026-05-26 19:29:05.820615014 +0000 UTC m=+210.354587798" May 26 19:29:07.883451 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:07.883410 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb4ea5e7-8ba5-4e11-9b69-934af418e93c/init-config-reloader/0.log" May 26 19:29:08.083079 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:08.083057 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb4ea5e7-8ba5-4e11-9b69-934af418e93c/alertmanager/0.log" May 26 19:29:08.123925 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:08.123900 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:29:08.123925 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:08.123928 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:29:08.283183 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:08.283158 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb4ea5e7-8ba5-4e11-9b69-934af418e93c/config-reloader/0.log" May 26 19:29:08.482940 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:08.482901 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb4ea5e7-8ba5-4e11-9b69-934af418e93c/kube-rbac-proxy-web/0.log" May 26 19:29:08.684190 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:08.683481 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb4ea5e7-8ba5-4e11-9b69-934af418e93c/kube-rbac-proxy/0.log" May 26 19:29:08.785486 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:08.785454 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7cdf89bb4f-28xz4" May 26 19:29:08.883494 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:08.883468 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb4ea5e7-8ba5-4e11-9b69-934af418e93c/kube-rbac-proxy-metric/0.log" May 26 19:29:09.083523 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:09.083453 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb4ea5e7-8ba5-4e11-9b69-934af418e93c/prom-label-proxy/0.log" May 26 19:29:09.483944 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:09.483915 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-rcpxj_56b5862b-6b1c-4902-b40c-ef9022c5f5b5/kube-state-metrics/0.log" May 26 19:29:09.683622 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:09.683596 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-rcpxj_56b5862b-6b1c-4902-b40c-ef9022c5f5b5/kube-rbac-proxy-main/0.log" May 26 19:29:09.883037 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:09.882963 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-rcpxj_56b5862b-6b1c-4902-b40c-ef9022c5f5b5/kube-rbac-proxy-self/0.log" May 26 19:29:10.083216 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:10.083185 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-9f456bbb-626mn_3dca64ef-e955-4cef-a8d4-193fe2378c11/metrics-server/0.log" May 26 19:29:10.282960 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:10.282933 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-qkbhh_ff768363-8e4e-44c8-8b36-7077f16b5128/monitoring-plugin/0.log" May 26 19:29:10.484493 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:10.484469 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f47x8_95db239a-8064-4562-bc79-24aceb39eabc/init-textfile/0.log" May 26 19:29:10.683146 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:10.683104 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f47x8_95db239a-8064-4562-bc79-24aceb39eabc/node-exporter/0.log" May 26 19:29:10.883299 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:10.883272 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f47x8_95db239a-8064-4562-bc79-24aceb39eabc/kube-rbac-proxy/0.log" May 26 19:29:12.282930 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:12.282899 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-x8z9m_6d4ee97d-ba1e-479e-a42c-eb682fc511bf/kube-rbac-proxy-main/0.log" May 26 19:29:12.483370 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:12.483341 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-x8z9m_6d4ee97d-ba1e-479e-a42c-eb682fc511bf/kube-rbac-proxy-self/0.log" May 26 19:29:12.683277 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:12.683251 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-x8z9m_6d4ee97d-ba1e-479e-a42c-eb682fc511bf/openshift-state-metrics/0.log" May 26 19:29:14.284205 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:14.284180 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-jjgpv_c341c15c-dd66-4ef9-9b86-aaf5a30bf57f/prometheus-operator/0.log" May 26 19:29:14.483886 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:14.483862 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-jjgpv_c341c15c-dd66-4ef9-9b86-aaf5a30bf57f/kube-rbac-proxy/0.log" May 26 19:29:14.916160 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:14.916129 2578 patch_prober.go:28] interesting pod/console-968596b7b-5kd6n container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= May 26 19:29:14.916312 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:14.916177 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-968596b7b-5kd6n" podUID="2f1621de-0454-4795-aafc-c463c5aeaada" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" May 26 19:29:15.304665 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:15.304580 2578 patch_prober.go:28] interesting pod/console-567b7686fc-fjlq2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= May 26 19:29:15.304665 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:15.304634 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-567b7686fc-fjlq2" podUID="643a91e9-4863-45ee-bcdc-84a6d6f38fb5" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" May 26 19:29:15.482810 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:15.482779 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cdf89bb4f-28xz4_aa143360-9d1f-4c98-b904-3625128bb74f/thanos-query/0.log" May 26 19:29:15.682794 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:15.682768 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cdf89bb4f-28xz4_aa143360-9d1f-4c98-b904-3625128bb74f/kube-rbac-proxy-web/0.log" May 26 19:29:15.882835 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:15.882808 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cdf89bb4f-28xz4_aa143360-9d1f-4c98-b904-3625128bb74f/kube-rbac-proxy/0.log" May 26 19:29:16.083005 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:16.082940 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cdf89bb4f-28xz4_aa143360-9d1f-4c98-b904-3625128bb74f/prom-label-proxy/0.log" May 26 19:29:16.283447 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:16.283420 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cdf89bb4f-28xz4_aa143360-9d1f-4c98-b904-3625128bb74f/kube-rbac-proxy-rules/0.log" May 26 19:29:16.483754 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:16.483729 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cdf89bb4f-28xz4_aa143360-9d1f-4c98-b904-3625128bb74f/kube-rbac-proxy-metrics/0.log" May 26 19:29:17.283451 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:17.283426 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-567b7686fc-fjlq2_643a91e9-4863-45ee-bcdc-84a6d6f38fb5/console/0.log" May 26 19:29:17.483675 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:17.483632 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-968596b7b-5kd6n_2f1621de-0454-4795-aafc-c463c5aeaada/console/0.log" May 26 19:29:17.684390 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:17.684345 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-ff7jc_4f8b8e1d-613a-42d9-be26-7d0e14b5dc41/download-server/0.log" May 26 19:29:19.083335 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:19.083308 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ggpg7_20a5cc5f-5de0-4de6-802a-cf1bcb303748/dns-node-resolver/0.log" May 26 19:29:20.283353 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:20.283308 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bjdfl_582de6bd-0ed1-4a29-b96e-f8825f9df04f/node-ca/0.log" May 26 19:29:24.916165 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:24.916121 2578 patch_prober.go:28] interesting pod/console-968596b7b-5kd6n container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= May 26 19:29:24.916753 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:24.916193 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-968596b7b-5kd6n" podUID="2f1621de-0454-4795-aafc-c463c5aeaada" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" May 26 19:29:25.303983 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:25.303910 2578 patch_prober.go:28] interesting pod/console-567b7686fc-fjlq2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= May 26 19:29:25.303983 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:25.303963 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-567b7686fc-fjlq2" podUID="643a91e9-4863-45ee-bcdc-84a6d6f38fb5" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" May 26 19:29:25.861652 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:25.861622 2578 generic.go:358] "Generic (PLEG): container finished" podID="e5da566c-d02a-4260-9b09-280863b75669" containerID="30eb85e357b757fa13eb5dae8ea012bbb9541616687bc049d7cd6988b1e4bba4" exitCode=0 May 26 19:29:25.861801 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:25.861677 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dbpt4" event={"ID":"e5da566c-d02a-4260-9b09-280863b75669","Type":"ContainerDied","Data":"30eb85e357b757fa13eb5dae8ea012bbb9541616687bc049d7cd6988b1e4bba4"} May 26 19:29:25.861956 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:25.861943 2578 scope.go:117] "RemoveContainer" containerID="30eb85e357b757fa13eb5dae8ea012bbb9541616687bc049d7cd6988b1e4bba4" May 26 19:29:26.866052 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:26.866021 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-dbpt4" event={"ID":"e5da566c-d02a-4260-9b09-280863b75669","Type":"ContainerStarted","Data":"e34e1e57f1153b2bad6c49bc276faa155620c672c1383ab7de8b954c9ac2fc3d"} May 26 19:29:28.128840 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:28.128814 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:29:28.132412 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:28.132390 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-9f456bbb-626mn" May 26 19:29:34.916184 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:34.916156 2578 patch_prober.go:28] interesting pod/console-968596b7b-5kd6n container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= May 26 19:29:34.916638 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:34.916225 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-968596b7b-5kd6n" podUID="2f1621de-0454-4795-aafc-c463c5aeaada" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" May 26 19:29:35.303923 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:35.303842 2578 patch_prober.go:28] interesting pod/console-567b7686fc-fjlq2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= May 26 19:29:35.303923 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:35.303889 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-567b7686fc-fjlq2" podUID="643a91e9-4863-45ee-bcdc-84a6d6f38fb5" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" May 26 19:29:41.918986 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:41.918951 2578 generic.go:358] "Generic (PLEG): container finished" podID="c32b7df0-3951-4635-b58d-9ac153849aba" containerID="66b08a217a0e5fe9feb8d30126a982dad9adc8489bb0c0a5dde7e1342f3fe836" exitCode=0 May 26 19:29:41.919505 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:41.919025 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qzlrj" event={"ID":"c32b7df0-3951-4635-b58d-9ac153849aba","Type":"ContainerDied","Data":"66b08a217a0e5fe9feb8d30126a982dad9adc8489bb0c0a5dde7e1342f3fe836"} May 26 19:29:41.919505 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:41.919427 2578 scope.go:117] "RemoveContainer" containerID="66b08a217a0e5fe9feb8d30126a982dad9adc8489bb0c0a5dde7e1342f3fe836" May 26 19:29:42.923708 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:42.923674 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qzlrj" event={"ID":"c32b7df0-3951-4635-b58d-9ac153849aba","Type":"ContainerStarted","Data":"3046b941b4158c6aa6f642ba6c0dfc3ff1e036fc10f25d2fc460a08fcd65fa22"} May 26 19:29:44.916030 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:44.915993 2578 patch_prober.go:28] interesting pod/console-968596b7b-5kd6n container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= May 26 19:29:44.916421 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:44.916058 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-968596b7b-5kd6n" podUID="2f1621de-0454-4795-aafc-c463c5aeaada" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" May 26 19:29:45.303992 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:45.303901 2578 patch_prober.go:28] interesting pod/console-567b7686fc-fjlq2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= May 26 19:29:45.303992 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:45.303952 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-567b7686fc-fjlq2" podUID="643a91e9-4863-45ee-bcdc-84a6d6f38fb5" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" May 26 19:29:47.906805 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:47.906751 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs\") pod \"network-metrics-daemon-qsdsm\" (UID: \"6ee8f53e-5d8f-4944-89c4-ed98b8fad590\") " pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:29:47.909106 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:47.909079 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ee8f53e-5d8f-4944-89c4-ed98b8fad590-metrics-certs\") pod \"network-metrics-daemon-qsdsm\" (UID: \"6ee8f53e-5d8f-4944-89c4-ed98b8fad590\") " pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:29:48.202532 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:48.202458 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z9trh\"" May 26 19:29:48.210508 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:48.210490 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qsdsm" May 26 19:29:48.340111 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:48.340083 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qsdsm"] May 26 19:29:48.342527 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:29:48.342497 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ee8f53e_5d8f_4944_89c4_ed98b8fad590.slice/crio-58f712e97c00d1053aa3780941842429af1f3f4c7d6ba0bf80665d3a8654834d WatchSource:0}: Error finding container 58f712e97c00d1053aa3780941842429af1f3f4c7d6ba0bf80665d3a8654834d: Status 404 returned error can't find the container with id 58f712e97c00d1053aa3780941842429af1f3f4c7d6ba0bf80665d3a8654834d May 26 19:29:48.944228 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:48.944193 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qsdsm" event={"ID":"6ee8f53e-5d8f-4944-89c4-ed98b8fad590","Type":"ContainerStarted","Data":"58f712e97c00d1053aa3780941842429af1f3f4c7d6ba0bf80665d3a8654834d"} May 26 19:29:49.948543 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:49.948510 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qsdsm" event={"ID":"6ee8f53e-5d8f-4944-89c4-ed98b8fad590","Type":"ContainerStarted","Data":"d383b6c55bca85c368e06f934b2674f0bef25636f4d1e795ab9e006c601494eb"} May 26 19:29:49.948543 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:49.948544 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qsdsm" event={"ID":"6ee8f53e-5d8f-4944-89c4-ed98b8fad590","Type":"ContainerStarted","Data":"65051a0d2c65677634f092600b53fcf4613035d098973f30de1d547cd238b840"} May 26 19:29:49.964539 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:49.964495 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qsdsm" podStartSLOduration=253.017245652 podStartE2EDuration="4m13.964479843s" podCreationTimestamp="2026-05-26 19:25:36 +0000 UTC" firstStartedPulling="2026-05-26 19:29:48.34429615 +0000 UTC m=+252.878268913" lastFinishedPulling="2026-05-26 19:29:49.29153034 +0000 UTC m=+253.825503104" observedRunningTime="2026-05-26 19:29:49.963044932 +0000 UTC m=+254.497017721" watchObservedRunningTime="2026-05-26 19:29:49.964479843 +0000 UTC m=+254.498452670" May 26 19:29:54.915830 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:54.915797 2578 patch_prober.go:28] interesting pod/console-968596b7b-5kd6n container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= May 26 19:29:54.916196 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:54.915847 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-968596b7b-5kd6n" podUID="2f1621de-0454-4795-aafc-c463c5aeaada" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" May 26 19:29:55.304124 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:55.304027 2578 patch_prober.go:28] interesting pod/console-567b7686fc-fjlq2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= May 26 19:29:55.304124 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:29:55.304073 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-567b7686fc-fjlq2" podUID="643a91e9-4863-45ee-bcdc-84a6d6f38fb5" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" May 26 19:30:02.677448 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:02.677407 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-567b7686fc-fjlq2"] May 26 19:30:02.708149 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:02.708120 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-797d998cfc-zvdgw"] May 26 19:30:02.710875 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:02.710857 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:02.719693 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:02.719668 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-797d998cfc-zvdgw"] May 26 19:30:02.747958 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:02.747928 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5944bc-47e9-4886-8238-105b8b9b53ee-trusted-ca-bundle\") pod \"console-797d998cfc-zvdgw\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:02.748073 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:02.747962 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a5944bc-47e9-4886-8238-105b8b9b53ee-oauth-serving-cert\") pod \"console-797d998cfc-zvdgw\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:02.748073 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:02.748043 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a5944bc-47e9-4886-8238-105b8b9b53ee-console-serving-cert\") pod \"console-797d998cfc-zvdgw\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:02.748182 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:02.748085 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a5944bc-47e9-4886-8238-105b8b9b53ee-service-ca\") pod \"console-797d998cfc-zvdgw\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:02.748182 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:02.748115 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a5944bc-47e9-4886-8238-105b8b9b53ee-console-config\") pod \"console-797d998cfc-zvdgw\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:02.748182 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:02.748144 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a5944bc-47e9-4886-8238-105b8b9b53ee-console-oauth-config\") pod \"console-797d998cfc-zvdgw\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:02.748279 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:02.748238 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z48wh\" (UniqueName: \"kubernetes.io/projected/6a5944bc-47e9-4886-8238-105b8b9b53ee-kube-api-access-z48wh\") pod \"console-797d998cfc-zvdgw\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:02.848951 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:02.848913 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a5944bc-47e9-4886-8238-105b8b9b53ee-service-ca\") pod \"console-797d998cfc-zvdgw\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:02.848951 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:02.848956 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a5944bc-47e9-4886-8238-105b8b9b53ee-console-config\") pod \"console-797d998cfc-zvdgw\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:02.849108 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:02.849001 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a5944bc-47e9-4886-8238-105b8b9b53ee-console-oauth-config\") pod \"console-797d998cfc-zvdgw\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:02.849108 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:02.849044 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z48wh\" (UniqueName: \"kubernetes.io/projected/6a5944bc-47e9-4886-8238-105b8b9b53ee-kube-api-access-z48wh\") pod \"console-797d998cfc-zvdgw\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:02.849108 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:02.849105 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5944bc-47e9-4886-8238-105b8b9b53ee-trusted-ca-bundle\") pod \"console-797d998cfc-zvdgw\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:02.849252 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:02.849130 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a5944bc-47e9-4886-8238-105b8b9b53ee-oauth-serving-cert\") pod \"console-797d998cfc-zvdgw\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:02.849367 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:02.849302 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a5944bc-47e9-4886-8238-105b8b9b53ee-console-serving-cert\") pod \"console-797d998cfc-zvdgw\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:02.849722 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:02.849703 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a5944bc-47e9-4886-8238-105b8b9b53ee-console-config\") pod \"console-797d998cfc-zvdgw\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:02.849804 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:02.849745 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a5944bc-47e9-4886-8238-105b8b9b53ee-service-ca\") pod \"console-797d998cfc-zvdgw\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:02.849894 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:02.849872 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a5944bc-47e9-4886-8238-105b8b9b53ee-oauth-serving-cert\") pod \"console-797d998cfc-zvdgw\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:02.850065 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:02.850049 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5944bc-47e9-4886-8238-105b8b9b53ee-trusted-ca-bundle\") pod \"console-797d998cfc-zvdgw\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:02.851509 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:02.851490 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a5944bc-47e9-4886-8238-105b8b9b53ee-console-oauth-config\") pod \"console-797d998cfc-zvdgw\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:02.851632 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:02.851616 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a5944bc-47e9-4886-8238-105b8b9b53ee-console-serving-cert\") pod \"console-797d998cfc-zvdgw\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:02.856359 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:02.856339 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z48wh\" (UniqueName: \"kubernetes.io/projected/6a5944bc-47e9-4886-8238-105b8b9b53ee-kube-api-access-z48wh\") pod \"console-797d998cfc-zvdgw\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:03.020611 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:03.020527 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:03.149711 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:03.149679 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-797d998cfc-zvdgw"] May 26 19:30:03.152816 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:30:03.152784 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a5944bc_47e9_4886_8238_105b8b9b53ee.slice/crio-9ff3ddf5f8368b38a2e7ffc297a993b3cf14d86c919cfbb15174e690524e3944 WatchSource:0}: Error finding container 9ff3ddf5f8368b38a2e7ffc297a993b3cf14d86c919cfbb15174e690524e3944: Status 404 returned error can't find the container with id 9ff3ddf5f8368b38a2e7ffc297a993b3cf14d86c919cfbb15174e690524e3944 May 26 19:30:03.731357 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:03.731310 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 19:30:03.731815 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:03.731736 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="alertmanager" containerID="cri-o://fa374e6c0bc2d56954a8c183a6d75df9a5a92fd230b86e3121a24ac27cd50e0e" gracePeriod=120 May 26 19:30:03.731880 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:03.731797 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="kube-rbac-proxy-metric" containerID="cri-o://c1bf6aaa8d4de9fcb72a069b9497c5bdfc3bea1626c48655aea58803169c2df2" gracePeriod=120 May 26 19:30:03.731880 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:03.731852 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="kube-rbac-proxy-web" containerID="cri-o://ae03a69894f7fcca776c6b008a4f39509894064d16d161aa147956beada80a1d" gracePeriod=120 May 26 19:30:03.731978 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:03.731866 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="kube-rbac-proxy" containerID="cri-o://7ed906ad766b231e5e2a3426294a553031a4b816784b34a1e95c87b291848b47" gracePeriod=120 May 26 19:30:03.731978 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:03.731872 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="prom-label-proxy" containerID="cri-o://2f9cefda0e2e04a008883db2d1dab27c207eec658475af912e689f75fe20cc02" gracePeriod=120 May 26 19:30:03.731978 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:03.731889 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="config-reloader" containerID="cri-o://7d43ed7bea363235b68d4b7652c684739b7f5a75585b03d4fa701e33c9c5655c" gracePeriod=120 May 26 19:30:03.988948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:03.988858 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797d998cfc-zvdgw" event={"ID":"6a5944bc-47e9-4886-8238-105b8b9b53ee","Type":"ContainerStarted","Data":"5cd1def4c2662afd70d0e3e8619f4fcf1f0b1ee7144e50c99c9121f4e01c17e0"} May 26 19:30:03.988948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:03.988896 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797d998cfc-zvdgw" event={"ID":"6a5944bc-47e9-4886-8238-105b8b9b53ee","Type":"ContainerStarted","Data":"9ff3ddf5f8368b38a2e7ffc297a993b3cf14d86c919cfbb15174e690524e3944"} May 26 19:30:03.991699 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:03.991673 2578 generic.go:358] "Generic (PLEG): container finished" podID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerID="2f9cefda0e2e04a008883db2d1dab27c207eec658475af912e689f75fe20cc02" exitCode=0 May 26 19:30:03.991699 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:03.991695 2578 generic.go:358] "Generic (PLEG): container finished" podID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerID="c1bf6aaa8d4de9fcb72a069b9497c5bdfc3bea1626c48655aea58803169c2df2" exitCode=0 May 26 19:30:03.991857 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:03.991704 2578 generic.go:358] "Generic (PLEG): container finished" podID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerID="7ed906ad766b231e5e2a3426294a553031a4b816784b34a1e95c87b291848b47" exitCode=0 May 26 19:30:03.991857 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:03.991713 2578 generic.go:358] "Generic (PLEG): container finished" podID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerID="7d43ed7bea363235b68d4b7652c684739b7f5a75585b03d4fa701e33c9c5655c" exitCode=0 May 26 19:30:03.991857 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:03.991720 2578 generic.go:358] "Generic (PLEG): container finished" podID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerID="fa374e6c0bc2d56954a8c183a6d75df9a5a92fd230b86e3121a24ac27cd50e0e" exitCode=0 May 26 19:30:03.991857 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:03.991736 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb4ea5e7-8ba5-4e11-9b69-934af418e93c","Type":"ContainerDied","Data":"2f9cefda0e2e04a008883db2d1dab27c207eec658475af912e689f75fe20cc02"} May 26 19:30:03.991857 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:03.991760 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb4ea5e7-8ba5-4e11-9b69-934af418e93c","Type":"ContainerDied","Data":"c1bf6aaa8d4de9fcb72a069b9497c5bdfc3bea1626c48655aea58803169c2df2"} May 26 19:30:03.991857 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:03.991771 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb4ea5e7-8ba5-4e11-9b69-934af418e93c","Type":"ContainerDied","Data":"7ed906ad766b231e5e2a3426294a553031a4b816784b34a1e95c87b291848b47"} May 26 19:30:03.991857 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:03.991783 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb4ea5e7-8ba5-4e11-9b69-934af418e93c","Type":"ContainerDied","Data":"7d43ed7bea363235b68d4b7652c684739b7f5a75585b03d4fa701e33c9c5655c"} May 26 19:30:03.991857 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:03.991792 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb4ea5e7-8ba5-4e11-9b69-934af418e93c","Type":"ContainerDied","Data":"fa374e6c0bc2d56954a8c183a6d75df9a5a92fd230b86e3121a24ac27cd50e0e"} May 26 19:30:04.916140 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:04.916105 2578 patch_prober.go:28] interesting pod/console-968596b7b-5kd6n container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= May 26 19:30:04.916476 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:04.916171 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-968596b7b-5kd6n" podUID="2f1621de-0454-4795-aafc-c463c5aeaada" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" May 26 19:30:04.971782 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:04.971760 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:04.997304 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:04.997259 2578 generic.go:358] "Generic (PLEG): container finished" podID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerID="ae03a69894f7fcca776c6b008a4f39509894064d16d161aa147956beada80a1d" exitCode=0 May 26 19:30:04.997586 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:04.997493 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb4ea5e7-8ba5-4e11-9b69-934af418e93c","Type":"ContainerDied","Data":"ae03a69894f7fcca776c6b008a4f39509894064d16d161aa147956beada80a1d"} May 26 19:30:04.997687 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:04.997575 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb4ea5e7-8ba5-4e11-9b69-934af418e93c","Type":"ContainerDied","Data":"134398b56d860a887a294767bfaf2e404ea5971c69328d6460244eaf5c6d6c55"} May 26 19:30:04.997687 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:04.997624 2578 scope.go:117] "RemoveContainer" containerID="2f9cefda0e2e04a008883db2d1dab27c207eec658475af912e689f75fe20cc02" May 26 19:30:04.997873 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:04.997859 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:04.999358 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:04.999299 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-797d998cfc-zvdgw" podStartSLOduration=2.99928577 podStartE2EDuration="2.99928577s" podCreationTimestamp="2026-05-26 19:30:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:30:04.003975919 +0000 UTC m=+268.537948706" watchObservedRunningTime="2026-05-26 19:30:04.99928577 +0000 UTC m=+269.533258554" May 26 19:30:05.007047 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.007030 2578 scope.go:117] "RemoveContainer" containerID="c1bf6aaa8d4de9fcb72a069b9497c5bdfc3bea1626c48655aea58803169c2df2" May 26 19:30:05.015184 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.015155 2578 scope.go:117] "RemoveContainer" containerID="7ed906ad766b231e5e2a3426294a553031a4b816784b34a1e95c87b291848b47" May 26 19:30:05.021855 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.021833 2578 scope.go:117] "RemoveContainer" containerID="ae03a69894f7fcca776c6b008a4f39509894064d16d161aa147956beada80a1d" May 26 19:30:05.029586 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.029568 2578 scope.go:117] "RemoveContainer" containerID="7d43ed7bea363235b68d4b7652c684739b7f5a75585b03d4fa701e33c9c5655c" May 26 19:30:05.035691 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.035675 2578 scope.go:117] "RemoveContainer" containerID="fa374e6c0bc2d56954a8c183a6d75df9a5a92fd230b86e3121a24ac27cd50e0e" May 26 19:30:05.045317 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.044050 2578 scope.go:117] "RemoveContainer" containerID="a76cf9fef1c8ec713137046b93d14e7db53f64f1de8a1808ee3ce60039ecc664" May 26 19:30:05.052193 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.052176 2578 scope.go:117] "RemoveContainer" containerID="2f9cefda0e2e04a008883db2d1dab27c207eec658475af912e689f75fe20cc02" May 26 19:30:05.052508 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:30:05.052470 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f9cefda0e2e04a008883db2d1dab27c207eec658475af912e689f75fe20cc02\": container with ID starting with 2f9cefda0e2e04a008883db2d1dab27c207eec658475af912e689f75fe20cc02 not found: ID does not exist" containerID="2f9cefda0e2e04a008883db2d1dab27c207eec658475af912e689f75fe20cc02" May 26 19:30:05.052604 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.052520 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f9cefda0e2e04a008883db2d1dab27c207eec658475af912e689f75fe20cc02"} err="failed to get container status \"2f9cefda0e2e04a008883db2d1dab27c207eec658475af912e689f75fe20cc02\": rpc error: code = NotFound desc = could not find container \"2f9cefda0e2e04a008883db2d1dab27c207eec658475af912e689f75fe20cc02\": container with ID starting with 2f9cefda0e2e04a008883db2d1dab27c207eec658475af912e689f75fe20cc02 not found: ID does not exist" May 26 19:30:05.052604 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.052565 2578 scope.go:117] "RemoveContainer" containerID="c1bf6aaa8d4de9fcb72a069b9497c5bdfc3bea1626c48655aea58803169c2df2" May 26 19:30:05.052813 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:30:05.052792 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1bf6aaa8d4de9fcb72a069b9497c5bdfc3bea1626c48655aea58803169c2df2\": container with ID starting with c1bf6aaa8d4de9fcb72a069b9497c5bdfc3bea1626c48655aea58803169c2df2 not found: ID does not exist" containerID="c1bf6aaa8d4de9fcb72a069b9497c5bdfc3bea1626c48655aea58803169c2df2" May 26 19:30:05.052867 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.052819 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1bf6aaa8d4de9fcb72a069b9497c5bdfc3bea1626c48655aea58803169c2df2"} err="failed to get container status \"c1bf6aaa8d4de9fcb72a069b9497c5bdfc3bea1626c48655aea58803169c2df2\": rpc error: code = NotFound desc = could not find container \"c1bf6aaa8d4de9fcb72a069b9497c5bdfc3bea1626c48655aea58803169c2df2\": container with ID starting with c1bf6aaa8d4de9fcb72a069b9497c5bdfc3bea1626c48655aea58803169c2df2 not found: ID does not exist" May 26 19:30:05.052867 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.052842 2578 scope.go:117] "RemoveContainer" containerID="7ed906ad766b231e5e2a3426294a553031a4b816784b34a1e95c87b291848b47" May 26 19:30:05.053113 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:30:05.053087 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ed906ad766b231e5e2a3426294a553031a4b816784b34a1e95c87b291848b47\": container with ID starting with 7ed906ad766b231e5e2a3426294a553031a4b816784b34a1e95c87b291848b47 not found: ID does not exist" containerID="7ed906ad766b231e5e2a3426294a553031a4b816784b34a1e95c87b291848b47" May 26 19:30:05.053211 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.053120 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ed906ad766b231e5e2a3426294a553031a4b816784b34a1e95c87b291848b47"} err="failed to get container status \"7ed906ad766b231e5e2a3426294a553031a4b816784b34a1e95c87b291848b47\": rpc error: code = NotFound desc = could not find container \"7ed906ad766b231e5e2a3426294a553031a4b816784b34a1e95c87b291848b47\": container with ID starting with 7ed906ad766b231e5e2a3426294a553031a4b816784b34a1e95c87b291848b47 not found: ID does not exist" May 26 19:30:05.053211 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.053142 2578 scope.go:117] "RemoveContainer" containerID="ae03a69894f7fcca776c6b008a4f39509894064d16d161aa147956beada80a1d" May 26 19:30:05.053411 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:30:05.053386 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae03a69894f7fcca776c6b008a4f39509894064d16d161aa147956beada80a1d\": container with ID starting with ae03a69894f7fcca776c6b008a4f39509894064d16d161aa147956beada80a1d not found: ID does not exist" containerID="ae03a69894f7fcca776c6b008a4f39509894064d16d161aa147956beada80a1d" May 26 19:30:05.053482 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.053422 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae03a69894f7fcca776c6b008a4f39509894064d16d161aa147956beada80a1d"} err="failed to get container status \"ae03a69894f7fcca776c6b008a4f39509894064d16d161aa147956beada80a1d\": rpc error: code = NotFound desc = could not find container \"ae03a69894f7fcca776c6b008a4f39509894064d16d161aa147956beada80a1d\": container with ID starting with ae03a69894f7fcca776c6b008a4f39509894064d16d161aa147956beada80a1d not found: ID does not exist" May 26 19:30:05.053482 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.053448 2578 scope.go:117] "RemoveContainer" containerID="7d43ed7bea363235b68d4b7652c684739b7f5a75585b03d4fa701e33c9c5655c" May 26 19:30:05.053778 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:30:05.053761 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d43ed7bea363235b68d4b7652c684739b7f5a75585b03d4fa701e33c9c5655c\": container with ID starting with 7d43ed7bea363235b68d4b7652c684739b7f5a75585b03d4fa701e33c9c5655c not found: ID does not exist" containerID="7d43ed7bea363235b68d4b7652c684739b7f5a75585b03d4fa701e33c9c5655c" May 26 19:30:05.053841 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.053781 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d43ed7bea363235b68d4b7652c684739b7f5a75585b03d4fa701e33c9c5655c"} err="failed to get container status \"7d43ed7bea363235b68d4b7652c684739b7f5a75585b03d4fa701e33c9c5655c\": rpc error: code = NotFound desc = could not find container \"7d43ed7bea363235b68d4b7652c684739b7f5a75585b03d4fa701e33c9c5655c\": container with ID starting with 7d43ed7bea363235b68d4b7652c684739b7f5a75585b03d4fa701e33c9c5655c not found: ID does not exist" May 26 19:30:05.053841 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.053795 2578 scope.go:117] "RemoveContainer" containerID="fa374e6c0bc2d56954a8c183a6d75df9a5a92fd230b86e3121a24ac27cd50e0e" May 26 19:30:05.054055 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:30:05.054039 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa374e6c0bc2d56954a8c183a6d75df9a5a92fd230b86e3121a24ac27cd50e0e\": container with ID starting with fa374e6c0bc2d56954a8c183a6d75df9a5a92fd230b86e3121a24ac27cd50e0e not found: ID does not exist" containerID="fa374e6c0bc2d56954a8c183a6d75df9a5a92fd230b86e3121a24ac27cd50e0e" May 26 19:30:05.054100 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.054057 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa374e6c0bc2d56954a8c183a6d75df9a5a92fd230b86e3121a24ac27cd50e0e"} err="failed to get container status \"fa374e6c0bc2d56954a8c183a6d75df9a5a92fd230b86e3121a24ac27cd50e0e\": rpc error: code = NotFound desc = could not find container \"fa374e6c0bc2d56954a8c183a6d75df9a5a92fd230b86e3121a24ac27cd50e0e\": container with ID starting with fa374e6c0bc2d56954a8c183a6d75df9a5a92fd230b86e3121a24ac27cd50e0e not found: ID does not exist" May 26 19:30:05.054100 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.054069 2578 scope.go:117] "RemoveContainer" containerID="a76cf9fef1c8ec713137046b93d14e7db53f64f1de8a1808ee3ce60039ecc664" May 26 19:30:05.054291 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:30:05.054277 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a76cf9fef1c8ec713137046b93d14e7db53f64f1de8a1808ee3ce60039ecc664\": container with ID starting with a76cf9fef1c8ec713137046b93d14e7db53f64f1de8a1808ee3ce60039ecc664 not found: ID does not exist" containerID="a76cf9fef1c8ec713137046b93d14e7db53f64f1de8a1808ee3ce60039ecc664" May 26 19:30:05.054350 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.054297 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a76cf9fef1c8ec713137046b93d14e7db53f64f1de8a1808ee3ce60039ecc664"} err="failed to get container status \"a76cf9fef1c8ec713137046b93d14e7db53f64f1de8a1808ee3ce60039ecc664\": rpc error: code = NotFound desc = could not find container \"a76cf9fef1c8ec713137046b93d14e7db53f64f1de8a1808ee3ce60039ecc664\": container with ID starting with a76cf9fef1c8ec713137046b93d14e7db53f64f1de8a1808ee3ce60039ecc664 not found: ID does not exist" May 26 19:30:05.067733 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.067710 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-alertmanager-main-db\") pod \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " May 26 19:30:05.067811 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.067745 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-web-config\") pod \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " May 26 19:30:05.067811 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.067786 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-secret-alertmanager-kube-rbac-proxy\") pod \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " May 26 19:30:05.067878 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.067812 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-cluster-tls-config\") pod \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " May 26 19:30:05.067878 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.067833 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-alertmanager-trusted-ca-bundle\") pod \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " May 26 19:30:05.067878 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.067871 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-secret-alertmanager-kube-rbac-proxy-web\") pod \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " May 26 19:30:05.067984 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.067893 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-config-volume\") pod \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " May 26 19:30:05.067984 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.067928 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-config-out\") pod \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " May 26 19:30:05.067984 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.067972 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " May 26 19:30:05.068130 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.068011 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-tls-assets\") pod \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " May 26 19:30:05.068130 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.068029 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "fb4ea5e7-8ba5-4e11-9b69-934af418e93c" (UID: "fb4ea5e7-8ba5-4e11-9b69-934af418e93c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:30:05.068130 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.068038 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-secret-alertmanager-main-tls\") pod \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " May 26 19:30:05.068281 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.068149 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-metrics-client-ca\") pod \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " May 26 19:30:05.068281 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.068184 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xs47q\" (UniqueName: \"kubernetes.io/projected/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-kube-api-access-xs47q\") pod \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\" (UID: \"fb4ea5e7-8ba5-4e11-9b69-934af418e93c\") " May 26 19:30:05.068398 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.068293 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "fb4ea5e7-8ba5-4e11-9b69-934af418e93c" (UID: "fb4ea5e7-8ba5-4e11-9b69-934af418e93c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 19:30:05.069347 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.068655 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:05.069347 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.068681 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-alertmanager-main-db\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:05.069347 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.068940 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "fb4ea5e7-8ba5-4e11-9b69-934af418e93c" (UID: "fb4ea5e7-8ba5-4e11-9b69-934af418e93c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 19:30:05.071131 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.071105 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-kube-api-access-xs47q" (OuterVolumeSpecName: "kube-api-access-xs47q") pod "fb4ea5e7-8ba5-4e11-9b69-934af418e93c" (UID: "fb4ea5e7-8ba5-4e11-9b69-934af418e93c"). InnerVolumeSpecName "kube-api-access-xs47q". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:30:05.071309 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.071268 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "fb4ea5e7-8ba5-4e11-9b69-934af418e93c" (UID: "fb4ea5e7-8ba5-4e11-9b69-934af418e93c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:30:05.071621 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.071579 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "fb4ea5e7-8ba5-4e11-9b69-934af418e93c" (UID: "fb4ea5e7-8ba5-4e11-9b69-934af418e93c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:30:05.071723 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.071658 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "fb4ea5e7-8ba5-4e11-9b69-934af418e93c" (UID: "fb4ea5e7-8ba5-4e11-9b69-934af418e93c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:30:05.072127 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.072083 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-config-volume" (OuterVolumeSpecName: "config-volume") pod "fb4ea5e7-8ba5-4e11-9b69-934af418e93c" (UID: "fb4ea5e7-8ba5-4e11-9b69-934af418e93c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:30:05.072202 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.072118 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-config-out" (OuterVolumeSpecName: "config-out") pod "fb4ea5e7-8ba5-4e11-9b69-934af418e93c" (UID: "fb4ea5e7-8ba5-4e11-9b69-934af418e93c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:30:05.072700 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.072683 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "fb4ea5e7-8ba5-4e11-9b69-934af418e93c" (UID: "fb4ea5e7-8ba5-4e11-9b69-934af418e93c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:30:05.072940 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.072914 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "fb4ea5e7-8ba5-4e11-9b69-934af418e93c" (UID: "fb4ea5e7-8ba5-4e11-9b69-934af418e93c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:30:05.075606 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.075569 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "fb4ea5e7-8ba5-4e11-9b69-934af418e93c" (UID: "fb4ea5e7-8ba5-4e11-9b69-934af418e93c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:30:05.082815 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.082793 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-web-config" (OuterVolumeSpecName: "web-config") pod "fb4ea5e7-8ba5-4e11-9b69-934af418e93c" (UID: "fb4ea5e7-8ba5-4e11-9b69-934af418e93c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:30:05.169255 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.169221 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:05.169255 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.169249 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-config-volume\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:05.169255 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.169259 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-config-out\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:05.169499 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.169267 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:05.169499 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.169277 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-tls-assets\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:05.169499 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.169286 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-secret-alertmanager-main-tls\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:05.169499 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.169294 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-metrics-client-ca\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:05.169499 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.169305 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xs47q\" (UniqueName: \"kubernetes.io/projected/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-kube-api-access-xs47q\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:05.169499 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.169314 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-web-config\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:05.169499 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.169343 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:05.169499 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.169352 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fb4ea5e7-8ba5-4e11-9b69-934af418e93c-cluster-tls-config\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:05.323035 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.323006 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 19:30:05.326917 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.326889 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 19:30:05.348751 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.348722 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 19:30:05.349023 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.349010 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="config-reloader" May 26 19:30:05.349063 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.349025 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="config-reloader" May 26 19:30:05.349063 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.349038 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="prom-label-proxy" May 26 19:30:05.349063 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.349044 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="prom-label-proxy" May 26 19:30:05.349063 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.349055 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="alertmanager" May 26 19:30:05.349063 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.349060 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="alertmanager" May 26 19:30:05.349220 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.349066 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="kube-rbac-proxy-metric" May 26 19:30:05.349220 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.349072 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="kube-rbac-proxy-metric" May 26 19:30:05.349220 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.349080 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="init-config-reloader" May 26 19:30:05.349220 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.349085 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="init-config-reloader" May 26 19:30:05.349220 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.349091 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="kube-rbac-proxy" May 26 19:30:05.349220 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.349096 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="kube-rbac-proxy" May 26 19:30:05.349220 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.349102 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="kube-rbac-proxy-web" May 26 19:30:05.349220 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.349107 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="kube-rbac-proxy-web" May 26 19:30:05.349220 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.349157 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="kube-rbac-proxy-metric" May 26 19:30:05.349220 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.349167 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="kube-rbac-proxy-web" May 26 19:30:05.349220 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.349173 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="prom-label-proxy" May 26 19:30:05.349220 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.349180 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="alertmanager" May 26 19:30:05.349220 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.349188 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="config-reloader" May 26 19:30:05.349220 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.349194 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" containerName="kube-rbac-proxy" May 26 19:30:05.354474 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.354455 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.356866 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.356845 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 26 19:30:05.356985 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.356906 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 26 19:30:05.356985 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.356934 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 26 19:30:05.356985 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.356951 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 26 19:30:05.357247 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.357228 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 26 19:30:05.357247 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.357239 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 26 19:30:05.357396 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.357242 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 26 19:30:05.357396 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.357237 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dx87d\"" May 26 19:30:05.357630 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.357613 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 26 19:30:05.363595 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.363384 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 26 19:30:05.364912 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.364890 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 19:30:05.370754 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.370734 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8dcb7ac5-eda1-4500-8585-0dbca800596a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.370835 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.370763 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8dcb7ac5-eda1-4500-8585-0dbca800596a-config-volume\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.370835 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.370783 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfklr\" (UniqueName: \"kubernetes.io/projected/8dcb7ac5-eda1-4500-8585-0dbca800596a-kube-api-access-jfklr\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.370835 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.370813 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8dcb7ac5-eda1-4500-8585-0dbca800596a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.370932 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.370897 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8dcb7ac5-eda1-4500-8585-0dbca800596a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.370975 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.370938 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8dcb7ac5-eda1-4500-8585-0dbca800596a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.371009 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.370995 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dcb7ac5-eda1-4500-8585-0dbca800596a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.371042 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.371018 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8dcb7ac5-eda1-4500-8585-0dbca800596a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.371076 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.371059 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8dcb7ac5-eda1-4500-8585-0dbca800596a-web-config\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.371109 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.371080 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8dcb7ac5-eda1-4500-8585-0dbca800596a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.371142 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.371117 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8dcb7ac5-eda1-4500-8585-0dbca800596a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.371176 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.371152 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dcb7ac5-eda1-4500-8585-0dbca800596a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.371208 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.371174 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8dcb7ac5-eda1-4500-8585-0dbca800596a-config-out\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.472484 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.472454 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8dcb7ac5-eda1-4500-8585-0dbca800596a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.472627 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.472510 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8dcb7ac5-eda1-4500-8585-0dbca800596a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.472627 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.472540 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dcb7ac5-eda1-4500-8585-0dbca800596a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.472627 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.472567 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8dcb7ac5-eda1-4500-8585-0dbca800596a-config-out\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.472627 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.472593 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8dcb7ac5-eda1-4500-8585-0dbca800596a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.472627 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.472621 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8dcb7ac5-eda1-4500-8585-0dbca800596a-config-volume\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.472838 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.472655 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jfklr\" (UniqueName: \"kubernetes.io/projected/8dcb7ac5-eda1-4500-8585-0dbca800596a-kube-api-access-jfklr\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.472838 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.472707 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8dcb7ac5-eda1-4500-8585-0dbca800596a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.472838 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.472753 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8dcb7ac5-eda1-4500-8585-0dbca800596a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.472838 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.472782 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8dcb7ac5-eda1-4500-8585-0dbca800596a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.472838 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.472819 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dcb7ac5-eda1-4500-8585-0dbca800596a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.473100 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.472848 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8dcb7ac5-eda1-4500-8585-0dbca800596a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.473100 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.472882 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8dcb7ac5-eda1-4500-8585-0dbca800596a-web-config\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.473401 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.473253 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8dcb7ac5-eda1-4500-8585-0dbca800596a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.473708 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.473685 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dcb7ac5-eda1-4500-8585-0dbca800596a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.475760 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.475611 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8dcb7ac5-eda1-4500-8585-0dbca800596a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.475760 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.475614 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8dcb7ac5-eda1-4500-8585-0dbca800596a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.475760 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.475650 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8dcb7ac5-eda1-4500-8585-0dbca800596a-config-out\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.475760 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.475714 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8dcb7ac5-eda1-4500-8585-0dbca800596a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.475980 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.475827 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8dcb7ac5-eda1-4500-8585-0dbca800596a-config-volume\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.475980 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.475825 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8dcb7ac5-eda1-4500-8585-0dbca800596a-web-config\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.476064 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.476018 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8dcb7ac5-eda1-4500-8585-0dbca800596a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.476340 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.476298 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dcb7ac5-eda1-4500-8585-0dbca800596a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.476381 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.476342 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8dcb7ac5-eda1-4500-8585-0dbca800596a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.477475 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.477455 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8dcb7ac5-eda1-4500-8585-0dbca800596a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.479786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.479770 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfklr\" (UniqueName: \"kubernetes.io/projected/8dcb7ac5-eda1-4500-8585-0dbca800596a-kube-api-access-jfklr\") pod \"alertmanager-main-0\" (UID: \"8dcb7ac5-eda1-4500-8585-0dbca800596a\") " pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.665315 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.665276 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 26 19:30:05.791940 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:05.791912 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 19:30:05.793416 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:30:05.793391 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dcb7ac5_eda1_4500_8585_0dbca800596a.slice/crio-78b7eac0f6bba881ce25a32310ddad624a7a075396a5eb124045b5eb640993d3 WatchSource:0}: Error finding container 78b7eac0f6bba881ce25a32310ddad624a7a075396a5eb124045b5eb640993d3: Status 404 returned error can't find the container with id 78b7eac0f6bba881ce25a32310ddad624a7a075396a5eb124045b5eb640993d3 May 26 19:30:06.002353 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:06.002255 2578 generic.go:358] "Generic (PLEG): container finished" podID="8dcb7ac5-eda1-4500-8585-0dbca800596a" containerID="bd22d57cbd1ccce760e2db3dec11ae21e78b3e6cb74a7c33368307e2029cf57c" exitCode=0 May 26 19:30:06.002728 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:06.002352 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8dcb7ac5-eda1-4500-8585-0dbca800596a","Type":"ContainerDied","Data":"bd22d57cbd1ccce760e2db3dec11ae21e78b3e6cb74a7c33368307e2029cf57c"} May 26 19:30:06.002728 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:06.002382 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8dcb7ac5-eda1-4500-8585-0dbca800596a","Type":"ContainerStarted","Data":"78b7eac0f6bba881ce25a32310ddad624a7a075396a5eb124045b5eb640993d3"} May 26 19:30:06.103876 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:06.103849 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb4ea5e7-8ba5-4e11-9b69-934af418e93c" path="/var/lib/kubelet/pods/fb4ea5e7-8ba5-4e11-9b69-934af418e93c/volumes" May 26 19:30:07.009407 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:07.009376 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8dcb7ac5-eda1-4500-8585-0dbca800596a","Type":"ContainerStarted","Data":"166eb2ecc1b0b0d99fc643f2a097970dcf8bfbe9fc511a4e20250a5ffb3cb917"} May 26 19:30:07.009407 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:07.009411 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8dcb7ac5-eda1-4500-8585-0dbca800596a","Type":"ContainerStarted","Data":"f29158738a7055f0ec127f1b06c537c1cb09b0d50dfa309f65447231bc9d4bf1"} May 26 19:30:07.009805 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:07.009421 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8dcb7ac5-eda1-4500-8585-0dbca800596a","Type":"ContainerStarted","Data":"f85a9056b4e492701d3ce365da528e81f6350db217451c6db26004341d626c6f"} May 26 19:30:07.009805 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:07.009431 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8dcb7ac5-eda1-4500-8585-0dbca800596a","Type":"ContainerStarted","Data":"d36830265f3a808c16ed4df7b08bcb1ad61f4d336471c99466ab2847d8c2995f"} May 26 19:30:07.009805 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:07.009439 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8dcb7ac5-eda1-4500-8585-0dbca800596a","Type":"ContainerStarted","Data":"ba513ec8d3c3d837b27bf05afe3600b2b01c4120d930278ec5f385026590fce3"} May 26 19:30:07.009805 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:07.009447 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8dcb7ac5-eda1-4500-8585-0dbca800596a","Type":"ContainerStarted","Data":"c392e9072c51355984d92d76f15021cdb13e9b92716ba3822043e757ff548f2a"} May 26 19:30:07.034703 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:07.034660 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.034645606 podStartE2EDuration="2.034645606s" podCreationTimestamp="2026-05-26 19:30:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:30:07.032958383 +0000 UTC m=+271.566931169" watchObservedRunningTime="2026-05-26 19:30:07.034645606 +0000 UTC m=+271.568618390" May 26 19:30:13.021384 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:13.021350 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:13.021384 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:13.021386 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:13.022675 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:13.022655 2578 patch_prober.go:28] interesting pod/console-797d998cfc-zvdgw container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" start-of-body= May 26 19:30:13.022723 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:13.022696 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-797d998cfc-zvdgw" podUID="6a5944bc-47e9-4886-8238-105b8b9b53ee" containerName="console" probeResult="failure" output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" May 26 19:30:14.916782 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:14.916749 2578 patch_prober.go:28] interesting pod/console-968596b7b-5kd6n container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= May 26 19:30:14.917119 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:14.916795 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-968596b7b-5kd6n" podUID="2f1621de-0454-4795-aafc-c463c5aeaada" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" May 26 19:30:16.564917 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:30:16.564879 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-s6nbq" podUID="508f26c0-895c-41a4-ad07-6119ac41ab6a" May 26 19:30:16.564917 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:30:16.564875 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-d9w79" podUID="3346df9a-a455-49fe-8602-808efc59cadc" May 26 19:30:17.039710 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:17.039682 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d9w79" May 26 19:30:17.039860 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:17.039684 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s6nbq" May 26 19:30:19.696081 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:19.696031 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert\") pod \"ingress-canary-s6nbq\" (UID: \"508f26c0-895c-41a4-ad07-6119ac41ab6a\") " pod="openshift-ingress-canary/ingress-canary-s6nbq" May 26 19:30:19.696081 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:19.696082 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls\") pod \"dns-default-d9w79\" (UID: \"3346df9a-a455-49fe-8602-808efc59cadc\") " pod="openshift-dns/dns-default-d9w79" May 26 19:30:19.698417 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:19.698389 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3346df9a-a455-49fe-8602-808efc59cadc-metrics-tls\") pod \"dns-default-d9w79\" (UID: \"3346df9a-a455-49fe-8602-808efc59cadc\") " pod="openshift-dns/dns-default-d9w79" May 26 19:30:19.698524 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:19.698475 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/508f26c0-895c-41a4-ad07-6119ac41ab6a-cert\") pod \"ingress-canary-s6nbq\" (UID: \"508f26c0-895c-41a4-ad07-6119ac41ab6a\") " pod="openshift-ingress-canary/ingress-canary-s6nbq" May 26 19:30:19.744407 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:19.744377 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jtv8f\"" May 26 19:30:19.744559 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:19.744402 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jhp6d\"" May 26 19:30:19.751566 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:19.751544 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d9w79" May 26 19:30:19.751663 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:19.751567 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s6nbq" May 26 19:30:19.884454 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:19.884405 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d9w79"] May 26 19:30:19.888366 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:30:19.888335 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3346df9a_a455_49fe_8602_808efc59cadc.slice/crio-8a5e83f8206142dcdd4f79f71c6fdaf22dc3d3c005d7ef332d163669f4b0ec73 WatchSource:0}: Error finding container 8a5e83f8206142dcdd4f79f71c6fdaf22dc3d3c005d7ef332d163669f4b0ec73: Status 404 returned error can't find the container with id 8a5e83f8206142dcdd4f79f71c6fdaf22dc3d3c005d7ef332d163669f4b0ec73 May 26 19:30:19.900577 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:19.900555 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s6nbq"] May 26 19:30:19.902564 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:30:19.902540 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod508f26c0_895c_41a4_ad07_6119ac41ab6a.slice/crio-aa818bc2397061721facc77a5a6cbfde750a8eb9582da70a966fa6c6b8f93d70 WatchSource:0}: Error finding container aa818bc2397061721facc77a5a6cbfde750a8eb9582da70a966fa6c6b8f93d70: Status 404 returned error can't find the container with id aa818bc2397061721facc77a5a6cbfde750a8eb9582da70a966fa6c6b8f93d70 May 26 19:30:20.049726 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:20.049640 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d9w79" event={"ID":"3346df9a-a455-49fe-8602-808efc59cadc","Type":"ContainerStarted","Data":"8a5e83f8206142dcdd4f79f71c6fdaf22dc3d3c005d7ef332d163669f4b0ec73"} May 26 19:30:20.050587 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:20.050550 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s6nbq" event={"ID":"508f26c0-895c-41a4-ad07-6119ac41ab6a","Type":"ContainerStarted","Data":"aa818bc2397061721facc77a5a6cbfde750a8eb9582da70a966fa6c6b8f93d70"} May 26 19:30:22.061107 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:22.061016 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s6nbq" event={"ID":"508f26c0-895c-41a4-ad07-6119ac41ab6a","Type":"ContainerStarted","Data":"0888c10b2516fa8686b6044df9ab071fb7418cb4e74063b21cac713b446dea22"} May 26 19:30:22.062553 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:22.062528 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d9w79" event={"ID":"3346df9a-a455-49fe-8602-808efc59cadc","Type":"ContainerStarted","Data":"1bd48582892d3338ae5f3cf5c37b23c0e7388df6a282e2a8b7dd718bcb65922d"} May 26 19:30:22.062637 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:22.062562 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d9w79" event={"ID":"3346df9a-a455-49fe-8602-808efc59cadc","Type":"ContainerStarted","Data":"37fc1e0199e237416e87bc65fdea39b11fc72a126d22630981f7734cd9e457e7"} May 26 19:30:22.062681 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:22.062667 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d9w79" May 26 19:30:22.078415 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:22.078375 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-s6nbq" podStartSLOduration=251.236583491 podStartE2EDuration="4m13.078364426s" podCreationTimestamp="2026-05-26 19:26:09 +0000 UTC" firstStartedPulling="2026-05-26 19:30:19.904243525 +0000 UTC m=+284.438216286" lastFinishedPulling="2026-05-26 19:30:21.746024459 +0000 UTC m=+286.279997221" observedRunningTime="2026-05-26 19:30:22.076829126 +0000 UTC m=+286.610801911" watchObservedRunningTime="2026-05-26 19:30:22.078364426 +0000 UTC m=+286.612337209" May 26 19:30:22.092226 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:22.092180 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-d9w79" podStartSLOduration=251.23853452 podStartE2EDuration="4m13.092166432s" podCreationTimestamp="2026-05-26 19:26:09 +0000 UTC" firstStartedPulling="2026-05-26 19:30:19.890425345 +0000 UTC m=+284.424398122" lastFinishedPulling="2026-05-26 19:30:21.744057272 +0000 UTC m=+286.278030034" observedRunningTime="2026-05-26 19:30:22.091520342 +0000 UTC m=+286.625493126" watchObservedRunningTime="2026-05-26 19:30:22.092166432 +0000 UTC m=+286.626139228" May 26 19:30:23.021766 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:23.021732 2578 patch_prober.go:28] interesting pod/console-797d998cfc-zvdgw container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" start-of-body= May 26 19:30:23.021910 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:23.021779 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-797d998cfc-zvdgw" podUID="6a5944bc-47e9-4886-8238-105b8b9b53ee" containerName="console" probeResult="failure" output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" May 26 19:30:24.916093 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:24.916063 2578 patch_prober.go:28] interesting pod/console-968596b7b-5kd6n container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= May 26 19:30:24.916478 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:24.916111 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-968596b7b-5kd6n" podUID="2f1621de-0454-4795-aafc-c463c5aeaada" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" May 26 19:30:27.696277 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:27.696210 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-567b7686fc-fjlq2" podUID="643a91e9-4863-45ee-bcdc-84a6d6f38fb5" containerName="console" containerID="cri-o://2b84da0f9fd1bf29dc3c9e85b8c69086f7f4f171c6079c31e292e64c7e37453b" gracePeriod=15 May 26 19:30:27.932891 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:27.932866 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-567b7686fc-fjlq2_643a91e9-4863-45ee-bcdc-84a6d6f38fb5/console/0.log" May 26 19:30:27.932998 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:27.932925 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567b7686fc-fjlq2" May 26 19:30:28.072246 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.072151 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4vks\" (UniqueName: \"kubernetes.io/projected/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-kube-api-access-w4vks\") pod \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\" (UID: \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\") " May 26 19:30:28.072246 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.072212 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-console-serving-cert\") pod \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\" (UID: \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\") " May 26 19:30:28.072246 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.072233 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-oauth-serving-cert\") pod \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\" (UID: \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\") " May 26 19:30:28.072246 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.072249 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-console-config\") pod \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\" (UID: \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\") " May 26 19:30:28.072601 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.072267 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-service-ca\") pod \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\" (UID: \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\") " May 26 19:30:28.072601 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.072297 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-console-oauth-config\") pod \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\" (UID: \"643a91e9-4863-45ee-bcdc-84a6d6f38fb5\") " May 26 19:30:28.072730 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.072701 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-console-config" (OuterVolumeSpecName: "console-config") pod "643a91e9-4863-45ee-bcdc-84a6d6f38fb5" (UID: "643a91e9-4863-45ee-bcdc-84a6d6f38fb5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 19:30:28.072730 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.072717 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-service-ca" (OuterVolumeSpecName: "service-ca") pod "643a91e9-4863-45ee-bcdc-84a6d6f38fb5" (UID: "643a91e9-4863-45ee-bcdc-84a6d6f38fb5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 19:30:28.072818 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.072714 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "643a91e9-4863-45ee-bcdc-84a6d6f38fb5" (UID: "643a91e9-4863-45ee-bcdc-84a6d6f38fb5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 19:30:28.074491 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.074462 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "643a91e9-4863-45ee-bcdc-84a6d6f38fb5" (UID: "643a91e9-4863-45ee-bcdc-84a6d6f38fb5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:30:28.074594 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.074571 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-kube-api-access-w4vks" (OuterVolumeSpecName: "kube-api-access-w4vks") pod "643a91e9-4863-45ee-bcdc-84a6d6f38fb5" (UID: "643a91e9-4863-45ee-bcdc-84a6d6f38fb5"). InnerVolumeSpecName "kube-api-access-w4vks". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:30:28.074635 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.074586 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "643a91e9-4863-45ee-bcdc-84a6d6f38fb5" (UID: "643a91e9-4863-45ee-bcdc-84a6d6f38fb5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:30:28.085503 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.085484 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-567b7686fc-fjlq2_643a91e9-4863-45ee-bcdc-84a6d6f38fb5/console/0.log" May 26 19:30:28.085618 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.085524 2578 generic.go:358] "Generic (PLEG): container finished" podID="643a91e9-4863-45ee-bcdc-84a6d6f38fb5" containerID="2b84da0f9fd1bf29dc3c9e85b8c69086f7f4f171c6079c31e292e64c7e37453b" exitCode=2 May 26 19:30:28.085618 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.085565 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567b7686fc-fjlq2" event={"ID":"643a91e9-4863-45ee-bcdc-84a6d6f38fb5","Type":"ContainerDied","Data":"2b84da0f9fd1bf29dc3c9e85b8c69086f7f4f171c6079c31e292e64c7e37453b"} May 26 19:30:28.085618 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.085589 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567b7686fc-fjlq2" May 26 19:30:28.085618 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.085607 2578 scope.go:117] "RemoveContainer" containerID="2b84da0f9fd1bf29dc3c9e85b8c69086f7f4f171c6079c31e292e64c7e37453b" May 26 19:30:28.085797 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.085595 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567b7686fc-fjlq2" event={"ID":"643a91e9-4863-45ee-bcdc-84a6d6f38fb5","Type":"ContainerDied","Data":"7f16ce9ff46fa60953a90067baf02c5811f9a4a05ad8871dbcd2fbfc6ec40e4b"} May 26 19:30:28.093538 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.093517 2578 scope.go:117] "RemoveContainer" containerID="2b84da0f9fd1bf29dc3c9e85b8c69086f7f4f171c6079c31e292e64c7e37453b" May 26 19:30:28.093766 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:30:28.093746 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b84da0f9fd1bf29dc3c9e85b8c69086f7f4f171c6079c31e292e64c7e37453b\": container with ID starting with 2b84da0f9fd1bf29dc3c9e85b8c69086f7f4f171c6079c31e292e64c7e37453b not found: ID does not exist" containerID="2b84da0f9fd1bf29dc3c9e85b8c69086f7f4f171c6079c31e292e64c7e37453b" May 26 19:30:28.093810 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.093773 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b84da0f9fd1bf29dc3c9e85b8c69086f7f4f171c6079c31e292e64c7e37453b"} err="failed to get container status \"2b84da0f9fd1bf29dc3c9e85b8c69086f7f4f171c6079c31e292e64c7e37453b\": rpc error: code = NotFound desc = could not find container \"2b84da0f9fd1bf29dc3c9e85b8c69086f7f4f171c6079c31e292e64c7e37453b\": container with ID starting with 2b84da0f9fd1bf29dc3c9e85b8c69086f7f4f171c6079c31e292e64c7e37453b not found: ID does not exist" May 26 19:30:28.109927 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.109904 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-567b7686fc-fjlq2"] May 26 19:30:28.113453 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.113434 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-567b7686fc-fjlq2"] May 26 19:30:28.173128 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.173105 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4vks\" (UniqueName: \"kubernetes.io/projected/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-kube-api-access-w4vks\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:28.173128 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.173125 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-console-serving-cert\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:28.173263 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.173136 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-oauth-serving-cert\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:28.173263 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.173146 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-console-config\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:28.173263 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.173154 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-service-ca\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:28.173263 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:28.173162 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/643a91e9-4863-45ee-bcdc-84a6d6f38fb5-console-oauth-config\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:30.102971 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:30.102934 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="643a91e9-4863-45ee-bcdc-84a6d6f38fb5" path="/var/lib/kubelet/pods/643a91e9-4863-45ee-bcdc-84a6d6f38fb5/volumes" May 26 19:30:32.069105 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:32.069079 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d9w79" May 26 19:30:33.024856 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:33.024827 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:33.028509 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:33.028485 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:30:33.084917 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:33.084890 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-968596b7b-5kd6n"] May 26 19:30:36.041689 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:36.041668 2578 kubelet.go:1628] "Image garbage collection succeeded" May 26 19:30:58.103876 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:58.103832 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-968596b7b-5kd6n" podUID="2f1621de-0454-4795-aafc-c463c5aeaada" containerName="console" containerID="cri-o://89ea164426c201a8cdff7664851382b798eda0071617f55ec8d51b04b7652f16" gracePeriod=15 May 26 19:30:58.357483 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:58.357433 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-968596b7b-5kd6n_2f1621de-0454-4795-aafc-c463c5aeaada/console/0.log" May 26 19:30:58.357579 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:58.357492 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-968596b7b-5kd6n" May 26 19:30:58.428168 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:58.428146 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f1621de-0454-4795-aafc-c463c5aeaada-console-serving-cert\") pod \"2f1621de-0454-4795-aafc-c463c5aeaada\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " May 26 19:30:58.428356 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:58.428186 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbbgb\" (UniqueName: \"kubernetes.io/projected/2f1621de-0454-4795-aafc-c463c5aeaada-kube-api-access-fbbgb\") pod \"2f1621de-0454-4795-aafc-c463c5aeaada\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " May 26 19:30:58.428356 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:58.428215 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f1621de-0454-4795-aafc-c463c5aeaada-console-oauth-config\") pod \"2f1621de-0454-4795-aafc-c463c5aeaada\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " May 26 19:30:58.428356 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:58.428245 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f1621de-0454-4795-aafc-c463c5aeaada-console-config\") pod \"2f1621de-0454-4795-aafc-c463c5aeaada\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " May 26 19:30:58.428356 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:58.428288 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f1621de-0454-4795-aafc-c463c5aeaada-oauth-serving-cert\") pod \"2f1621de-0454-4795-aafc-c463c5aeaada\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " May 26 19:30:58.428356 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:58.428312 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f1621de-0454-4795-aafc-c463c5aeaada-trusted-ca-bundle\") pod \"2f1621de-0454-4795-aafc-c463c5aeaada\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " May 26 19:30:58.428638 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:58.428363 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1621de-0454-4795-aafc-c463c5aeaada-service-ca\") pod \"2f1621de-0454-4795-aafc-c463c5aeaada\" (UID: \"2f1621de-0454-4795-aafc-c463c5aeaada\") " May 26 19:30:58.428802 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:58.428756 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f1621de-0454-4795-aafc-c463c5aeaada-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2f1621de-0454-4795-aafc-c463c5aeaada" (UID: "2f1621de-0454-4795-aafc-c463c5aeaada"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 19:30:58.428802 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:58.428674 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f1621de-0454-4795-aafc-c463c5aeaada-console-config" (OuterVolumeSpecName: "console-config") pod "2f1621de-0454-4795-aafc-c463c5aeaada" (UID: "2f1621de-0454-4795-aafc-c463c5aeaada"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 19:30:58.428965 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:58.428796 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f1621de-0454-4795-aafc-c463c5aeaada-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2f1621de-0454-4795-aafc-c463c5aeaada" (UID: "2f1621de-0454-4795-aafc-c463c5aeaada"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 19:30:58.428965 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:58.428834 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f1621de-0454-4795-aafc-c463c5aeaada-service-ca" (OuterVolumeSpecName: "service-ca") pod "2f1621de-0454-4795-aafc-c463c5aeaada" (UID: "2f1621de-0454-4795-aafc-c463c5aeaada"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 19:30:58.430270 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:58.430251 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f1621de-0454-4795-aafc-c463c5aeaada-kube-api-access-fbbgb" (OuterVolumeSpecName: "kube-api-access-fbbgb") pod "2f1621de-0454-4795-aafc-c463c5aeaada" (UID: "2f1621de-0454-4795-aafc-c463c5aeaada"). InnerVolumeSpecName "kube-api-access-fbbgb". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:30:58.430717 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:58.430693 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f1621de-0454-4795-aafc-c463c5aeaada-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2f1621de-0454-4795-aafc-c463c5aeaada" (UID: "2f1621de-0454-4795-aafc-c463c5aeaada"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:30:58.430717 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:58.430705 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f1621de-0454-4795-aafc-c463c5aeaada-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2f1621de-0454-4795-aafc-c463c5aeaada" (UID: "2f1621de-0454-4795-aafc-c463c5aeaada"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:30:58.529561 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:58.529525 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f1621de-0454-4795-aafc-c463c5aeaada-console-serving-cert\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:58.529561 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:58.529554 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbbgb\" (UniqueName: \"kubernetes.io/projected/2f1621de-0454-4795-aafc-c463c5aeaada-kube-api-access-fbbgb\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:58.529561 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:58.529566 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f1621de-0454-4795-aafc-c463c5aeaada-console-oauth-config\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:58.529777 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:58.529575 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f1621de-0454-4795-aafc-c463c5aeaada-console-config\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:58.529777 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:58.529585 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f1621de-0454-4795-aafc-c463c5aeaada-oauth-serving-cert\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:58.529777 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:58.529593 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f1621de-0454-4795-aafc-c463c5aeaada-trusted-ca-bundle\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:58.529777 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:58.529602 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1621de-0454-4795-aafc-c463c5aeaada-service-ca\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:30:59.179120 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:59.179097 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-968596b7b-5kd6n_2f1621de-0454-4795-aafc-c463c5aeaada/console/0.log" May 26 19:30:59.179559 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:59.179135 2578 generic.go:358] "Generic (PLEG): container finished" podID="2f1621de-0454-4795-aafc-c463c5aeaada" containerID="89ea164426c201a8cdff7664851382b798eda0071617f55ec8d51b04b7652f16" exitCode=2 May 26 19:30:59.179559 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:59.179166 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-968596b7b-5kd6n" event={"ID":"2f1621de-0454-4795-aafc-c463c5aeaada","Type":"ContainerDied","Data":"89ea164426c201a8cdff7664851382b798eda0071617f55ec8d51b04b7652f16"} May 26 19:30:59.179559 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:59.179192 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-968596b7b-5kd6n" May 26 19:30:59.179559 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:59.179206 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-968596b7b-5kd6n" event={"ID":"2f1621de-0454-4795-aafc-c463c5aeaada","Type":"ContainerDied","Data":"922deababbe3e9a903e50966b16b696054f0f36cd82bd2f39d53c7d4b0253d94"} May 26 19:30:59.179559 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:59.179222 2578 scope.go:117] "RemoveContainer" containerID="89ea164426c201a8cdff7664851382b798eda0071617f55ec8d51b04b7652f16" May 26 19:30:59.187469 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:59.187461 2578 scope.go:117] "RemoveContainer" containerID="89ea164426c201a8cdff7664851382b798eda0071617f55ec8d51b04b7652f16" May 26 19:30:59.187705 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:30:59.187689 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89ea164426c201a8cdff7664851382b798eda0071617f55ec8d51b04b7652f16\": container with ID starting with 89ea164426c201a8cdff7664851382b798eda0071617f55ec8d51b04b7652f16 not found: ID does not exist" containerID="89ea164426c201a8cdff7664851382b798eda0071617f55ec8d51b04b7652f16" May 26 19:30:59.187754 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:59.187712 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89ea164426c201a8cdff7664851382b798eda0071617f55ec8d51b04b7652f16"} err="failed to get container status \"89ea164426c201a8cdff7664851382b798eda0071617f55ec8d51b04b7652f16\": rpc error: code = NotFound desc = could not find container \"89ea164426c201a8cdff7664851382b798eda0071617f55ec8d51b04b7652f16\": container with ID starting with 89ea164426c201a8cdff7664851382b798eda0071617f55ec8d51b04b7652f16 not found: ID does not exist" May 26 19:30:59.200885 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:59.200864 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-968596b7b-5kd6n"] May 26 19:30:59.205441 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:30:59.205421 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-968596b7b-5kd6n"] May 26 19:31:00.103549 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:31:00.103515 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f1621de-0454-4795-aafc-c463c5aeaada" path="/var/lib/kubelet/pods/2f1621de-0454-4795-aafc-c463c5aeaada/volumes" May 26 19:34:08.359837 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.359803 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-754d675fd8-rblrv"] May 26 19:34:08.360287 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.360136 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="643a91e9-4863-45ee-bcdc-84a6d6f38fb5" containerName="console" May 26 19:34:08.360287 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.360152 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="643a91e9-4863-45ee-bcdc-84a6d6f38fb5" containerName="console" May 26 19:34:08.360287 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.360169 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f1621de-0454-4795-aafc-c463c5aeaada" containerName="console" May 26 19:34:08.360287 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.360174 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f1621de-0454-4795-aafc-c463c5aeaada" containerName="console" May 26 19:34:08.360287 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.360233 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="643a91e9-4863-45ee-bcdc-84a6d6f38fb5" containerName="console" May 26 19:34:08.360287 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.360242 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="2f1621de-0454-4795-aafc-c463c5aeaada" containerName="console" May 26 19:34:08.363214 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.363198 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:08.380426 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.380401 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-754d675fd8-rblrv"] May 26 19:34:08.488744 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.488718 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/652d45ca-19b5-404f-af0c-da7d3edcda26-oauth-serving-cert\") pod \"console-754d675fd8-rblrv\" (UID: \"652d45ca-19b5-404f-af0c-da7d3edcda26\") " pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:08.488895 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.488756 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/652d45ca-19b5-404f-af0c-da7d3edcda26-trusted-ca-bundle\") pod \"console-754d675fd8-rblrv\" (UID: \"652d45ca-19b5-404f-af0c-da7d3edcda26\") " pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:08.488895 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.488777 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/652d45ca-19b5-404f-af0c-da7d3edcda26-console-oauth-config\") pod \"console-754d675fd8-rblrv\" (UID: \"652d45ca-19b5-404f-af0c-da7d3edcda26\") " pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:08.488895 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.488793 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/652d45ca-19b5-404f-af0c-da7d3edcda26-console-config\") pod \"console-754d675fd8-rblrv\" (UID: \"652d45ca-19b5-404f-af0c-da7d3edcda26\") " pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:08.488895 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.488808 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/652d45ca-19b5-404f-af0c-da7d3edcda26-service-ca\") pod \"console-754d675fd8-rblrv\" (UID: \"652d45ca-19b5-404f-af0c-da7d3edcda26\") " pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:08.488895 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.488852 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjz5d\" (UniqueName: \"kubernetes.io/projected/652d45ca-19b5-404f-af0c-da7d3edcda26-kube-api-access-tjz5d\") pod \"console-754d675fd8-rblrv\" (UID: \"652d45ca-19b5-404f-af0c-da7d3edcda26\") " pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:08.488895 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.488893 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/652d45ca-19b5-404f-af0c-da7d3edcda26-console-serving-cert\") pod \"console-754d675fd8-rblrv\" (UID: \"652d45ca-19b5-404f-af0c-da7d3edcda26\") " pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:08.589474 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.589442 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/652d45ca-19b5-404f-af0c-da7d3edcda26-console-serving-cert\") pod \"console-754d675fd8-rblrv\" (UID: \"652d45ca-19b5-404f-af0c-da7d3edcda26\") " pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:08.589624 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.589502 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/652d45ca-19b5-404f-af0c-da7d3edcda26-oauth-serving-cert\") pod \"console-754d675fd8-rblrv\" (UID: \"652d45ca-19b5-404f-af0c-da7d3edcda26\") " pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:08.589624 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.589531 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/652d45ca-19b5-404f-af0c-da7d3edcda26-trusted-ca-bundle\") pod \"console-754d675fd8-rblrv\" (UID: \"652d45ca-19b5-404f-af0c-da7d3edcda26\") " pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:08.589624 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.589549 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/652d45ca-19b5-404f-af0c-da7d3edcda26-console-oauth-config\") pod \"console-754d675fd8-rblrv\" (UID: \"652d45ca-19b5-404f-af0c-da7d3edcda26\") " pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:08.589624 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.589563 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/652d45ca-19b5-404f-af0c-da7d3edcda26-console-config\") pod \"console-754d675fd8-rblrv\" (UID: \"652d45ca-19b5-404f-af0c-da7d3edcda26\") " pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:08.589624 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.589578 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/652d45ca-19b5-404f-af0c-da7d3edcda26-service-ca\") pod \"console-754d675fd8-rblrv\" (UID: \"652d45ca-19b5-404f-af0c-da7d3edcda26\") " pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:08.589624 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.589599 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tjz5d\" (UniqueName: \"kubernetes.io/projected/652d45ca-19b5-404f-af0c-da7d3edcda26-kube-api-access-tjz5d\") pod \"console-754d675fd8-rblrv\" (UID: \"652d45ca-19b5-404f-af0c-da7d3edcda26\") " pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:08.590430 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.590400 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/652d45ca-19b5-404f-af0c-da7d3edcda26-oauth-serving-cert\") pod \"console-754d675fd8-rblrv\" (UID: \"652d45ca-19b5-404f-af0c-da7d3edcda26\") " pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:08.590567 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.590430 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/652d45ca-19b5-404f-af0c-da7d3edcda26-service-ca\") pod \"console-754d675fd8-rblrv\" (UID: \"652d45ca-19b5-404f-af0c-da7d3edcda26\") " pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:08.590567 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.590457 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/652d45ca-19b5-404f-af0c-da7d3edcda26-console-config\") pod \"console-754d675fd8-rblrv\" (UID: \"652d45ca-19b5-404f-af0c-da7d3edcda26\") " pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:08.590567 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.590485 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/652d45ca-19b5-404f-af0c-da7d3edcda26-trusted-ca-bundle\") pod \"console-754d675fd8-rblrv\" (UID: \"652d45ca-19b5-404f-af0c-da7d3edcda26\") " pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:08.591860 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.591836 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/652d45ca-19b5-404f-af0c-da7d3edcda26-console-oauth-config\") pod \"console-754d675fd8-rblrv\" (UID: \"652d45ca-19b5-404f-af0c-da7d3edcda26\") " pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:08.591971 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.591952 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/652d45ca-19b5-404f-af0c-da7d3edcda26-console-serving-cert\") pod \"console-754d675fd8-rblrv\" (UID: \"652d45ca-19b5-404f-af0c-da7d3edcda26\") " pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:08.597122 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.597099 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjz5d\" (UniqueName: \"kubernetes.io/projected/652d45ca-19b5-404f-af0c-da7d3edcda26-kube-api-access-tjz5d\") pod \"console-754d675fd8-rblrv\" (UID: \"652d45ca-19b5-404f-af0c-da7d3edcda26\") " pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:08.672944 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.672914 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:08.797203 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.797171 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-754d675fd8-rblrv"] May 26 19:34:08.799361 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:34:08.799311 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod652d45ca_19b5_404f_af0c_da7d3edcda26.slice/crio-c6170b2a9c86b908edbe2a3e369085bb94b69692bec26d420c4188259491f931 WatchSource:0}: Error finding container c6170b2a9c86b908edbe2a3e369085bb94b69692bec26d420c4188259491f931: Status 404 returned error can't find the container with id c6170b2a9c86b908edbe2a3e369085bb94b69692bec26d420c4188259491f931 May 26 19:34:08.801113 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:08.801094 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 19:34:09.729280 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:09.729246 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754d675fd8-rblrv" event={"ID":"652d45ca-19b5-404f-af0c-da7d3edcda26","Type":"ContainerStarted","Data":"1d4eb87d45fc4ce4e0644952203296e5aac374d780260d0a269a074537fbf9dd"} May 26 19:34:09.729280 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:09.729282 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754d675fd8-rblrv" event={"ID":"652d45ca-19b5-404f-af0c-da7d3edcda26","Type":"ContainerStarted","Data":"c6170b2a9c86b908edbe2a3e369085bb94b69692bec26d420c4188259491f931"} May 26 19:34:09.748611 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:09.748566 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-754d675fd8-rblrv" podStartSLOduration=1.748552098 podStartE2EDuration="1.748552098s" podCreationTimestamp="2026-05-26 19:34:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:34:09.746706221 +0000 UTC m=+514.280679004" watchObservedRunningTime="2026-05-26 19:34:09.748552098 +0000 UTC m=+514.282524881" May 26 19:34:18.673364 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:18.673316 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:18.673776 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:18.673375 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:18.678171 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:18.678149 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:18.757820 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:18.757796 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-754d675fd8-rblrv" May 26 19:34:18.801766 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:18.801736 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-797d998cfc-zvdgw"] May 26 19:34:43.821517 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:43.821415 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-797d998cfc-zvdgw" podUID="6a5944bc-47e9-4886-8238-105b8b9b53ee" containerName="console" containerID="cri-o://5cd1def4c2662afd70d0e3e8619f4fcf1f0b1ee7144e50c99c9121f4e01c17e0" gracePeriod=15 May 26 19:34:44.064031 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.064006 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-797d998cfc-zvdgw_6a5944bc-47e9-4886-8238-105b8b9b53ee/console/0.log" May 26 19:34:44.064137 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.064065 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:34:44.185611 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.185582 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a5944bc-47e9-4886-8238-105b8b9b53ee-console-config\") pod \"6a5944bc-47e9-4886-8238-105b8b9b53ee\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " May 26 19:34:44.185772 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.185631 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a5944bc-47e9-4886-8238-105b8b9b53ee-console-oauth-config\") pod \"6a5944bc-47e9-4886-8238-105b8b9b53ee\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " May 26 19:34:44.185772 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.185682 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a5944bc-47e9-4886-8238-105b8b9b53ee-console-serving-cert\") pod \"6a5944bc-47e9-4886-8238-105b8b9b53ee\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " May 26 19:34:44.185772 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.185703 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5944bc-47e9-4886-8238-105b8b9b53ee-trusted-ca-bundle\") pod \"6a5944bc-47e9-4886-8238-105b8b9b53ee\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " May 26 19:34:44.185772 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.185726 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a5944bc-47e9-4886-8238-105b8b9b53ee-oauth-serving-cert\") pod \"6a5944bc-47e9-4886-8238-105b8b9b53ee\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " May 26 19:34:44.185772 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.185766 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a5944bc-47e9-4886-8238-105b8b9b53ee-service-ca\") pod \"6a5944bc-47e9-4886-8238-105b8b9b53ee\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " May 26 19:34:44.186042 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.185817 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z48wh\" (UniqueName: \"kubernetes.io/projected/6a5944bc-47e9-4886-8238-105b8b9b53ee-kube-api-access-z48wh\") pod \"6a5944bc-47e9-4886-8238-105b8b9b53ee\" (UID: \"6a5944bc-47e9-4886-8238-105b8b9b53ee\") " May 26 19:34:44.186101 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.186066 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a5944bc-47e9-4886-8238-105b8b9b53ee-console-config" (OuterVolumeSpecName: "console-config") pod "6a5944bc-47e9-4886-8238-105b8b9b53ee" (UID: "6a5944bc-47e9-4886-8238-105b8b9b53ee"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 19:34:44.186160 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.186120 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a5944bc-47e9-4886-8238-105b8b9b53ee-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6a5944bc-47e9-4886-8238-105b8b9b53ee" (UID: "6a5944bc-47e9-4886-8238-105b8b9b53ee"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 19:34:44.186208 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.186153 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a5944bc-47e9-4886-8238-105b8b9b53ee-service-ca" (OuterVolumeSpecName: "service-ca") pod "6a5944bc-47e9-4886-8238-105b8b9b53ee" (UID: "6a5944bc-47e9-4886-8238-105b8b9b53ee"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 19:34:44.186208 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.186168 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a5944bc-47e9-4886-8238-105b8b9b53ee-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6a5944bc-47e9-4886-8238-105b8b9b53ee" (UID: "6a5944bc-47e9-4886-8238-105b8b9b53ee"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 19:34:44.187849 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.187822 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a5944bc-47e9-4886-8238-105b8b9b53ee-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6a5944bc-47e9-4886-8238-105b8b9b53ee" (UID: "6a5944bc-47e9-4886-8238-105b8b9b53ee"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:34:44.187942 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.187855 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a5944bc-47e9-4886-8238-105b8b9b53ee-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6a5944bc-47e9-4886-8238-105b8b9b53ee" (UID: "6a5944bc-47e9-4886-8238-105b8b9b53ee"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:34:44.187942 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.187907 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a5944bc-47e9-4886-8238-105b8b9b53ee-kube-api-access-z48wh" (OuterVolumeSpecName: "kube-api-access-z48wh") pod "6a5944bc-47e9-4886-8238-105b8b9b53ee" (UID: "6a5944bc-47e9-4886-8238-105b8b9b53ee"). InnerVolumeSpecName "kube-api-access-z48wh". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:34:44.287030 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.287002 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a5944bc-47e9-4886-8238-105b8b9b53ee-service-ca\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:34:44.287030 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.287027 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z48wh\" (UniqueName: \"kubernetes.io/projected/6a5944bc-47e9-4886-8238-105b8b9b53ee-kube-api-access-z48wh\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:34:44.287201 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.287038 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a5944bc-47e9-4886-8238-105b8b9b53ee-console-config\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:34:44.287201 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.287053 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a5944bc-47e9-4886-8238-105b8b9b53ee-console-oauth-config\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:34:44.287201 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.287062 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a5944bc-47e9-4886-8238-105b8b9b53ee-console-serving-cert\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:34:44.287201 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.287071 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5944bc-47e9-4886-8238-105b8b9b53ee-trusted-ca-bundle\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:34:44.287201 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.287079 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a5944bc-47e9-4886-8238-105b8b9b53ee-oauth-serving-cert\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:34:44.835764 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.835738 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-797d998cfc-zvdgw_6a5944bc-47e9-4886-8238-105b8b9b53ee/console/0.log" May 26 19:34:44.836212 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.835777 2578 generic.go:358] "Generic (PLEG): container finished" podID="6a5944bc-47e9-4886-8238-105b8b9b53ee" containerID="5cd1def4c2662afd70d0e3e8619f4fcf1f0b1ee7144e50c99c9121f4e01c17e0" exitCode=2 May 26 19:34:44.836212 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.835812 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797d998cfc-zvdgw" event={"ID":"6a5944bc-47e9-4886-8238-105b8b9b53ee","Type":"ContainerDied","Data":"5cd1def4c2662afd70d0e3e8619f4fcf1f0b1ee7144e50c99c9121f4e01c17e0"} May 26 19:34:44.836212 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.835836 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797d998cfc-zvdgw" May 26 19:34:44.836212 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.835864 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797d998cfc-zvdgw" event={"ID":"6a5944bc-47e9-4886-8238-105b8b9b53ee","Type":"ContainerDied","Data":"9ff3ddf5f8368b38a2e7ffc297a993b3cf14d86c919cfbb15174e690524e3944"} May 26 19:34:44.836212 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.835885 2578 scope.go:117] "RemoveContainer" containerID="5cd1def4c2662afd70d0e3e8619f4fcf1f0b1ee7144e50c99c9121f4e01c17e0" May 26 19:34:44.844099 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.844081 2578 scope.go:117] "RemoveContainer" containerID="5cd1def4c2662afd70d0e3e8619f4fcf1f0b1ee7144e50c99c9121f4e01c17e0" May 26 19:34:44.844334 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:34:44.844307 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cd1def4c2662afd70d0e3e8619f4fcf1f0b1ee7144e50c99c9121f4e01c17e0\": container with ID starting with 5cd1def4c2662afd70d0e3e8619f4fcf1f0b1ee7144e50c99c9121f4e01c17e0 not found: ID does not exist" containerID="5cd1def4c2662afd70d0e3e8619f4fcf1f0b1ee7144e50c99c9121f4e01c17e0" May 26 19:34:44.844390 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.844346 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cd1def4c2662afd70d0e3e8619f4fcf1f0b1ee7144e50c99c9121f4e01c17e0"} err="failed to get container status \"5cd1def4c2662afd70d0e3e8619f4fcf1f0b1ee7144e50c99c9121f4e01c17e0\": rpc error: code = NotFound desc = could not find container \"5cd1def4c2662afd70d0e3e8619f4fcf1f0b1ee7144e50c99c9121f4e01c17e0\": container with ID starting with 5cd1def4c2662afd70d0e3e8619f4fcf1f0b1ee7144e50c99c9121f4e01c17e0 not found: ID does not exist" May 26 19:34:44.855637 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.855617 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-797d998cfc-zvdgw"] May 26 19:34:44.859004 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:44.858984 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-797d998cfc-zvdgw"] May 26 19:34:46.104176 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:34:46.104142 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a5944bc-47e9-4886-8238-105b8b9b53ee" path="/var/lib/kubelet/pods/6a5944bc-47e9-4886-8238-105b8b9b53ee/volumes" May 26 19:35:45.973339 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:45.973291 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx"] May 26 19:35:45.973742 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:45.973628 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a5944bc-47e9-4886-8238-105b8b9b53ee" containerName="console" May 26 19:35:45.973742 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:45.973639 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a5944bc-47e9-4886-8238-105b8b9b53ee" containerName="console" May 26 19:35:45.973742 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:45.973702 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="6a5944bc-47e9-4886-8238-105b8b9b53ee" containerName="console" May 26 19:35:45.976909 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:45.976892 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx" May 26 19:35:45.979848 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:45.979820 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ps5z8\"" May 26 19:35:45.979956 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:45.979847 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 26 19:35:45.980667 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:45.980653 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 26 19:35:45.985053 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:45.985028 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx"] May 26 19:35:46.077597 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:46.077547 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a8a8fb4-a953-415c-aee8-b148d2d5697f-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx\" (UID: \"3a8a8fb4-a953-415c-aee8-b148d2d5697f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx" May 26 19:35:46.077597 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:46.077599 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4d9n\" (UniqueName: \"kubernetes.io/projected/3a8a8fb4-a953-415c-aee8-b148d2d5697f-kube-api-access-p4d9n\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx\" (UID: \"3a8a8fb4-a953-415c-aee8-b148d2d5697f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx" May 26 19:35:46.077799 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:46.077695 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a8a8fb4-a953-415c-aee8-b148d2d5697f-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx\" (UID: \"3a8a8fb4-a953-415c-aee8-b148d2d5697f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx" May 26 19:35:46.178056 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:46.178021 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a8a8fb4-a953-415c-aee8-b148d2d5697f-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx\" (UID: \"3a8a8fb4-a953-415c-aee8-b148d2d5697f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx" May 26 19:35:46.178056 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:46.178056 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p4d9n\" (UniqueName: \"kubernetes.io/projected/3a8a8fb4-a953-415c-aee8-b148d2d5697f-kube-api-access-p4d9n\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx\" (UID: \"3a8a8fb4-a953-415c-aee8-b148d2d5697f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx" May 26 19:35:46.178252 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:46.178113 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a8a8fb4-a953-415c-aee8-b148d2d5697f-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx\" (UID: \"3a8a8fb4-a953-415c-aee8-b148d2d5697f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx" May 26 19:35:46.178478 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:46.178459 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a8a8fb4-a953-415c-aee8-b148d2d5697f-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx\" (UID: \"3a8a8fb4-a953-415c-aee8-b148d2d5697f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx" May 26 19:35:46.178551 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:46.178505 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a8a8fb4-a953-415c-aee8-b148d2d5697f-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx\" (UID: \"3a8a8fb4-a953-415c-aee8-b148d2d5697f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx" May 26 19:35:46.186223 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:46.186203 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4d9n\" (UniqueName: \"kubernetes.io/projected/3a8a8fb4-a953-415c-aee8-b148d2d5697f-kube-api-access-p4d9n\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx\" (UID: \"3a8a8fb4-a953-415c-aee8-b148d2d5697f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx" May 26 19:35:46.287459 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:46.287367 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx" May 26 19:35:46.409214 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:46.409189 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx"] May 26 19:35:46.411074 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:35:46.411044 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a8a8fb4_a953_415c_aee8_b148d2d5697f.slice/crio-636a92cf9f917622ba4e33b48691d3e4a09e39256d9416216285c9183646892e WatchSource:0}: Error finding container 636a92cf9f917622ba4e33b48691d3e4a09e39256d9416216285c9183646892e: Status 404 returned error can't find the container with id 636a92cf9f917622ba4e33b48691d3e4a09e39256d9416216285c9183646892e May 26 19:35:47.026070 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:47.026033 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx" event={"ID":"3a8a8fb4-a953-415c-aee8-b148d2d5697f","Type":"ContainerStarted","Data":"636a92cf9f917622ba4e33b48691d3e4a09e39256d9416216285c9183646892e"} May 26 19:35:53.051914 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:53.051878 2578 generic.go:358] "Generic (PLEG): container finished" podID="3a8a8fb4-a953-415c-aee8-b148d2d5697f" containerID="8939df9d8359d3d7c1b3a28ae0667f0a82428ba89cf03dedaae3667f7e367421" exitCode=0 May 26 19:35:53.052363 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:53.051931 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx" event={"ID":"3a8a8fb4-a953-415c-aee8-b148d2d5697f","Type":"ContainerDied","Data":"8939df9d8359d3d7c1b3a28ae0667f0a82428ba89cf03dedaae3667f7e367421"} May 26 19:35:55.062239 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:55.062201 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx" event={"ID":"3a8a8fb4-a953-415c-aee8-b148d2d5697f","Type":"ContainerStarted","Data":"be1d9e0485ec803e04780e947f54313b8c2e65e6a18d9f64072c6d02ff6cb10e"} May 26 19:35:56.067152 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:56.067114 2578 generic.go:358] "Generic (PLEG): container finished" podID="3a8a8fb4-a953-415c-aee8-b148d2d5697f" containerID="be1d9e0485ec803e04780e947f54313b8c2e65e6a18d9f64072c6d02ff6cb10e" exitCode=0 May 26 19:35:56.067152 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:35:56.067149 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx" event={"ID":"3a8a8fb4-a953-415c-aee8-b148d2d5697f","Type":"ContainerDied","Data":"be1d9e0485ec803e04780e947f54313b8c2e65e6a18d9f64072c6d02ff6cb10e"} May 26 19:36:02.088382 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:02.088274 2578 generic.go:358] "Generic (PLEG): container finished" podID="3a8a8fb4-a953-415c-aee8-b148d2d5697f" containerID="615961e83c22db552ad85d2ecfa99bb5f304e7923d8778a5e760418cf1141dc2" exitCode=0 May 26 19:36:02.088382 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:02.088371 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx" event={"ID":"3a8a8fb4-a953-415c-aee8-b148d2d5697f","Type":"ContainerDied","Data":"615961e83c22db552ad85d2ecfa99bb5f304e7923d8778a5e760418cf1141dc2"} May 26 19:36:03.218411 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:03.218389 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx" May 26 19:36:03.231264 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:03.231242 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a8a8fb4-a953-415c-aee8-b148d2d5697f-bundle\") pod \"3a8a8fb4-a953-415c-aee8-b148d2d5697f\" (UID: \"3a8a8fb4-a953-415c-aee8-b148d2d5697f\") " May 26 19:36:03.231408 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:03.231276 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4d9n\" (UniqueName: \"kubernetes.io/projected/3a8a8fb4-a953-415c-aee8-b148d2d5697f-kube-api-access-p4d9n\") pod \"3a8a8fb4-a953-415c-aee8-b148d2d5697f\" (UID: \"3a8a8fb4-a953-415c-aee8-b148d2d5697f\") " May 26 19:36:03.231408 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:03.231354 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a8a8fb4-a953-415c-aee8-b148d2d5697f-util\") pod \"3a8a8fb4-a953-415c-aee8-b148d2d5697f\" (UID: \"3a8a8fb4-a953-415c-aee8-b148d2d5697f\") " May 26 19:36:03.231941 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:03.231919 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a8a8fb4-a953-415c-aee8-b148d2d5697f-bundle" (OuterVolumeSpecName: "bundle") pod "3a8a8fb4-a953-415c-aee8-b148d2d5697f" (UID: "3a8a8fb4-a953-415c-aee8-b148d2d5697f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:36:03.233303 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:03.233280 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a8a8fb4-a953-415c-aee8-b148d2d5697f-kube-api-access-p4d9n" (OuterVolumeSpecName: "kube-api-access-p4d9n") pod "3a8a8fb4-a953-415c-aee8-b148d2d5697f" (UID: "3a8a8fb4-a953-415c-aee8-b148d2d5697f"). InnerVolumeSpecName "kube-api-access-p4d9n". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:36:03.236265 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:03.236239 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a8a8fb4-a953-415c-aee8-b148d2d5697f-util" (OuterVolumeSpecName: "util") pod "3a8a8fb4-a953-415c-aee8-b148d2d5697f" (UID: "3a8a8fb4-a953-415c-aee8-b148d2d5697f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:36:03.332442 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:03.332414 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a8a8fb4-a953-415c-aee8-b148d2d5697f-bundle\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:36:03.332442 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:03.332441 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4d9n\" (UniqueName: \"kubernetes.io/projected/3a8a8fb4-a953-415c-aee8-b148d2d5697f-kube-api-access-p4d9n\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:36:03.332634 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:03.332451 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a8a8fb4-a953-415c-aee8-b148d2d5697f-util\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:36:04.098881 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:04.098856 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx" May 26 19:36:04.102307 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:04.102282 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbr4gx" event={"ID":"3a8a8fb4-a953-415c-aee8-b148d2d5697f","Type":"ContainerDied","Data":"636a92cf9f917622ba4e33b48691d3e4a09e39256d9416216285c9183646892e"} May 26 19:36:04.102307 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:04.102309 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="636a92cf9f917622ba4e33b48691d3e4a09e39256d9416216285c9183646892e" May 26 19:36:08.881303 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:08.881269 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qd7lw"] May 26 19:36:08.881666 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:08.881605 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a8a8fb4-a953-415c-aee8-b148d2d5697f" containerName="util" May 26 19:36:08.881666 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:08.881616 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a8a8fb4-a953-415c-aee8-b148d2d5697f" containerName="util" May 26 19:36:08.881666 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:08.881624 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a8a8fb4-a953-415c-aee8-b148d2d5697f" containerName="extract" May 26 19:36:08.881666 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:08.881630 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a8a8fb4-a953-415c-aee8-b148d2d5697f" containerName="extract" May 26 19:36:08.881666 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:08.881642 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a8a8fb4-a953-415c-aee8-b148d2d5697f" containerName="pull" May 26 19:36:08.881666 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:08.881647 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a8a8fb4-a953-415c-aee8-b148d2d5697f" containerName="pull" May 26 19:36:08.881916 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:08.881699 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a8a8fb4-a953-415c-aee8-b148d2d5697f" containerName="extract" May 26 19:36:08.885591 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:08.885571 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qd7lw" May 26 19:36:08.888405 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:08.888381 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-rpgkk\"" May 26 19:36:08.888668 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:08.888649 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 26 19:36:08.888768 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:08.888715 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 26 19:36:08.899283 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:08.899257 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qd7lw"] May 26 19:36:08.979147 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:08.979112 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4015f841-7ef3-4769-abc2-d591ae51847d-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-qd7lw\" (UID: \"4015f841-7ef3-4769-abc2-d591ae51847d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qd7lw" May 26 19:36:08.979311 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:08.979176 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phppl\" (UniqueName: \"kubernetes.io/projected/4015f841-7ef3-4769-abc2-d591ae51847d-kube-api-access-phppl\") pod \"cert-manager-operator-controller-manager-54b9655956-qd7lw\" (UID: \"4015f841-7ef3-4769-abc2-d591ae51847d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qd7lw" May 26 19:36:09.080633 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:09.080587 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-phppl\" (UniqueName: \"kubernetes.io/projected/4015f841-7ef3-4769-abc2-d591ae51847d-kube-api-access-phppl\") pod \"cert-manager-operator-controller-manager-54b9655956-qd7lw\" (UID: \"4015f841-7ef3-4769-abc2-d591ae51847d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qd7lw" May 26 19:36:09.080769 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:09.080664 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4015f841-7ef3-4769-abc2-d591ae51847d-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-qd7lw\" (UID: \"4015f841-7ef3-4769-abc2-d591ae51847d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qd7lw" May 26 19:36:09.080976 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:09.080962 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4015f841-7ef3-4769-abc2-d591ae51847d-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-qd7lw\" (UID: \"4015f841-7ef3-4769-abc2-d591ae51847d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qd7lw" May 26 19:36:09.088850 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:09.088827 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phppl\" (UniqueName: \"kubernetes.io/projected/4015f841-7ef3-4769-abc2-d591ae51847d-kube-api-access-phppl\") pod \"cert-manager-operator-controller-manager-54b9655956-qd7lw\" (UID: \"4015f841-7ef3-4769-abc2-d591ae51847d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qd7lw" May 26 19:36:09.194810 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:09.194783 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qd7lw" May 26 19:36:09.323628 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:09.323597 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qd7lw"] May 26 19:36:09.327228 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:36:09.327201 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4015f841_7ef3_4769_abc2_d591ae51847d.slice/crio-7df9f80e694e0074585d4f4d312fa69cc9788723461dfd6f8799663d5e763b35 WatchSource:0}: Error finding container 7df9f80e694e0074585d4f4d312fa69cc9788723461dfd6f8799663d5e763b35: Status 404 returned error can't find the container with id 7df9f80e694e0074585d4f4d312fa69cc9788723461dfd6f8799663d5e763b35 May 26 19:36:10.116090 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:10.116057 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qd7lw" event={"ID":"4015f841-7ef3-4769-abc2-d591ae51847d","Type":"ContainerStarted","Data":"7df9f80e694e0074585d4f4d312fa69cc9788723461dfd6f8799663d5e763b35"} May 26 19:36:13.128223 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:13.128184 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qd7lw" event={"ID":"4015f841-7ef3-4769-abc2-d591ae51847d","Type":"ContainerStarted","Data":"a12567a6e5866eb2309eca7dc9e1e3fd544ab51eef45d8dec3a5c7ad710620c7"} May 26 19:36:13.153524 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:13.153467 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qd7lw" podStartSLOduration=1.459615362 podStartE2EDuration="5.15345316s" podCreationTimestamp="2026-05-26 19:36:08 +0000 UTC" firstStartedPulling="2026-05-26 19:36:09.329839017 +0000 UTC m=+633.863811778" lastFinishedPulling="2026-05-26 19:36:13.02367681 +0000 UTC m=+637.557649576" observedRunningTime="2026-05-26 19:36:13.151595778 +0000 UTC m=+637.685568561" watchObservedRunningTime="2026-05-26 19:36:13.15345316 +0000 UTC m=+637.687425945" May 26 19:36:13.762728 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:13.762699 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj"] May 26 19:36:13.766198 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:13.766178 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj" May 26 19:36:13.768842 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:13.768816 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ps5z8\"" May 26 19:36:13.769033 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:13.769014 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 26 19:36:13.769894 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:13.769878 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 26 19:36:13.776371 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:13.776349 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj"] May 26 19:36:13.822853 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:13.822814 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wkx5\" (UniqueName: \"kubernetes.io/projected/68b0004a-1ee3-4f79-9628-e6b0264f30f0-kube-api-access-7wkx5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj\" (UID: \"68b0004a-1ee3-4f79-9628-e6b0264f30f0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj" May 26 19:36:13.823036 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:13.822861 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68b0004a-1ee3-4f79-9628-e6b0264f30f0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj\" (UID: \"68b0004a-1ee3-4f79-9628-e6b0264f30f0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj" May 26 19:36:13.823036 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:13.822963 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68b0004a-1ee3-4f79-9628-e6b0264f30f0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj\" (UID: \"68b0004a-1ee3-4f79-9628-e6b0264f30f0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj" May 26 19:36:13.924156 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:13.924114 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7wkx5\" (UniqueName: \"kubernetes.io/projected/68b0004a-1ee3-4f79-9628-e6b0264f30f0-kube-api-access-7wkx5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj\" (UID: \"68b0004a-1ee3-4f79-9628-e6b0264f30f0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj" May 26 19:36:13.924381 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:13.924167 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68b0004a-1ee3-4f79-9628-e6b0264f30f0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj\" (UID: \"68b0004a-1ee3-4f79-9628-e6b0264f30f0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj" May 26 19:36:13.924381 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:13.924225 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68b0004a-1ee3-4f79-9628-e6b0264f30f0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj\" (UID: \"68b0004a-1ee3-4f79-9628-e6b0264f30f0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj" May 26 19:36:13.924634 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:13.924612 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68b0004a-1ee3-4f79-9628-e6b0264f30f0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj\" (UID: \"68b0004a-1ee3-4f79-9628-e6b0264f30f0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj" May 26 19:36:13.924712 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:13.924652 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68b0004a-1ee3-4f79-9628-e6b0264f30f0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj\" (UID: \"68b0004a-1ee3-4f79-9628-e6b0264f30f0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj" May 26 19:36:13.938292 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:13.938268 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wkx5\" (UniqueName: \"kubernetes.io/projected/68b0004a-1ee3-4f79-9628-e6b0264f30f0-kube-api-access-7wkx5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj\" (UID: \"68b0004a-1ee3-4f79-9628-e6b0264f30f0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj" May 26 19:36:14.075819 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:14.075742 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj" May 26 19:36:14.200777 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:14.200744 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj"] May 26 19:36:14.203977 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:36:14.203954 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68b0004a_1ee3_4f79_9628_e6b0264f30f0.slice/crio-8bc595e8746d6b86f08c650cdeeb143e4b2978f6ae84234e6392d1957db79c78 WatchSource:0}: Error finding container 8bc595e8746d6b86f08c650cdeeb143e4b2978f6ae84234e6392d1957db79c78: Status 404 returned error can't find the container with id 8bc595e8746d6b86f08c650cdeeb143e4b2978f6ae84234e6392d1957db79c78 May 26 19:36:15.136027 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:15.135988 2578 generic.go:358] "Generic (PLEG): container finished" podID="68b0004a-1ee3-4f79-9628-e6b0264f30f0" containerID="ae74a522c38ac27237aead6a2767fbba90226cb69695b3ba589de65a3cc6ceec" exitCode=0 May 26 19:36:15.136257 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:15.136072 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj" event={"ID":"68b0004a-1ee3-4f79-9628-e6b0264f30f0","Type":"ContainerDied","Data":"ae74a522c38ac27237aead6a2767fbba90226cb69695b3ba589de65a3cc6ceec"} May 26 19:36:15.136257 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:15.136109 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj" event={"ID":"68b0004a-1ee3-4f79-9628-e6b0264f30f0","Type":"ContainerStarted","Data":"8bc595e8746d6b86f08c650cdeeb143e4b2978f6ae84234e6392d1957db79c78"} May 26 19:36:17.498891 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:17.498852 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-jpwc5"] May 26 19:36:17.505439 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:17.505408 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-jpwc5" May 26 19:36:17.508719 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:17.508632 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 26 19:36:17.510534 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:17.510113 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 26 19:36:17.510534 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:17.510233 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-prr5z\"" May 26 19:36:17.512501 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:17.512476 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-jpwc5"] May 26 19:36:17.557768 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:17.557739 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71a4beed-5ec9-4883-9540-a4104472b888-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-jpwc5\" (UID: \"71a4beed-5ec9-4883-9540-a4104472b888\") " pod="cert-manager/cert-manager-cainjector-68b757865b-jpwc5" May 26 19:36:17.557949 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:17.557837 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxtln\" (UniqueName: \"kubernetes.io/projected/71a4beed-5ec9-4883-9540-a4104472b888-kube-api-access-jxtln\") pod \"cert-manager-cainjector-68b757865b-jpwc5\" (UID: \"71a4beed-5ec9-4883-9540-a4104472b888\") " pod="cert-manager/cert-manager-cainjector-68b757865b-jpwc5" May 26 19:36:17.658988 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:17.658942 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71a4beed-5ec9-4883-9540-a4104472b888-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-jpwc5\" (UID: \"71a4beed-5ec9-4883-9540-a4104472b888\") " pod="cert-manager/cert-manager-cainjector-68b757865b-jpwc5" May 26 19:36:17.659158 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:17.659021 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxtln\" (UniqueName: \"kubernetes.io/projected/71a4beed-5ec9-4883-9540-a4104472b888-kube-api-access-jxtln\") pod \"cert-manager-cainjector-68b757865b-jpwc5\" (UID: \"71a4beed-5ec9-4883-9540-a4104472b888\") " pod="cert-manager/cert-manager-cainjector-68b757865b-jpwc5" May 26 19:36:17.667424 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:17.667379 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71a4beed-5ec9-4883-9540-a4104472b888-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-jpwc5\" (UID: \"71a4beed-5ec9-4883-9540-a4104472b888\") " pod="cert-manager/cert-manager-cainjector-68b757865b-jpwc5" May 26 19:36:17.667564 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:17.667535 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxtln\" (UniqueName: \"kubernetes.io/projected/71a4beed-5ec9-4883-9540-a4104472b888-kube-api-access-jxtln\") pod \"cert-manager-cainjector-68b757865b-jpwc5\" (UID: \"71a4beed-5ec9-4883-9540-a4104472b888\") " pod="cert-manager/cert-manager-cainjector-68b757865b-jpwc5" May 26 19:36:17.829391 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:17.829303 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-jpwc5" May 26 19:36:17.931902 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:17.931868 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-fjvc4"] May 26 19:36:17.940477 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:17.940449 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-fjvc4" May 26 19:36:17.944594 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:17.943990 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-cldgk\"" May 26 19:36:17.944748 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:17.944720 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-fjvc4"] May 26 19:36:18.062379 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:18.062345 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/186e5a63-0d50-4434-afa7-fdbfbe76c51d-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-fjvc4\" (UID: \"186e5a63-0d50-4434-afa7-fdbfbe76c51d\") " pod="cert-manager/cert-manager-webhook-587ccfb98-fjvc4" May 26 19:36:18.062557 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:18.062392 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psljf\" (UniqueName: \"kubernetes.io/projected/186e5a63-0d50-4434-afa7-fdbfbe76c51d-kube-api-access-psljf\") pod \"cert-manager-webhook-587ccfb98-fjvc4\" (UID: \"186e5a63-0d50-4434-afa7-fdbfbe76c51d\") " pod="cert-manager/cert-manager-webhook-587ccfb98-fjvc4" May 26 19:36:18.163443 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:18.163408 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/186e5a63-0d50-4434-afa7-fdbfbe76c51d-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-fjvc4\" (UID: \"186e5a63-0d50-4434-afa7-fdbfbe76c51d\") " pod="cert-manager/cert-manager-webhook-587ccfb98-fjvc4" May 26 19:36:18.163596 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:18.163496 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-psljf\" (UniqueName: \"kubernetes.io/projected/186e5a63-0d50-4434-afa7-fdbfbe76c51d-kube-api-access-psljf\") pod \"cert-manager-webhook-587ccfb98-fjvc4\" (UID: \"186e5a63-0d50-4434-afa7-fdbfbe76c51d\") " pod="cert-manager/cert-manager-webhook-587ccfb98-fjvc4" May 26 19:36:18.172877 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:18.172849 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psljf\" (UniqueName: \"kubernetes.io/projected/186e5a63-0d50-4434-afa7-fdbfbe76c51d-kube-api-access-psljf\") pod \"cert-manager-webhook-587ccfb98-fjvc4\" (UID: \"186e5a63-0d50-4434-afa7-fdbfbe76c51d\") " pod="cert-manager/cert-manager-webhook-587ccfb98-fjvc4" May 26 19:36:18.173274 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:18.173252 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/186e5a63-0d50-4434-afa7-fdbfbe76c51d-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-fjvc4\" (UID: \"186e5a63-0d50-4434-afa7-fdbfbe76c51d\") " pod="cert-manager/cert-manager-webhook-587ccfb98-fjvc4" May 26 19:36:18.256723 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:18.256692 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-fjvc4" May 26 19:36:18.272186 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:18.272116 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-jpwc5"] May 26 19:36:18.274591 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:36:18.274561 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71a4beed_5ec9_4883_9540_a4104472b888.slice/crio-fb13c3a9fa55c259dd58c6595e5f591d6d0e129139163c86d5a03014eca519d6 WatchSource:0}: Error finding container fb13c3a9fa55c259dd58c6595e5f591d6d0e129139163c86d5a03014eca519d6: Status 404 returned error can't find the container with id fb13c3a9fa55c259dd58c6595e5f591d6d0e129139163c86d5a03014eca519d6 May 26 19:36:18.387376 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:18.387348 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-fjvc4"] May 26 19:36:18.389711 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:36:18.389678 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod186e5a63_0d50_4434_afa7_fdbfbe76c51d.slice/crio-da7e686a0e624b08c4cb6d52f46b057d1eb751e1413f6b6972602727cdf582a9 WatchSource:0}: Error finding container da7e686a0e624b08c4cb6d52f46b057d1eb751e1413f6b6972602727cdf582a9: Status 404 returned error can't find the container with id da7e686a0e624b08c4cb6d52f46b057d1eb751e1413f6b6972602727cdf582a9 May 26 19:36:19.151233 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:19.151197 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-jpwc5" event={"ID":"71a4beed-5ec9-4883-9540-a4104472b888","Type":"ContainerStarted","Data":"fb13c3a9fa55c259dd58c6595e5f591d6d0e129139163c86d5a03014eca519d6"} May 26 19:36:19.152237 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:19.152211 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-fjvc4" event={"ID":"186e5a63-0d50-4434-afa7-fdbfbe76c51d","Type":"ContainerStarted","Data":"da7e686a0e624b08c4cb6d52f46b057d1eb751e1413f6b6972602727cdf582a9"} May 26 19:36:19.153690 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:19.153669 2578 generic.go:358] "Generic (PLEG): container finished" podID="68b0004a-1ee3-4f79-9628-e6b0264f30f0" containerID="dc8e0049fa7d7bef3021ab757a54125890f8197f6b92523c797b8c77670c0fa1" exitCode=0 May 26 19:36:19.153770 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:19.153713 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj" event={"ID":"68b0004a-1ee3-4f79-9628-e6b0264f30f0","Type":"ContainerDied","Data":"dc8e0049fa7d7bef3021ab757a54125890f8197f6b92523c797b8c77670c0fa1"} May 26 19:36:20.159142 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:20.159102 2578 generic.go:358] "Generic (PLEG): container finished" podID="68b0004a-1ee3-4f79-9628-e6b0264f30f0" containerID="d01bb270be90abcd1002167e702305267f5df83e39f5ac1b40ce96f7ec0cbd0f" exitCode=0 May 26 19:36:20.159531 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:20.159181 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj" event={"ID":"68b0004a-1ee3-4f79-9628-e6b0264f30f0","Type":"ContainerDied","Data":"d01bb270be90abcd1002167e702305267f5df83e39f5ac1b40ce96f7ec0cbd0f"} May 26 19:36:21.288823 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:21.288802 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj" May 26 19:36:21.397805 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:21.397771 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68b0004a-1ee3-4f79-9628-e6b0264f30f0-bundle\") pod \"68b0004a-1ee3-4f79-9628-e6b0264f30f0\" (UID: \"68b0004a-1ee3-4f79-9628-e6b0264f30f0\") " May 26 19:36:21.397951 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:21.397816 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68b0004a-1ee3-4f79-9628-e6b0264f30f0-util\") pod \"68b0004a-1ee3-4f79-9628-e6b0264f30f0\" (UID: \"68b0004a-1ee3-4f79-9628-e6b0264f30f0\") " May 26 19:36:21.397951 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:21.397872 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wkx5\" (UniqueName: \"kubernetes.io/projected/68b0004a-1ee3-4f79-9628-e6b0264f30f0-kube-api-access-7wkx5\") pod \"68b0004a-1ee3-4f79-9628-e6b0264f30f0\" (UID: \"68b0004a-1ee3-4f79-9628-e6b0264f30f0\") " May 26 19:36:21.398194 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:21.398162 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68b0004a-1ee3-4f79-9628-e6b0264f30f0-bundle" (OuterVolumeSpecName: "bundle") pod "68b0004a-1ee3-4f79-9628-e6b0264f30f0" (UID: "68b0004a-1ee3-4f79-9628-e6b0264f30f0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:36:21.400050 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:21.400027 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68b0004a-1ee3-4f79-9628-e6b0264f30f0-kube-api-access-7wkx5" (OuterVolumeSpecName: "kube-api-access-7wkx5") pod "68b0004a-1ee3-4f79-9628-e6b0264f30f0" (UID: "68b0004a-1ee3-4f79-9628-e6b0264f30f0"). InnerVolumeSpecName "kube-api-access-7wkx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:36:21.401970 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:21.401937 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68b0004a-1ee3-4f79-9628-e6b0264f30f0-util" (OuterVolumeSpecName: "util") pod "68b0004a-1ee3-4f79-9628-e6b0264f30f0" (UID: "68b0004a-1ee3-4f79-9628-e6b0264f30f0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:36:21.498732 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:21.498644 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68b0004a-1ee3-4f79-9628-e6b0264f30f0-util\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:36:21.498732 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:21.498677 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wkx5\" (UniqueName: \"kubernetes.io/projected/68b0004a-1ee3-4f79-9628-e6b0264f30f0-kube-api-access-7wkx5\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:36:21.498732 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:21.498693 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68b0004a-1ee3-4f79-9628-e6b0264f30f0-bundle\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:36:22.167078 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:22.167045 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj" May 26 19:36:22.167243 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:22.167047 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv7mvj" event={"ID":"68b0004a-1ee3-4f79-9628-e6b0264f30f0","Type":"ContainerDied","Data":"8bc595e8746d6b86f08c650cdeeb143e4b2978f6ae84234e6392d1957db79c78"} May 26 19:36:22.167243 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:22.167166 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8bc595e8746d6b86f08c650cdeeb143e4b2978f6ae84234e6392d1957db79c78" May 26 19:36:25.179285 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:25.179247 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-fjvc4" event={"ID":"186e5a63-0d50-4434-afa7-fdbfbe76c51d","Type":"ContainerStarted","Data":"e92173b1337a0ecda0aae72f62d033993890685f49a1a2309a90f0fa512bcc8f"} May 26 19:36:25.179706 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:25.179371 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-fjvc4" May 26 19:36:25.196448 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:25.196399 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-fjvc4" podStartSLOduration=2.328102731 podStartE2EDuration="8.196382054s" podCreationTimestamp="2026-05-26 19:36:17 +0000 UTC" firstStartedPulling="2026-05-26 19:36:18.391518323 +0000 UTC m=+642.925491085" lastFinishedPulling="2026-05-26 19:36:24.259797633 +0000 UTC m=+648.793770408" observedRunningTime="2026-05-26 19:36:25.194484638 +0000 UTC m=+649.728457426" watchObservedRunningTime="2026-05-26 19:36:25.196382054 +0000 UTC m=+649.730354838" May 26 19:36:31.184793 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:31.184712 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-fjvc4" May 26 19:36:31.199904 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:31.199867 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-jpwc5" event={"ID":"71a4beed-5ec9-4883-9540-a4104472b888","Type":"ContainerStarted","Data":"44510b7859e3af1bc531646a78aaba1fda36aae12edd53dbefd6e9b576f051d6"} May 26 19:36:31.217423 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:31.217363 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-jpwc5" podStartSLOduration=1.595685627 podStartE2EDuration="14.217344192s" podCreationTimestamp="2026-05-26 19:36:17 +0000 UTC" firstStartedPulling="2026-05-26 19:36:18.277361075 +0000 UTC m=+642.811333838" lastFinishedPulling="2026-05-26 19:36:30.899019634 +0000 UTC m=+655.432992403" observedRunningTime="2026-05-26 19:36:31.215085682 +0000 UTC m=+655.749058469" watchObservedRunningTime="2026-05-26 19:36:31.217344192 +0000 UTC m=+655.751316975" May 26 19:36:34.456302 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:34.456257 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-rdz6j"] May 26 19:36:34.456776 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:34.456762 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68b0004a-1ee3-4f79-9628-e6b0264f30f0" containerName="pull" May 26 19:36:34.456843 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:34.456782 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="68b0004a-1ee3-4f79-9628-e6b0264f30f0" containerName="pull" May 26 19:36:34.456843 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:34.456796 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68b0004a-1ee3-4f79-9628-e6b0264f30f0" containerName="extract" May 26 19:36:34.456843 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:34.456805 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="68b0004a-1ee3-4f79-9628-e6b0264f30f0" containerName="extract" May 26 19:36:34.456843 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:34.456840 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68b0004a-1ee3-4f79-9628-e6b0264f30f0" containerName="util" May 26 19:36:34.457033 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:34.456849 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="68b0004a-1ee3-4f79-9628-e6b0264f30f0" containerName="util" May 26 19:36:34.457033 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:34.456935 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="68b0004a-1ee3-4f79-9628-e6b0264f30f0" containerName="extract" May 26 19:36:34.459030 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:34.459011 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-rdz6j" May 26 19:36:34.461684 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:34.461666 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-k2zzm\"" May 26 19:36:34.468880 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:34.468860 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-rdz6j"] May 26 19:36:34.612903 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:34.612858 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb6f0fd0-ab59-4e47-a595-7c86b4659070-bound-sa-token\") pod \"cert-manager-79c8d999ff-rdz6j\" (UID: \"eb6f0fd0-ab59-4e47-a595-7c86b4659070\") " pod="cert-manager/cert-manager-79c8d999ff-rdz6j" May 26 19:36:34.613080 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:34.612958 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7vl8\" (UniqueName: \"kubernetes.io/projected/eb6f0fd0-ab59-4e47-a595-7c86b4659070-kube-api-access-q7vl8\") pod \"cert-manager-79c8d999ff-rdz6j\" (UID: \"eb6f0fd0-ab59-4e47-a595-7c86b4659070\") " pod="cert-manager/cert-manager-79c8d999ff-rdz6j" May 26 19:36:34.713703 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:34.713619 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q7vl8\" (UniqueName: \"kubernetes.io/projected/eb6f0fd0-ab59-4e47-a595-7c86b4659070-kube-api-access-q7vl8\") pod \"cert-manager-79c8d999ff-rdz6j\" (UID: \"eb6f0fd0-ab59-4e47-a595-7c86b4659070\") " pod="cert-manager/cert-manager-79c8d999ff-rdz6j" May 26 19:36:34.713703 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:34.713692 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb6f0fd0-ab59-4e47-a595-7c86b4659070-bound-sa-token\") pod \"cert-manager-79c8d999ff-rdz6j\" (UID: \"eb6f0fd0-ab59-4e47-a595-7c86b4659070\") " pod="cert-manager/cert-manager-79c8d999ff-rdz6j" May 26 19:36:34.721357 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:34.721312 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb6f0fd0-ab59-4e47-a595-7c86b4659070-bound-sa-token\") pod \"cert-manager-79c8d999ff-rdz6j\" (UID: \"eb6f0fd0-ab59-4e47-a595-7c86b4659070\") " pod="cert-manager/cert-manager-79c8d999ff-rdz6j" May 26 19:36:34.721564 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:34.721545 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7vl8\" (UniqueName: \"kubernetes.io/projected/eb6f0fd0-ab59-4e47-a595-7c86b4659070-kube-api-access-q7vl8\") pod \"cert-manager-79c8d999ff-rdz6j\" (UID: \"eb6f0fd0-ab59-4e47-a595-7c86b4659070\") " pod="cert-manager/cert-manager-79c8d999ff-rdz6j" May 26 19:36:34.768560 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:34.768525 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-rdz6j" May 26 19:36:34.897237 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:34.897211 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-rdz6j"] May 26 19:36:34.899977 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:36:34.899950 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb6f0fd0_ab59_4e47_a595_7c86b4659070.slice/crio-4cf5e79bd31665791ec199921ca801641967e9604f2c47e844d50dd372fe8821 WatchSource:0}: Error finding container 4cf5e79bd31665791ec199921ca801641967e9604f2c47e844d50dd372fe8821: Status 404 returned error can't find the container with id 4cf5e79bd31665791ec199921ca801641967e9604f2c47e844d50dd372fe8821 May 26 19:36:35.217731 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:35.217692 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-rdz6j" event={"ID":"eb6f0fd0-ab59-4e47-a595-7c86b4659070","Type":"ContainerStarted","Data":"8898b1be4a969b3d35fd929c25b1af29fccadb3130086b6a49c4b86cd75923f9"} May 26 19:36:35.217731 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:35.217730 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-rdz6j" event={"ID":"eb6f0fd0-ab59-4e47-a595-7c86b4659070","Type":"ContainerStarted","Data":"4cf5e79bd31665791ec199921ca801641967e9604f2c47e844d50dd372fe8821"} May 26 19:36:35.234280 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:35.234225 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-rdz6j" podStartSLOduration=1.234212096 podStartE2EDuration="1.234212096s" podCreationTimestamp="2026-05-26 19:36:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:36:35.232522575 +0000 UTC m=+659.766495361" watchObservedRunningTime="2026-05-26 19:36:35.234212096 +0000 UTC m=+659.768184880" May 26 19:36:41.144469 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:41.144436 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh"] May 26 19:36:41.146887 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:41.146871 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh" May 26 19:36:41.149966 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:41.149940 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 26 19:36:41.150084 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:41.149984 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 26 19:36:41.151065 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:41.151050 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ps5z8\"" May 26 19:36:41.155484 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:41.155461 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh"] May 26 19:36:41.275277 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:41.275243 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d36a9f0-b631-43cd-834d-a45c8a8e8881-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh\" (UID: \"7d36a9f0-b631-43cd-834d-a45c8a8e8881\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh" May 26 19:36:41.275523 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:41.275314 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg9t6\" (UniqueName: \"kubernetes.io/projected/7d36a9f0-b631-43cd-834d-a45c8a8e8881-kube-api-access-gg9t6\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh\" (UID: \"7d36a9f0-b631-43cd-834d-a45c8a8e8881\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh" May 26 19:36:41.275523 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:41.275407 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d36a9f0-b631-43cd-834d-a45c8a8e8881-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh\" (UID: \"7d36a9f0-b631-43cd-834d-a45c8a8e8881\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh" May 26 19:36:41.376684 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:41.376648 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gg9t6\" (UniqueName: \"kubernetes.io/projected/7d36a9f0-b631-43cd-834d-a45c8a8e8881-kube-api-access-gg9t6\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh\" (UID: \"7d36a9f0-b631-43cd-834d-a45c8a8e8881\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh" May 26 19:36:41.376853 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:41.376706 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d36a9f0-b631-43cd-834d-a45c8a8e8881-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh\" (UID: \"7d36a9f0-b631-43cd-834d-a45c8a8e8881\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh" May 26 19:36:41.376853 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:41.376750 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d36a9f0-b631-43cd-834d-a45c8a8e8881-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh\" (UID: \"7d36a9f0-b631-43cd-834d-a45c8a8e8881\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh" May 26 19:36:41.377038 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:41.377018 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d36a9f0-b631-43cd-834d-a45c8a8e8881-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh\" (UID: \"7d36a9f0-b631-43cd-834d-a45c8a8e8881\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh" May 26 19:36:41.377077 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:41.377060 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d36a9f0-b631-43cd-834d-a45c8a8e8881-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh\" (UID: \"7d36a9f0-b631-43cd-834d-a45c8a8e8881\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh" May 26 19:36:41.384604 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:41.384574 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg9t6\" (UniqueName: \"kubernetes.io/projected/7d36a9f0-b631-43cd-834d-a45c8a8e8881-kube-api-access-gg9t6\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh\" (UID: \"7d36a9f0-b631-43cd-834d-a45c8a8e8881\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh" May 26 19:36:41.456514 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:41.456433 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh" May 26 19:36:41.593682 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:41.593657 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh"] May 26 19:36:41.596001 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:36:41.595974 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d36a9f0_b631_43cd_834d_a45c8a8e8881.slice/crio-900c2e3e80ea2eb440ae3b0493a63f66af4bd1dbda2ffee2d05ef3ca20bd39c9 WatchSource:0}: Error finding container 900c2e3e80ea2eb440ae3b0493a63f66af4bd1dbda2ffee2d05ef3ca20bd39c9: Status 404 returned error can't find the container with id 900c2e3e80ea2eb440ae3b0493a63f66af4bd1dbda2ffee2d05ef3ca20bd39c9 May 26 19:36:42.240928 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:42.240891 2578 generic.go:358] "Generic (PLEG): container finished" podID="7d36a9f0-b631-43cd-834d-a45c8a8e8881" containerID="16338d260a454cbde43825f9d9ab371300c2aa24fd0e5c566d9f8f2c70104e5a" exitCode=0 May 26 19:36:42.241280 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:42.240942 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh" event={"ID":"7d36a9f0-b631-43cd-834d-a45c8a8e8881","Type":"ContainerDied","Data":"16338d260a454cbde43825f9d9ab371300c2aa24fd0e5c566d9f8f2c70104e5a"} May 26 19:36:42.241280 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:42.240963 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh" event={"ID":"7d36a9f0-b631-43cd-834d-a45c8a8e8881","Type":"ContainerStarted","Data":"900c2e3e80ea2eb440ae3b0493a63f66af4bd1dbda2ffee2d05ef3ca20bd39c9"} May 26 19:36:43.246341 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:43.246296 2578 generic.go:358] "Generic (PLEG): container finished" podID="7d36a9f0-b631-43cd-834d-a45c8a8e8881" containerID="a2d1ba37cc6b1520fcdb1265682c6e639af1ed3e7ce22c7bb83624f3ddea078d" exitCode=0 May 26 19:36:43.246686 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:43.246366 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh" event={"ID":"7d36a9f0-b631-43cd-834d-a45c8a8e8881","Type":"ContainerDied","Data":"a2d1ba37cc6b1520fcdb1265682c6e639af1ed3e7ce22c7bb83624f3ddea078d"} May 26 19:36:44.252382 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:44.252344 2578 generic.go:358] "Generic (PLEG): container finished" podID="7d36a9f0-b631-43cd-834d-a45c8a8e8881" containerID="e1d83e61833754050e64fd0b1fd9bb6879037722d3101e99bcaede6a76e4ee32" exitCode=0 May 26 19:36:44.252801 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:44.252415 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh" event={"ID":"7d36a9f0-b631-43cd-834d-a45c8a8e8881","Type":"ContainerDied","Data":"e1d83e61833754050e64fd0b1fd9bb6879037722d3101e99bcaede6a76e4ee32"} May 26 19:36:45.387312 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:45.387287 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh" May 26 19:36:45.403861 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:45.403827 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d36a9f0-b631-43cd-834d-a45c8a8e8881-bundle\") pod \"7d36a9f0-b631-43cd-834d-a45c8a8e8881\" (UID: \"7d36a9f0-b631-43cd-834d-a45c8a8e8881\") " May 26 19:36:45.403947 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:45.403898 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d36a9f0-b631-43cd-834d-a45c8a8e8881-util\") pod \"7d36a9f0-b631-43cd-834d-a45c8a8e8881\" (UID: \"7d36a9f0-b631-43cd-834d-a45c8a8e8881\") " May 26 19:36:45.403947 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:45.403932 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gg9t6\" (UniqueName: \"kubernetes.io/projected/7d36a9f0-b631-43cd-834d-a45c8a8e8881-kube-api-access-gg9t6\") pod \"7d36a9f0-b631-43cd-834d-a45c8a8e8881\" (UID: \"7d36a9f0-b631-43cd-834d-a45c8a8e8881\") " May 26 19:36:45.404699 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:45.404667 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d36a9f0-b631-43cd-834d-a45c8a8e8881-bundle" (OuterVolumeSpecName: "bundle") pod "7d36a9f0-b631-43cd-834d-a45c8a8e8881" (UID: "7d36a9f0-b631-43cd-834d-a45c8a8e8881"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:36:45.406625 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:45.406581 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d36a9f0-b631-43cd-834d-a45c8a8e8881-kube-api-access-gg9t6" (OuterVolumeSpecName: "kube-api-access-gg9t6") pod "7d36a9f0-b631-43cd-834d-a45c8a8e8881" (UID: "7d36a9f0-b631-43cd-834d-a45c8a8e8881"). InnerVolumeSpecName "kube-api-access-gg9t6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:36:45.409716 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:45.409690 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d36a9f0-b631-43cd-834d-a45c8a8e8881-util" (OuterVolumeSpecName: "util") pod "7d36a9f0-b631-43cd-834d-a45c8a8e8881" (UID: "7d36a9f0-b631-43cd-834d-a45c8a8e8881"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:36:45.504487 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:45.504450 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d36a9f0-b631-43cd-834d-a45c8a8e8881-util\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:36:45.504487 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:45.504481 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gg9t6\" (UniqueName: \"kubernetes.io/projected/7d36a9f0-b631-43cd-834d-a45c8a8e8881-kube-api-access-gg9t6\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:36:45.504487 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:45.504493 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d36a9f0-b631-43cd-834d-a45c8a8e8881-bundle\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:36:46.264278 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:46.264247 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh" May 26 19:36:46.264278 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:46.264263 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5zcxbh" event={"ID":"7d36a9f0-b631-43cd-834d-a45c8a8e8881","Type":"ContainerDied","Data":"900c2e3e80ea2eb440ae3b0493a63f66af4bd1dbda2ffee2d05ef3ca20bd39c9"} May 26 19:36:46.264552 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:46.264296 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="900c2e3e80ea2eb440ae3b0493a63f66af4bd1dbda2ffee2d05ef3ca20bd39c9" May 26 19:36:50.164604 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:50.164557 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx"] May 26 19:36:50.165099 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:50.165077 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d36a9f0-b631-43cd-834d-a45c8a8e8881" containerName="pull" May 26 19:36:50.165259 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:50.165248 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d36a9f0-b631-43cd-834d-a45c8a8e8881" containerName="pull" May 26 19:36:50.165379 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:50.165361 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d36a9f0-b631-43cd-834d-a45c8a8e8881" containerName="extract" May 26 19:36:50.165379 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:50.165377 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d36a9f0-b631-43cd-834d-a45c8a8e8881" containerName="extract" May 26 19:36:50.165544 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:50.165409 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d36a9f0-b631-43cd-834d-a45c8a8e8881" containerName="util" May 26 19:36:50.165544 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:50.165417 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d36a9f0-b631-43cd-834d-a45c8a8e8881" containerName="util" May 26 19:36:50.165544 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:50.165532 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d36a9f0-b631-43cd-834d-a45c8a8e8881" containerName="extract" May 26 19:36:50.168754 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:50.168729 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx" May 26 19:36:50.171667 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:50.171644 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 26 19:36:50.171776 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:50.171648 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ps5z8\"" May 26 19:36:50.173217 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:50.173194 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 26 19:36:50.175515 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:50.175493 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx"] May 26 19:36:50.245793 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:50.245759 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b68c9121-079d-4975-a5b9-8989f8fd5636-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx\" (UID: \"b68c9121-079d-4975-a5b9-8989f8fd5636\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx" May 26 19:36:50.245989 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:50.245818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b68c9121-079d-4975-a5b9-8989f8fd5636-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx\" (UID: \"b68c9121-079d-4975-a5b9-8989f8fd5636\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx" May 26 19:36:50.245989 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:50.245900 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfb6v\" (UniqueName: \"kubernetes.io/projected/b68c9121-079d-4975-a5b9-8989f8fd5636-kube-api-access-cfb6v\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx\" (UID: \"b68c9121-079d-4975-a5b9-8989f8fd5636\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx" May 26 19:36:50.346836 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:50.346804 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b68c9121-079d-4975-a5b9-8989f8fd5636-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx\" (UID: \"b68c9121-079d-4975-a5b9-8989f8fd5636\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx" May 26 19:36:50.347009 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:50.346862 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b68c9121-079d-4975-a5b9-8989f8fd5636-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx\" (UID: \"b68c9121-079d-4975-a5b9-8989f8fd5636\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx" May 26 19:36:50.347009 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:50.346986 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cfb6v\" (UniqueName: \"kubernetes.io/projected/b68c9121-079d-4975-a5b9-8989f8fd5636-kube-api-access-cfb6v\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx\" (UID: \"b68c9121-079d-4975-a5b9-8989f8fd5636\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx" May 26 19:36:50.347207 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:50.347191 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b68c9121-079d-4975-a5b9-8989f8fd5636-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx\" (UID: \"b68c9121-079d-4975-a5b9-8989f8fd5636\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx" May 26 19:36:50.347242 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:50.347227 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b68c9121-079d-4975-a5b9-8989f8fd5636-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx\" (UID: \"b68c9121-079d-4975-a5b9-8989f8fd5636\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx" May 26 19:36:50.355708 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:50.355677 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfb6v\" (UniqueName: \"kubernetes.io/projected/b68c9121-079d-4975-a5b9-8989f8fd5636-kube-api-access-cfb6v\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx\" (UID: \"b68c9121-079d-4975-a5b9-8989f8fd5636\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx" May 26 19:36:50.480269 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:50.480182 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx" May 26 19:36:50.610579 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:50.610548 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx"] May 26 19:36:50.614011 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:36:50.613970 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb68c9121_079d_4975_a5b9_8989f8fd5636.slice/crio-f7973a3f8bd38db17f9030e32fc308e355e9ed9e63ec4c5fb1db501f1eb15399 WatchSource:0}: Error finding container f7973a3f8bd38db17f9030e32fc308e355e9ed9e63ec4c5fb1db501f1eb15399: Status 404 returned error can't find the container with id f7973a3f8bd38db17f9030e32fc308e355e9ed9e63ec4c5fb1db501f1eb15399 May 26 19:36:51.287213 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:51.287179 2578 generic.go:358] "Generic (PLEG): container finished" podID="b68c9121-079d-4975-a5b9-8989f8fd5636" containerID="b4ae280520cff1dd6ee0f33006c87d2ef66ae06f73e7f2adb1b381bffc9ab652" exitCode=0 May 26 19:36:51.287614 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:51.287274 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx" event={"ID":"b68c9121-079d-4975-a5b9-8989f8fd5636","Type":"ContainerDied","Data":"b4ae280520cff1dd6ee0f33006c87d2ef66ae06f73e7f2adb1b381bffc9ab652"} May 26 19:36:51.287614 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:51.287310 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx" event={"ID":"b68c9121-079d-4975-a5b9-8989f8fd5636","Type":"ContainerStarted","Data":"f7973a3f8bd38db17f9030e32fc308e355e9ed9e63ec4c5fb1db501f1eb15399"} May 26 19:36:52.031919 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:52.031888 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94b8b45bb-7kbpp"] May 26 19:36:52.034146 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:52.034123 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-7kbpp" May 26 19:36:52.037486 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:52.037466 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 26 19:36:52.037910 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:52.037870 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 26 19:36:52.038382 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:52.038344 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-krg4l\"" May 26 19:36:52.038692 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:52.038663 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 26 19:36:52.038835 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:52.038815 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 26 19:36:52.052962 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:52.052940 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94b8b45bb-7kbpp"] May 26 19:36:52.061553 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:52.061525 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f62ce15e-c048-4085-ab5a-bab25e13e876-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94b8b45bb-7kbpp\" (UID: \"f62ce15e-c048-4085-ab5a-bab25e13e876\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-7kbpp" May 26 19:36:52.061651 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:52.061590 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f62ce15e-c048-4085-ab5a-bab25e13e876-webhook-cert\") pod \"opendatahub-operator-controller-manager-94b8b45bb-7kbpp\" (UID: \"f62ce15e-c048-4085-ab5a-bab25e13e876\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-7kbpp" May 26 19:36:52.061651 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:52.061644 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4bxs\" (UniqueName: \"kubernetes.io/projected/f62ce15e-c048-4085-ab5a-bab25e13e876-kube-api-access-j4bxs\") pod \"opendatahub-operator-controller-manager-94b8b45bb-7kbpp\" (UID: \"f62ce15e-c048-4085-ab5a-bab25e13e876\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-7kbpp" May 26 19:36:52.162030 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:52.162006 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f62ce15e-c048-4085-ab5a-bab25e13e876-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94b8b45bb-7kbpp\" (UID: \"f62ce15e-c048-4085-ab5a-bab25e13e876\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-7kbpp" May 26 19:36:52.162190 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:52.162044 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f62ce15e-c048-4085-ab5a-bab25e13e876-webhook-cert\") pod \"opendatahub-operator-controller-manager-94b8b45bb-7kbpp\" (UID: \"f62ce15e-c048-4085-ab5a-bab25e13e876\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-7kbpp" May 26 19:36:52.162190 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:52.162076 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j4bxs\" (UniqueName: \"kubernetes.io/projected/f62ce15e-c048-4085-ab5a-bab25e13e876-kube-api-access-j4bxs\") pod \"opendatahub-operator-controller-manager-94b8b45bb-7kbpp\" (UID: \"f62ce15e-c048-4085-ab5a-bab25e13e876\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-7kbpp" May 26 19:36:52.164527 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:52.164505 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f62ce15e-c048-4085-ab5a-bab25e13e876-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94b8b45bb-7kbpp\" (UID: \"f62ce15e-c048-4085-ab5a-bab25e13e876\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-7kbpp" May 26 19:36:52.164633 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:52.164537 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f62ce15e-c048-4085-ab5a-bab25e13e876-webhook-cert\") pod \"opendatahub-operator-controller-manager-94b8b45bb-7kbpp\" (UID: \"f62ce15e-c048-4085-ab5a-bab25e13e876\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-7kbpp" May 26 19:36:52.169755 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:52.169732 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4bxs\" (UniqueName: \"kubernetes.io/projected/f62ce15e-c048-4085-ab5a-bab25e13e876-kube-api-access-j4bxs\") pod \"opendatahub-operator-controller-manager-94b8b45bb-7kbpp\" (UID: \"f62ce15e-c048-4085-ab5a-bab25e13e876\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-7kbpp" May 26 19:36:52.292452 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:52.292426 2578 generic.go:358] "Generic (PLEG): container finished" podID="b68c9121-079d-4975-a5b9-8989f8fd5636" containerID="e783bbb34860b93630225f8d480b6d2ec9b0f949a9c3bea5c3c0109de1a57cc6" exitCode=0 May 26 19:36:52.292839 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:52.292521 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx" event={"ID":"b68c9121-079d-4975-a5b9-8989f8fd5636","Type":"ContainerDied","Data":"e783bbb34860b93630225f8d480b6d2ec9b0f949a9c3bea5c3c0109de1a57cc6"} May 26 19:36:52.345623 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:52.345597 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-7kbpp" May 26 19:36:52.493161 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:52.493123 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94b8b45bb-7kbpp"] May 26 19:36:52.496376 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:36:52.496348 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf62ce15e_c048_4085_ab5a_bab25e13e876.slice/crio-9b7539b92baef2cf5cc62507c3950b44f458901e828518d9c5db03faefc32f43 WatchSource:0}: Error finding container 9b7539b92baef2cf5cc62507c3950b44f458901e828518d9c5db03faefc32f43: Status 404 returned error can't find the container with id 9b7539b92baef2cf5cc62507c3950b44f458901e828518d9c5db03faefc32f43 May 26 19:36:53.298760 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:53.298717 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-7kbpp" event={"ID":"f62ce15e-c048-4085-ab5a-bab25e13e876","Type":"ContainerStarted","Data":"9b7539b92baef2cf5cc62507c3950b44f458901e828518d9c5db03faefc32f43"} May 26 19:36:53.301665 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:53.301634 2578 generic.go:358] "Generic (PLEG): container finished" podID="b68c9121-079d-4975-a5b9-8989f8fd5636" containerID="ec7ae9b0006af6ed3f721305c4ee2bbcad5c4810c6ab80da6b38ab587cde4a06" exitCode=0 May 26 19:36:53.301778 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:53.301701 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx" event={"ID":"b68c9121-079d-4975-a5b9-8989f8fd5636","Type":"ContainerDied","Data":"ec7ae9b0006af6ed3f721305c4ee2bbcad5c4810c6ab80da6b38ab587cde4a06"} May 26 19:36:54.969646 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:54.969623 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx" May 26 19:36:55.087134 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:55.087103 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b68c9121-079d-4975-a5b9-8989f8fd5636-bundle\") pod \"b68c9121-079d-4975-a5b9-8989f8fd5636\" (UID: \"b68c9121-079d-4975-a5b9-8989f8fd5636\") " May 26 19:36:55.087276 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:55.087209 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfb6v\" (UniqueName: \"kubernetes.io/projected/b68c9121-079d-4975-a5b9-8989f8fd5636-kube-api-access-cfb6v\") pod \"b68c9121-079d-4975-a5b9-8989f8fd5636\" (UID: \"b68c9121-079d-4975-a5b9-8989f8fd5636\") " May 26 19:36:55.087345 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:55.087284 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b68c9121-079d-4975-a5b9-8989f8fd5636-util\") pod \"b68c9121-079d-4975-a5b9-8989f8fd5636\" (UID: \"b68c9121-079d-4975-a5b9-8989f8fd5636\") " May 26 19:36:55.087899 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:55.087877 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b68c9121-079d-4975-a5b9-8989f8fd5636-bundle" (OuterVolumeSpecName: "bundle") pod "b68c9121-079d-4975-a5b9-8989f8fd5636" (UID: "b68c9121-079d-4975-a5b9-8989f8fd5636"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:36:55.089365 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:55.089310 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b68c9121-079d-4975-a5b9-8989f8fd5636-kube-api-access-cfb6v" (OuterVolumeSpecName: "kube-api-access-cfb6v") pod "b68c9121-079d-4975-a5b9-8989f8fd5636" (UID: "b68c9121-079d-4975-a5b9-8989f8fd5636"). InnerVolumeSpecName "kube-api-access-cfb6v". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:36:55.092812 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:55.092787 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b68c9121-079d-4975-a5b9-8989f8fd5636-util" (OuterVolumeSpecName: "util") pod "b68c9121-079d-4975-a5b9-8989f8fd5636" (UID: "b68c9121-079d-4975-a5b9-8989f8fd5636"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:36:55.188833 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:55.188799 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfb6v\" (UniqueName: \"kubernetes.io/projected/b68c9121-079d-4975-a5b9-8989f8fd5636-kube-api-access-cfb6v\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:36:55.188833 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:55.188828 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b68c9121-079d-4975-a5b9-8989f8fd5636-util\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:36:55.189056 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:55.188841 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b68c9121-079d-4975-a5b9-8989f8fd5636-bundle\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:36:55.310558 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:55.310481 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx" May 26 19:36:55.310704 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:55.310471 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b2ptx" event={"ID":"b68c9121-079d-4975-a5b9-8989f8fd5636","Type":"ContainerDied","Data":"f7973a3f8bd38db17f9030e32fc308e355e9ed9e63ec4c5fb1db501f1eb15399"} May 26 19:36:55.310704 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:55.310611 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7973a3f8bd38db17f9030e32fc308e355e9ed9e63ec4c5fb1db501f1eb15399" May 26 19:36:55.312061 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:55.312036 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-7kbpp" event={"ID":"f62ce15e-c048-4085-ab5a-bab25e13e876","Type":"ContainerStarted","Data":"5ebb184e264d0c18458fea11e3e3262d466ea50089dbaefab7a98688b6b3de1d"} May 26 19:36:55.312180 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:55.312152 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-7kbpp" May 26 19:36:55.332174 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:36:55.332134 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-7kbpp" podStartSLOduration=1.85129831 podStartE2EDuration="4.332122251s" podCreationTimestamp="2026-05-26 19:36:51 +0000 UTC" firstStartedPulling="2026-05-26 19:36:52.498234053 +0000 UTC m=+677.032206829" lastFinishedPulling="2026-05-26 19:36:54.979058006 +0000 UTC m=+679.513030770" observedRunningTime="2026-05-26 19:36:55.32971954 +0000 UTC m=+679.863692335" watchObservedRunningTime="2026-05-26 19:36:55.332122251 +0000 UTC m=+679.866095098" May 26 19:37:06.317943 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:06.317913 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-7kbpp" May 26 19:37:08.673599 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.673564 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f8b76d9f6-kgvzk"] May 26 19:37:08.673986 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.673967 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b68c9121-079d-4975-a5b9-8989f8fd5636" containerName="pull" May 26 19:37:08.673986 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.673981 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b68c9121-079d-4975-a5b9-8989f8fd5636" containerName="pull" May 26 19:37:08.674093 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.674001 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b68c9121-079d-4975-a5b9-8989f8fd5636" containerName="extract" May 26 19:37:08.674093 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.674006 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b68c9121-079d-4975-a5b9-8989f8fd5636" containerName="extract" May 26 19:37:08.674093 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.674020 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b68c9121-079d-4975-a5b9-8989f8fd5636" containerName="util" May 26 19:37:08.674093 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.674025 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b68c9121-079d-4975-a5b9-8989f8fd5636" containerName="util" May 26 19:37:08.674093 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.674079 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="b68c9121-079d-4975-a5b9-8989f8fd5636" containerName="extract" May 26 19:37:08.677203 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.677184 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-kgvzk" May 26 19:37:08.683337 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.683306 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 26 19:37:08.684100 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.684079 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 26 19:37:08.684207 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.684156 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 26 19:37:08.684274 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.684206 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 26 19:37:08.684274 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.684079 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 26 19:37:08.684274 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.684136 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hk8q8\"" May 26 19:37:08.713916 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.713889 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f8b76d9f6-kgvzk"] May 26 19:37:08.809136 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.809103 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/35a48417-4435-4bbe-ad35-a31207ea1f50-metrics-cert\") pod \"lws-controller-manager-6f8b76d9f6-kgvzk\" (UID: \"35a48417-4435-4bbe-ad35-a31207ea1f50\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-kgvzk" May 26 19:37:08.809136 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.809140 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35a48417-4435-4bbe-ad35-a31207ea1f50-cert\") pod \"lws-controller-manager-6f8b76d9f6-kgvzk\" (UID: \"35a48417-4435-4bbe-ad35-a31207ea1f50\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-kgvzk" May 26 19:37:08.809408 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.809205 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/35a48417-4435-4bbe-ad35-a31207ea1f50-manager-config\") pod \"lws-controller-manager-6f8b76d9f6-kgvzk\" (UID: \"35a48417-4435-4bbe-ad35-a31207ea1f50\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-kgvzk" May 26 19:37:08.809408 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.809271 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kh5d\" (UniqueName: \"kubernetes.io/projected/35a48417-4435-4bbe-ad35-a31207ea1f50-kube-api-access-6kh5d\") pod \"lws-controller-manager-6f8b76d9f6-kgvzk\" (UID: \"35a48417-4435-4bbe-ad35-a31207ea1f50\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-kgvzk" May 26 19:37:08.910449 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.910413 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/35a48417-4435-4bbe-ad35-a31207ea1f50-metrics-cert\") pod \"lws-controller-manager-6f8b76d9f6-kgvzk\" (UID: \"35a48417-4435-4bbe-ad35-a31207ea1f50\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-kgvzk" May 26 19:37:08.910615 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.910454 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35a48417-4435-4bbe-ad35-a31207ea1f50-cert\") pod \"lws-controller-manager-6f8b76d9f6-kgvzk\" (UID: \"35a48417-4435-4bbe-ad35-a31207ea1f50\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-kgvzk" May 26 19:37:08.910615 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.910500 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/35a48417-4435-4bbe-ad35-a31207ea1f50-manager-config\") pod \"lws-controller-manager-6f8b76d9f6-kgvzk\" (UID: \"35a48417-4435-4bbe-ad35-a31207ea1f50\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-kgvzk" May 26 19:37:08.910615 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.910565 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6kh5d\" (UniqueName: \"kubernetes.io/projected/35a48417-4435-4bbe-ad35-a31207ea1f50-kube-api-access-6kh5d\") pod \"lws-controller-manager-6f8b76d9f6-kgvzk\" (UID: \"35a48417-4435-4bbe-ad35-a31207ea1f50\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-kgvzk" May 26 19:37:08.911223 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.911196 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/35a48417-4435-4bbe-ad35-a31207ea1f50-manager-config\") pod \"lws-controller-manager-6f8b76d9f6-kgvzk\" (UID: \"35a48417-4435-4bbe-ad35-a31207ea1f50\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-kgvzk" May 26 19:37:08.912961 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.912938 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35a48417-4435-4bbe-ad35-a31207ea1f50-cert\") pod \"lws-controller-manager-6f8b76d9f6-kgvzk\" (UID: \"35a48417-4435-4bbe-ad35-a31207ea1f50\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-kgvzk" May 26 19:37:08.913051 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.912967 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/35a48417-4435-4bbe-ad35-a31207ea1f50-metrics-cert\") pod \"lws-controller-manager-6f8b76d9f6-kgvzk\" (UID: \"35a48417-4435-4bbe-ad35-a31207ea1f50\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-kgvzk" May 26 19:37:08.959723 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.959665 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kh5d\" (UniqueName: \"kubernetes.io/projected/35a48417-4435-4bbe-ad35-a31207ea1f50-kube-api-access-6kh5d\") pod \"lws-controller-manager-6f8b76d9f6-kgvzk\" (UID: \"35a48417-4435-4bbe-ad35-a31207ea1f50\") " pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-kgvzk" May 26 19:37:08.986612 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:08.986569 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-kgvzk" May 26 19:37:09.130542 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:09.130520 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f8b76d9f6-kgvzk"] May 26 19:37:09.133139 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:37:09.133110 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35a48417_4435_4bbe_ad35_a31207ea1f50.slice/crio-55fa588e3c99f442f6821566d36b9711ebf5a3b09e485a4877758cd1e9bd42e4 WatchSource:0}: Error finding container 55fa588e3c99f442f6821566d36b9711ebf5a3b09e485a4877758cd1e9bd42e4: Status 404 returned error can't find the container with id 55fa588e3c99f442f6821566d36b9711ebf5a3b09e485a4877758cd1e9bd42e4 May 26 19:37:09.362602 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:09.362518 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-kgvzk" event={"ID":"35a48417-4435-4bbe-ad35-a31207ea1f50","Type":"ContainerStarted","Data":"55fa588e3c99f442f6821566d36b9711ebf5a3b09e485a4877758cd1e9bd42e4"} May 26 19:37:11.044779 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:11.044745 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r"] May 26 19:37:11.048400 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:11.048383 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r" May 26 19:37:11.050845 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:11.050824 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 26 19:37:11.050845 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:11.050835 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 26 19:37:11.051028 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:11.050993 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ps5z8\"" May 26 19:37:11.056029 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:11.055996 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r"] May 26 19:37:11.128917 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:11.128860 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec60e328-a613-4cc0-ba68-fd84533dc22b-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r\" (UID: \"ec60e328-a613-4cc0-ba68-fd84533dc22b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r" May 26 19:37:11.129103 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:11.128929 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec60e328-a613-4cc0-ba68-fd84533dc22b-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r\" (UID: \"ec60e328-a613-4cc0-ba68-fd84533dc22b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r" May 26 19:37:11.129189 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:11.129102 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96plv\" (UniqueName: \"kubernetes.io/projected/ec60e328-a613-4cc0-ba68-fd84533dc22b-kube-api-access-96plv\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r\" (UID: \"ec60e328-a613-4cc0-ba68-fd84533dc22b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r" May 26 19:37:11.230766 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:11.230726 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-96plv\" (UniqueName: \"kubernetes.io/projected/ec60e328-a613-4cc0-ba68-fd84533dc22b-kube-api-access-96plv\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r\" (UID: \"ec60e328-a613-4cc0-ba68-fd84533dc22b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r" May 26 19:37:11.230928 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:11.230831 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec60e328-a613-4cc0-ba68-fd84533dc22b-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r\" (UID: \"ec60e328-a613-4cc0-ba68-fd84533dc22b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r" May 26 19:37:11.230928 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:11.230880 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec60e328-a613-4cc0-ba68-fd84533dc22b-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r\" (UID: \"ec60e328-a613-4cc0-ba68-fd84533dc22b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r" May 26 19:37:11.231403 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:11.231379 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec60e328-a613-4cc0-ba68-fd84533dc22b-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r\" (UID: \"ec60e328-a613-4cc0-ba68-fd84533dc22b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r" May 26 19:37:11.231972 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:11.231951 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec60e328-a613-4cc0-ba68-fd84533dc22b-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r\" (UID: \"ec60e328-a613-4cc0-ba68-fd84533dc22b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r" May 26 19:37:11.239234 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:11.239201 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96plv\" (UniqueName: \"kubernetes.io/projected/ec60e328-a613-4cc0-ba68-fd84533dc22b-kube-api-access-96plv\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r\" (UID: \"ec60e328-a613-4cc0-ba68-fd84533dc22b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r" May 26 19:37:11.358054 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:11.357973 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r" May 26 19:37:11.371137 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:11.371098 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-kgvzk" event={"ID":"35a48417-4435-4bbe-ad35-a31207ea1f50","Type":"ContainerStarted","Data":"c9493bfd84f5633f07e18fc5a4a3190bf4b413abc987276abc090efb0d867276"} May 26 19:37:11.371288 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:11.371183 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-kgvzk" May 26 19:37:11.387205 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:11.387153 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-kgvzk" podStartSLOduration=1.903171606 podStartE2EDuration="3.387136178s" podCreationTimestamp="2026-05-26 19:37:08 +0000 UTC" firstStartedPulling="2026-05-26 19:37:09.134904643 +0000 UTC m=+693.668877406" lastFinishedPulling="2026-05-26 19:37:10.618869216 +0000 UTC m=+695.152841978" observedRunningTime="2026-05-26 19:37:11.385526552 +0000 UTC m=+695.919499341" watchObservedRunningTime="2026-05-26 19:37:11.387136178 +0000 UTC m=+695.921108962" May 26 19:37:11.492922 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:11.492896 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r"] May 26 19:37:11.494853 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:37:11.494823 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec60e328_a613_4cc0_ba68_fd84533dc22b.slice/crio-e2ee94411534a1c34a6bbdcaee253ca9bab9d56133cabf354622a163df3da22a WatchSource:0}: Error finding container e2ee94411534a1c34a6bbdcaee253ca9bab9d56133cabf354622a163df3da22a: Status 404 returned error can't find the container with id e2ee94411534a1c34a6bbdcaee253ca9bab9d56133cabf354622a163df3da22a May 26 19:37:12.376340 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:12.376295 2578 generic.go:358] "Generic (PLEG): container finished" podID="ec60e328-a613-4cc0-ba68-fd84533dc22b" containerID="caf7d3bf4ddd6f32c6d73b2b64b8445ddbf8c149a5c8c4345cfa5d5a6350e959" exitCode=0 May 26 19:37:12.376794 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:12.376375 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r" event={"ID":"ec60e328-a613-4cc0-ba68-fd84533dc22b","Type":"ContainerDied","Data":"caf7d3bf4ddd6f32c6d73b2b64b8445ddbf8c149a5c8c4345cfa5d5a6350e959"} May 26 19:37:12.376794 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:12.376425 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r" event={"ID":"ec60e328-a613-4cc0-ba68-fd84533dc22b","Type":"ContainerStarted","Data":"e2ee94411534a1c34a6bbdcaee253ca9bab9d56133cabf354622a163df3da22a"} May 26 19:37:12.886336 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:12.886293 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-59cf57849b-fg6kt"] May 26 19:37:12.889917 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:12.889896 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59cf57849b-fg6kt" May 26 19:37:12.893500 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:12.893478 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 26 19:37:12.893620 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:12.893530 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 26 19:37:12.893620 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:12.893550 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 26 19:37:12.893620 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:12.893560 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-l7zjd\"" May 26 19:37:12.893620 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:12.893574 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 26 19:37:12.899036 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:12.899009 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59cf57849b-fg6kt"] May 26 19:37:13.047082 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:13.047047 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsd2c\" (UniqueName: \"kubernetes.io/projected/f8289a95-e6e5-43a9-809f-75dc20e065fe-kube-api-access-gsd2c\") pod \"kube-auth-proxy-59cf57849b-fg6kt\" (UID: \"f8289a95-e6e5-43a9-809f-75dc20e065fe\") " pod="openshift-ingress/kube-auth-proxy-59cf57849b-fg6kt" May 26 19:37:13.047255 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:13.047112 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8289a95-e6e5-43a9-809f-75dc20e065fe-tmp\") pod \"kube-auth-proxy-59cf57849b-fg6kt\" (UID: \"f8289a95-e6e5-43a9-809f-75dc20e065fe\") " pod="openshift-ingress/kube-auth-proxy-59cf57849b-fg6kt" May 26 19:37:13.047255 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:13.047178 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8289a95-e6e5-43a9-809f-75dc20e065fe-tls-certs\") pod \"kube-auth-proxy-59cf57849b-fg6kt\" (UID: \"f8289a95-e6e5-43a9-809f-75dc20e065fe\") " pod="openshift-ingress/kube-auth-proxy-59cf57849b-fg6kt" May 26 19:37:13.147989 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:13.147883 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8289a95-e6e5-43a9-809f-75dc20e065fe-tls-certs\") pod \"kube-auth-proxy-59cf57849b-fg6kt\" (UID: \"f8289a95-e6e5-43a9-809f-75dc20e065fe\") " pod="openshift-ingress/kube-auth-proxy-59cf57849b-fg6kt" May 26 19:37:13.147989 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:13.147948 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gsd2c\" (UniqueName: \"kubernetes.io/projected/f8289a95-e6e5-43a9-809f-75dc20e065fe-kube-api-access-gsd2c\") pod \"kube-auth-proxy-59cf57849b-fg6kt\" (UID: \"f8289a95-e6e5-43a9-809f-75dc20e065fe\") " pod="openshift-ingress/kube-auth-proxy-59cf57849b-fg6kt" May 26 19:37:13.148214 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:13.148081 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8289a95-e6e5-43a9-809f-75dc20e065fe-tmp\") pod \"kube-auth-proxy-59cf57849b-fg6kt\" (UID: \"f8289a95-e6e5-43a9-809f-75dc20e065fe\") " pod="openshift-ingress/kube-auth-proxy-59cf57849b-fg6kt" May 26 19:37:13.150153 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:13.150130 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8289a95-e6e5-43a9-809f-75dc20e065fe-tmp\") pod \"kube-auth-proxy-59cf57849b-fg6kt\" (UID: \"f8289a95-e6e5-43a9-809f-75dc20e065fe\") " pod="openshift-ingress/kube-auth-proxy-59cf57849b-fg6kt" May 26 19:37:13.150485 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:13.150466 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8289a95-e6e5-43a9-809f-75dc20e065fe-tls-certs\") pod \"kube-auth-proxy-59cf57849b-fg6kt\" (UID: \"f8289a95-e6e5-43a9-809f-75dc20e065fe\") " pod="openshift-ingress/kube-auth-proxy-59cf57849b-fg6kt" May 26 19:37:13.155752 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:13.155729 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsd2c\" (UniqueName: \"kubernetes.io/projected/f8289a95-e6e5-43a9-809f-75dc20e065fe-kube-api-access-gsd2c\") pod \"kube-auth-proxy-59cf57849b-fg6kt\" (UID: \"f8289a95-e6e5-43a9-809f-75dc20e065fe\") " pod="openshift-ingress/kube-auth-proxy-59cf57849b-fg6kt" May 26 19:37:13.200887 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:13.200846 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59cf57849b-fg6kt" May 26 19:37:13.336083 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:13.336059 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59cf57849b-fg6kt"] May 26 19:37:13.338029 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:37:13.337994 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8289a95_e6e5_43a9_809f_75dc20e065fe.slice/crio-00ff3b7ad5f315cdc782963c34c11bfef7b50b2ae92608ec124ed8bbbf8fbba0 WatchSource:0}: Error finding container 00ff3b7ad5f315cdc782963c34c11bfef7b50b2ae92608ec124ed8bbbf8fbba0: Status 404 returned error can't find the container with id 00ff3b7ad5f315cdc782963c34c11bfef7b50b2ae92608ec124ed8bbbf8fbba0 May 26 19:37:13.381715 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:13.381677 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59cf57849b-fg6kt" event={"ID":"f8289a95-e6e5-43a9-809f-75dc20e065fe","Type":"ContainerStarted","Data":"00ff3b7ad5f315cdc782963c34c11bfef7b50b2ae92608ec124ed8bbbf8fbba0"} May 26 19:37:14.387794 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:14.387760 2578 generic.go:358] "Generic (PLEG): container finished" podID="ec60e328-a613-4cc0-ba68-fd84533dc22b" containerID="bbb554dcd2d773559c921c8c8672de79727f137872b03a5a7dae8ecad57836f1" exitCode=0 May 26 19:37:14.388246 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:14.387879 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r" event={"ID":"ec60e328-a613-4cc0-ba68-fd84533dc22b","Type":"ContainerDied","Data":"bbb554dcd2d773559c921c8c8672de79727f137872b03a5a7dae8ecad57836f1"} May 26 19:37:15.393728 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:15.393695 2578 generic.go:358] "Generic (PLEG): container finished" podID="ec60e328-a613-4cc0-ba68-fd84533dc22b" containerID="46a7af88784b30a55444f17b02231385cb617f9e6f8586bd577bdad757f901f2" exitCode=0 May 26 19:37:15.394171 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:15.393772 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r" event={"ID":"ec60e328-a613-4cc0-ba68-fd84533dc22b","Type":"ContainerDied","Data":"46a7af88784b30a55444f17b02231385cb617f9e6f8586bd577bdad757f901f2"} May 26 19:37:16.521925 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:16.521902 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r" May 26 19:37:16.682755 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:16.682668 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96plv\" (UniqueName: \"kubernetes.io/projected/ec60e328-a613-4cc0-ba68-fd84533dc22b-kube-api-access-96plv\") pod \"ec60e328-a613-4cc0-ba68-fd84533dc22b\" (UID: \"ec60e328-a613-4cc0-ba68-fd84533dc22b\") " May 26 19:37:16.682755 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:16.682727 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec60e328-a613-4cc0-ba68-fd84533dc22b-bundle\") pod \"ec60e328-a613-4cc0-ba68-fd84533dc22b\" (UID: \"ec60e328-a613-4cc0-ba68-fd84533dc22b\") " May 26 19:37:16.682953 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:16.682768 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec60e328-a613-4cc0-ba68-fd84533dc22b-util\") pod \"ec60e328-a613-4cc0-ba68-fd84533dc22b\" (UID: \"ec60e328-a613-4cc0-ba68-fd84533dc22b\") " May 26 19:37:16.683616 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:16.683589 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec60e328-a613-4cc0-ba68-fd84533dc22b-bundle" (OuterVolumeSpecName: "bundle") pod "ec60e328-a613-4cc0-ba68-fd84533dc22b" (UID: "ec60e328-a613-4cc0-ba68-fd84533dc22b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:37:16.684735 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:16.684720 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec60e328-a613-4cc0-ba68-fd84533dc22b-kube-api-access-96plv" (OuterVolumeSpecName: "kube-api-access-96plv") pod "ec60e328-a613-4cc0-ba68-fd84533dc22b" (UID: "ec60e328-a613-4cc0-ba68-fd84533dc22b"). InnerVolumeSpecName "kube-api-access-96plv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:37:16.687863 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:16.687827 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec60e328-a613-4cc0-ba68-fd84533dc22b-util" (OuterVolumeSpecName: "util") pod "ec60e328-a613-4cc0-ba68-fd84533dc22b" (UID: "ec60e328-a613-4cc0-ba68-fd84533dc22b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:37:16.784088 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:16.784058 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec60e328-a613-4cc0-ba68-fd84533dc22b-util\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:37:16.784088 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:16.784083 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96plv\" (UniqueName: \"kubernetes.io/projected/ec60e328-a613-4cc0-ba68-fd84533dc22b-kube-api-access-96plv\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:37:16.784088 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:16.784094 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec60e328-a613-4cc0-ba68-fd84533dc22b-bundle\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:37:17.402965 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:17.402922 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r" event={"ID":"ec60e328-a613-4cc0-ba68-fd84533dc22b","Type":"ContainerDied","Data":"e2ee94411534a1c34a6bbdcaee253ca9bab9d56133cabf354622a163df3da22a"} May 26 19:37:17.402965 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:17.402964 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e2ee94411534a1c34a6bbdcaee253ca9bab9d56133cabf354622a163df3da22a" May 26 19:37:17.403217 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:17.402999 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xh24r" May 26 19:37:18.407745 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:18.407706 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59cf57849b-fg6kt" event={"ID":"f8289a95-e6e5-43a9-809f-75dc20e065fe","Type":"ContainerStarted","Data":"530b878b1ffcfc01afc403c2a27ee2c6b2d3d43338b4adcf36b360017fb0c989"} May 26 19:37:18.424519 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:18.424464 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-59cf57849b-fg6kt" podStartSLOduration=2.346979881 podStartE2EDuration="6.424451103s" podCreationTimestamp="2026-05-26 19:37:12 +0000 UTC" firstStartedPulling="2026-05-26 19:37:13.339786958 +0000 UTC m=+697.873759723" lastFinishedPulling="2026-05-26 19:37:17.417258178 +0000 UTC m=+701.951230945" observedRunningTime="2026-05-26 19:37:18.423289229 +0000 UTC m=+702.957262014" watchObservedRunningTime="2026-05-26 19:37:18.424451103 +0000 UTC m=+702.958423898" May 26 19:37:22.379124 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:22.379095 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6f8b76d9f6-kgvzk" May 26 19:37:25.236807 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:25.236717 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd"] May 26 19:37:25.237290 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:25.237272 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec60e328-a613-4cc0-ba68-fd84533dc22b" containerName="util" May 26 19:37:25.237373 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:25.237294 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec60e328-a613-4cc0-ba68-fd84533dc22b" containerName="util" May 26 19:37:25.237373 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:25.237346 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec60e328-a613-4cc0-ba68-fd84533dc22b" containerName="pull" May 26 19:37:25.237373 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:25.237356 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec60e328-a613-4cc0-ba68-fd84533dc22b" containerName="pull" May 26 19:37:25.237526 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:25.237379 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec60e328-a613-4cc0-ba68-fd84533dc22b" containerName="extract" May 26 19:37:25.237526 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:25.237389 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec60e328-a613-4cc0-ba68-fd84533dc22b" containerName="extract" May 26 19:37:25.237526 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:25.237491 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="ec60e328-a613-4cc0-ba68-fd84533dc22b" containerName="extract" May 26 19:37:25.242093 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:25.242071 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd" May 26 19:37:25.244845 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:25.244822 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 26 19:37:25.245952 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:25.245932 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ps5z8\"" May 26 19:37:25.246025 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:25.245964 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 26 19:37:25.251684 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:25.251664 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd"] May 26 19:37:25.359996 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:25.359961 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d7a4773-e094-4cbe-b3a9-f907bc567548-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd\" (UID: \"5d7a4773-e094-4cbe-b3a9-f907bc567548\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd" May 26 19:37:25.360172 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:25.360042 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvwgj\" (UniqueName: \"kubernetes.io/projected/5d7a4773-e094-4cbe-b3a9-f907bc567548-kube-api-access-gvwgj\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd\" (UID: \"5d7a4773-e094-4cbe-b3a9-f907bc567548\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd" May 26 19:37:25.360172 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:25.360128 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d7a4773-e094-4cbe-b3a9-f907bc567548-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd\" (UID: \"5d7a4773-e094-4cbe-b3a9-f907bc567548\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd" May 26 19:37:25.460861 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:25.460824 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gvwgj\" (UniqueName: \"kubernetes.io/projected/5d7a4773-e094-4cbe-b3a9-f907bc567548-kube-api-access-gvwgj\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd\" (UID: \"5d7a4773-e094-4cbe-b3a9-f907bc567548\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd" May 26 19:37:25.461012 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:25.460878 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d7a4773-e094-4cbe-b3a9-f907bc567548-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd\" (UID: \"5d7a4773-e094-4cbe-b3a9-f907bc567548\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd" May 26 19:37:25.461012 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:25.460896 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d7a4773-e094-4cbe-b3a9-f907bc567548-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd\" (UID: \"5d7a4773-e094-4cbe-b3a9-f907bc567548\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd" May 26 19:37:25.461396 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:25.461373 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d7a4773-e094-4cbe-b3a9-f907bc567548-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd\" (UID: \"5d7a4773-e094-4cbe-b3a9-f907bc567548\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd" May 26 19:37:25.461446 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:25.461401 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d7a4773-e094-4cbe-b3a9-f907bc567548-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd\" (UID: \"5d7a4773-e094-4cbe-b3a9-f907bc567548\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd" May 26 19:37:25.469164 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:25.469143 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvwgj\" (UniqueName: \"kubernetes.io/projected/5d7a4773-e094-4cbe-b3a9-f907bc567548-kube-api-access-gvwgj\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd\" (UID: \"5d7a4773-e094-4cbe-b3a9-f907bc567548\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd" May 26 19:37:25.552804 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:25.552714 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd" May 26 19:37:25.698715 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:25.698685 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd"] May 26 19:37:25.700436 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:37:25.700404 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d7a4773_e094_4cbe_b3a9_f907bc567548.slice/crio-7d44b2807f27b720fb81ab546101aa48e0222e3400350cb5a2a84783babe72f9 WatchSource:0}: Error finding container 7d44b2807f27b720fb81ab546101aa48e0222e3400350cb5a2a84783babe72f9: Status 404 returned error can't find the container with id 7d44b2807f27b720fb81ab546101aa48e0222e3400350cb5a2a84783babe72f9 May 26 19:37:26.437305 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:26.437264 2578 generic.go:358] "Generic (PLEG): container finished" podID="5d7a4773-e094-4cbe-b3a9-f907bc567548" containerID="1bbbbba57bd1a5e8f54702611b3c4f79702c05279fd9205f23b34b008c783510" exitCode=0 May 26 19:37:26.437678 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:26.437355 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd" event={"ID":"5d7a4773-e094-4cbe-b3a9-f907bc567548","Type":"ContainerDied","Data":"1bbbbba57bd1a5e8f54702611b3c4f79702c05279fd9205f23b34b008c783510"} May 26 19:37:26.437678 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:26.437394 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd" event={"ID":"5d7a4773-e094-4cbe-b3a9-f907bc567548","Type":"ContainerStarted","Data":"7d44b2807f27b720fb81ab546101aa48e0222e3400350cb5a2a84783babe72f9"} May 26 19:37:27.442705 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:27.442671 2578 generic.go:358] "Generic (PLEG): container finished" podID="5d7a4773-e094-4cbe-b3a9-f907bc567548" containerID="b9cea2efd17cfc00c1d047b02499e835577eabb796b19dfa6650921bb57655e5" exitCode=0 May 26 19:37:27.443102 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:27.442764 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd" event={"ID":"5d7a4773-e094-4cbe-b3a9-f907bc567548","Type":"ContainerDied","Data":"b9cea2efd17cfc00c1d047b02499e835577eabb796b19dfa6650921bb57655e5"} May 26 19:37:28.448449 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:28.448416 2578 generic.go:358] "Generic (PLEG): container finished" podID="5d7a4773-e094-4cbe-b3a9-f907bc567548" containerID="250298740f42244da2893734998879cc97db0debf8a3edc7b86138ec9dfdb6eb" exitCode=0 May 26 19:37:28.448810 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:28.448506 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd" event={"ID":"5d7a4773-e094-4cbe-b3a9-f907bc567548","Type":"ContainerDied","Data":"250298740f42244da2893734998879cc97db0debf8a3edc7b86138ec9dfdb6eb"} May 26 19:37:29.574859 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:29.574839 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd" May 26 19:37:29.700060 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:29.700024 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d7a4773-e094-4cbe-b3a9-f907bc567548-bundle\") pod \"5d7a4773-e094-4cbe-b3a9-f907bc567548\" (UID: \"5d7a4773-e094-4cbe-b3a9-f907bc567548\") " May 26 19:37:29.700248 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:29.700106 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvwgj\" (UniqueName: \"kubernetes.io/projected/5d7a4773-e094-4cbe-b3a9-f907bc567548-kube-api-access-gvwgj\") pod \"5d7a4773-e094-4cbe-b3a9-f907bc567548\" (UID: \"5d7a4773-e094-4cbe-b3a9-f907bc567548\") " May 26 19:37:29.700353 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:29.700308 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d7a4773-e094-4cbe-b3a9-f907bc567548-util\") pod \"5d7a4773-e094-4cbe-b3a9-f907bc567548\" (UID: \"5d7a4773-e094-4cbe-b3a9-f907bc567548\") " May 26 19:37:29.701070 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:29.701038 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d7a4773-e094-4cbe-b3a9-f907bc567548-bundle" (OuterVolumeSpecName: "bundle") pod "5d7a4773-e094-4cbe-b3a9-f907bc567548" (UID: "5d7a4773-e094-4cbe-b3a9-f907bc567548"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:37:29.702175 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:29.702117 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d7a4773-e094-4cbe-b3a9-f907bc567548-kube-api-access-gvwgj" (OuterVolumeSpecName: "kube-api-access-gvwgj") pod "5d7a4773-e094-4cbe-b3a9-f907bc567548" (UID: "5d7a4773-e094-4cbe-b3a9-f907bc567548"). InnerVolumeSpecName "kube-api-access-gvwgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:37:29.705853 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:29.705825 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d7a4773-e094-4cbe-b3a9-f907bc567548-util" (OuterVolumeSpecName: "util") pod "5d7a4773-e094-4cbe-b3a9-f907bc567548" (UID: "5d7a4773-e094-4cbe-b3a9-f907bc567548"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:37:29.801166 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:29.801133 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d7a4773-e094-4cbe-b3a9-f907bc567548-util\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:37:29.801166 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:29.801161 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d7a4773-e094-4cbe-b3a9-f907bc567548-bundle\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:37:29.801166 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:29.801171 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvwgj\" (UniqueName: \"kubernetes.io/projected/5d7a4773-e094-4cbe-b3a9-f907bc567548-kube-api-access-gvwgj\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:37:30.457560 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:30.457519 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd" event={"ID":"5d7a4773-e094-4cbe-b3a9-f907bc567548","Type":"ContainerDied","Data":"7d44b2807f27b720fb81ab546101aa48e0222e3400350cb5a2a84783babe72f9"} May 26 19:37:30.457560 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:30.457553 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d44b2807f27b720fb81ab546101aa48e0222e3400350cb5a2a84783babe72f9" May 26 19:37:30.457728 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:37:30.457593 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw4hpd" May 26 19:38:26.014071 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.014036 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc"] May 26 19:38:26.014528 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.014421 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d7a4773-e094-4cbe-b3a9-f907bc567548" containerName="util" May 26 19:38:26.014528 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.014433 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d7a4773-e094-4cbe-b3a9-f907bc567548" containerName="util" May 26 19:38:26.014528 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.014446 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d7a4773-e094-4cbe-b3a9-f907bc567548" containerName="extract" May 26 19:38:26.014528 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.014451 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d7a4773-e094-4cbe-b3a9-f907bc567548" containerName="extract" May 26 19:38:26.014528 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.014465 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d7a4773-e094-4cbe-b3a9-f907bc567548" containerName="pull" May 26 19:38:26.014528 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.014471 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d7a4773-e094-4cbe-b3a9-f907bc567548" containerName="pull" May 26 19:38:26.014528 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.014524 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="5d7a4773-e094-4cbe-b3a9-f907bc567548" containerName="extract" May 26 19:38:26.018509 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.018493 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc" May 26 19:38:26.021149 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.021126 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 26 19:38:26.021346 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.021149 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pb8hs\"" May 26 19:38:26.022187 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.022165 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 26 19:38:26.025306 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.025283 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc"] May 26 19:38:26.080904 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.080869 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7856r\" (UniqueName: \"kubernetes.io/projected/f5deffd3-7ce2-4a96-ae8e-b18c404a2f82-kube-api-access-7856r\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc\" (UID: \"f5deffd3-7ce2-4a96-ae8e-b18c404a2f82\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc" May 26 19:38:26.081066 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.080912 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5deffd3-7ce2-4a96-ae8e-b18c404a2f82-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc\" (UID: \"f5deffd3-7ce2-4a96-ae8e-b18c404a2f82\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc" May 26 19:38:26.081066 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.080984 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5deffd3-7ce2-4a96-ae8e-b18c404a2f82-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc\" (UID: \"f5deffd3-7ce2-4a96-ae8e-b18c404a2f82\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc" May 26 19:38:26.182948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.182366 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5deffd3-7ce2-4a96-ae8e-b18c404a2f82-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc\" (UID: \"f5deffd3-7ce2-4a96-ae8e-b18c404a2f82\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc" May 26 19:38:26.182948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.182481 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7856r\" (UniqueName: \"kubernetes.io/projected/f5deffd3-7ce2-4a96-ae8e-b18c404a2f82-kube-api-access-7856r\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc\" (UID: \"f5deffd3-7ce2-4a96-ae8e-b18c404a2f82\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc" May 26 19:38:26.182948 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.182534 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5deffd3-7ce2-4a96-ae8e-b18c404a2f82-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc\" (UID: \"f5deffd3-7ce2-4a96-ae8e-b18c404a2f82\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc" May 26 19:38:26.183219 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.183171 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5deffd3-7ce2-4a96-ae8e-b18c404a2f82-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc\" (UID: \"f5deffd3-7ce2-4a96-ae8e-b18c404a2f82\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc" May 26 19:38:26.187380 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.183379 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5deffd3-7ce2-4a96-ae8e-b18c404a2f82-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc\" (UID: \"f5deffd3-7ce2-4a96-ae8e-b18c404a2f82\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc" May 26 19:38:26.190270 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.190249 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7856r\" (UniqueName: \"kubernetes.io/projected/f5deffd3-7ce2-4a96-ae8e-b18c404a2f82-kube-api-access-7856r\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc\" (UID: \"f5deffd3-7ce2-4a96-ae8e-b18c404a2f82\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc" May 26 19:38:26.328891 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.328810 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc" May 26 19:38:26.454466 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.454441 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc"] May 26 19:38:26.456385 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:38:26.456357 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5deffd3_7ce2_4a96_ae8e_b18c404a2f82.slice/crio-11d3e8417d71417f293019c2f5f114771fae43cc2672989a339ddd731b7bbd52 WatchSource:0}: Error finding container 11d3e8417d71417f293019c2f5f114771fae43cc2672989a339ddd731b7bbd52: Status 404 returned error can't find the container with id 11d3e8417d71417f293019c2f5f114771fae43cc2672989a339ddd731b7bbd52 May 26 19:38:26.611349 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.611277 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k"] May 26 19:38:26.614740 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.614724 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k" May 26 19:38:26.620902 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.620879 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k"] May 26 19:38:26.662161 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.662130 2578 generic.go:358] "Generic (PLEG): container finished" podID="f5deffd3-7ce2-4a96-ae8e-b18c404a2f82" containerID="c742358823fc3f78ae6b5f39208a2ee2d2e325d687801da35664e1f6557a7b4c" exitCode=0 May 26 19:38:26.662298 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.662210 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc" event={"ID":"f5deffd3-7ce2-4a96-ae8e-b18c404a2f82","Type":"ContainerDied","Data":"c742358823fc3f78ae6b5f39208a2ee2d2e325d687801da35664e1f6557a7b4c"} May 26 19:38:26.662298 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.662240 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc" event={"ID":"f5deffd3-7ce2-4a96-ae8e-b18c404a2f82","Type":"ContainerStarted","Data":"11d3e8417d71417f293019c2f5f114771fae43cc2672989a339ddd731b7bbd52"} May 26 19:38:26.686653 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.686623 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7c8df20-322f-42cf-9781-f05b4325c9a1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k\" (UID: \"a7c8df20-322f-42cf-9781-f05b4325c9a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k" May 26 19:38:26.686762 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.686683 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7c8df20-322f-42cf-9781-f05b4325c9a1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k\" (UID: \"a7c8df20-322f-42cf-9781-f05b4325c9a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k" May 26 19:38:26.686852 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.686830 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmt5l\" (UniqueName: \"kubernetes.io/projected/a7c8df20-322f-42cf-9781-f05b4325c9a1-kube-api-access-rmt5l\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k\" (UID: \"a7c8df20-322f-42cf-9781-f05b4325c9a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k" May 26 19:38:26.787996 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.787969 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rmt5l\" (UniqueName: \"kubernetes.io/projected/a7c8df20-322f-42cf-9781-f05b4325c9a1-kube-api-access-rmt5l\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k\" (UID: \"a7c8df20-322f-42cf-9781-f05b4325c9a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k" May 26 19:38:26.788144 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.788006 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7c8df20-322f-42cf-9781-f05b4325c9a1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k\" (UID: \"a7c8df20-322f-42cf-9781-f05b4325c9a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k" May 26 19:38:26.788144 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.788033 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7c8df20-322f-42cf-9781-f05b4325c9a1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k\" (UID: \"a7c8df20-322f-42cf-9781-f05b4325c9a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k" May 26 19:38:26.788438 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.788416 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7c8df20-322f-42cf-9781-f05b4325c9a1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k\" (UID: \"a7c8df20-322f-42cf-9781-f05b4325c9a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k" May 26 19:38:26.788523 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.788444 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7c8df20-322f-42cf-9781-f05b4325c9a1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k\" (UID: \"a7c8df20-322f-42cf-9781-f05b4325c9a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k" May 26 19:38:26.795526 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.795505 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmt5l\" (UniqueName: \"kubernetes.io/projected/a7c8df20-322f-42cf-9781-f05b4325c9a1-kube-api-access-rmt5l\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k\" (UID: \"a7c8df20-322f-42cf-9781-f05b4325c9a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k" May 26 19:38:26.926543 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:26.926516 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k" May 26 19:38:27.011002 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.010967 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf"] May 26 19:38:27.016478 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.016455 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf" May 26 19:38:27.023146 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.023119 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf"] May 26 19:38:27.056001 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.055976 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k"] May 26 19:38:27.057948 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:38:27.057920 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7c8df20_322f_42cf_9781_f05b4325c9a1.slice/crio-161ebe2cc7ba2b5cadcf3fdb5c8ad4ab4cd8d602139e47f744690009d99913d5 WatchSource:0}: Error finding container 161ebe2cc7ba2b5cadcf3fdb5c8ad4ab4cd8d602139e47f744690009d99913d5: Status 404 returned error can't find the container with id 161ebe2cc7ba2b5cadcf3fdb5c8ad4ab4cd8d602139e47f744690009d99913d5 May 26 19:38:27.090411 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.090385 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5c6a83e-3823-4d5d-93c4-62801527549b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf\" (UID: \"c5c6a83e-3823-4d5d-93c4-62801527549b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf" May 26 19:38:27.090515 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.090434 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d964j\" (UniqueName: \"kubernetes.io/projected/c5c6a83e-3823-4d5d-93c4-62801527549b-kube-api-access-d964j\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf\" (UID: \"c5c6a83e-3823-4d5d-93c4-62801527549b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf" May 26 19:38:27.090515 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.090465 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5c6a83e-3823-4d5d-93c4-62801527549b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf\" (UID: \"c5c6a83e-3823-4d5d-93c4-62801527549b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf" May 26 19:38:27.191262 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.191184 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5c6a83e-3823-4d5d-93c4-62801527549b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf\" (UID: \"c5c6a83e-3823-4d5d-93c4-62801527549b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf" May 26 19:38:27.191262 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.191249 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d964j\" (UniqueName: \"kubernetes.io/projected/c5c6a83e-3823-4d5d-93c4-62801527549b-kube-api-access-d964j\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf\" (UID: \"c5c6a83e-3823-4d5d-93c4-62801527549b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf" May 26 19:38:27.191493 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.191280 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5c6a83e-3823-4d5d-93c4-62801527549b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf\" (UID: \"c5c6a83e-3823-4d5d-93c4-62801527549b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf" May 26 19:38:27.191607 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.191584 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5c6a83e-3823-4d5d-93c4-62801527549b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf\" (UID: \"c5c6a83e-3823-4d5d-93c4-62801527549b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf" May 26 19:38:27.191671 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.191629 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5c6a83e-3823-4d5d-93c4-62801527549b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf\" (UID: \"c5c6a83e-3823-4d5d-93c4-62801527549b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf" May 26 19:38:27.199639 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.199610 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d964j\" (UniqueName: \"kubernetes.io/projected/c5c6a83e-3823-4d5d-93c4-62801527549b-kube-api-access-d964j\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf\" (UID: \"c5c6a83e-3823-4d5d-93c4-62801527549b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf" May 26 19:38:27.328367 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.328312 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf" May 26 19:38:27.421666 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.421642 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm"] May 26 19:38:27.425497 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.425475 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm" May 26 19:38:27.431850 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.431826 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm"] May 26 19:38:27.494418 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.494386 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3a1dc18-5889-42d2-9c98-a068167022cb-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm\" (UID: \"c3a1dc18-5889-42d2-9c98-a068167022cb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm" May 26 19:38:27.494559 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.494490 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3a1dc18-5889-42d2-9c98-a068167022cb-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm\" (UID: \"c3a1dc18-5889-42d2-9c98-a068167022cb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm" May 26 19:38:27.494559 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.494535 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r5w4\" (UniqueName: \"kubernetes.io/projected/c3a1dc18-5889-42d2-9c98-a068167022cb-kube-api-access-5r5w4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm\" (UID: \"c3a1dc18-5889-42d2-9c98-a068167022cb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm" May 26 19:38:27.500241 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.500219 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf"] May 26 19:38:27.502013 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:38:27.501987 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5c6a83e_3823_4d5d_93c4_62801527549b.slice/crio-03e9b26cfe9bcbc888510ce6ddc232317a013e9b68f4498368669224d422848f WatchSource:0}: Error finding container 03e9b26cfe9bcbc888510ce6ddc232317a013e9b68f4498368669224d422848f: Status 404 returned error can't find the container with id 03e9b26cfe9bcbc888510ce6ddc232317a013e9b68f4498368669224d422848f May 26 19:38:27.595271 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.595245 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3a1dc18-5889-42d2-9c98-a068167022cb-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm\" (UID: \"c3a1dc18-5889-42d2-9c98-a068167022cb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm" May 26 19:38:27.595370 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.595288 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5r5w4\" (UniqueName: \"kubernetes.io/projected/c3a1dc18-5889-42d2-9c98-a068167022cb-kube-api-access-5r5w4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm\" (UID: \"c3a1dc18-5889-42d2-9c98-a068167022cb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm" May 26 19:38:27.595370 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.595357 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3a1dc18-5889-42d2-9c98-a068167022cb-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm\" (UID: \"c3a1dc18-5889-42d2-9c98-a068167022cb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm" May 26 19:38:27.595578 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.595561 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3a1dc18-5889-42d2-9c98-a068167022cb-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm\" (UID: \"c3a1dc18-5889-42d2-9c98-a068167022cb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm" May 26 19:38:27.595620 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.595610 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3a1dc18-5889-42d2-9c98-a068167022cb-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm\" (UID: \"c3a1dc18-5889-42d2-9c98-a068167022cb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm" May 26 19:38:27.602915 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.602885 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r5w4\" (UniqueName: \"kubernetes.io/projected/c3a1dc18-5889-42d2-9c98-a068167022cb-kube-api-access-5r5w4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm\" (UID: \"c3a1dc18-5889-42d2-9c98-a068167022cb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm" May 26 19:38:27.667297 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.667259 2578 generic.go:358] "Generic (PLEG): container finished" podID="c5c6a83e-3823-4d5d-93c4-62801527549b" containerID="ea0f93aac4a95cfa65671c4f3e4bb0113d62b7ace166d623c0a82fc1be86260d" exitCode=0 May 26 19:38:27.667460 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.667352 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf" event={"ID":"c5c6a83e-3823-4d5d-93c4-62801527549b","Type":"ContainerDied","Data":"ea0f93aac4a95cfa65671c4f3e4bb0113d62b7ace166d623c0a82fc1be86260d"} May 26 19:38:27.667460 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.667385 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf" event={"ID":"c5c6a83e-3823-4d5d-93c4-62801527549b","Type":"ContainerStarted","Data":"03e9b26cfe9bcbc888510ce6ddc232317a013e9b68f4498368669224d422848f"} May 26 19:38:27.669077 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.669057 2578 generic.go:358] "Generic (PLEG): container finished" podID="f5deffd3-7ce2-4a96-ae8e-b18c404a2f82" containerID="aed5493626a11307a24a70fc8779b16e25b3521db95de254e82103fc4de406c3" exitCode=0 May 26 19:38:27.669178 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.669095 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc" event={"ID":"f5deffd3-7ce2-4a96-ae8e-b18c404a2f82","Type":"ContainerDied","Data":"aed5493626a11307a24a70fc8779b16e25b3521db95de254e82103fc4de406c3"} May 26 19:38:27.670421 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.670397 2578 generic.go:358] "Generic (PLEG): container finished" podID="a7c8df20-322f-42cf-9781-f05b4325c9a1" containerID="3232836efe4f62d518cd2f4b92d9de447fa9e415aff31bc88c7640c119eb888d" exitCode=0 May 26 19:38:27.670515 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.670460 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k" event={"ID":"a7c8df20-322f-42cf-9781-f05b4325c9a1","Type":"ContainerDied","Data":"3232836efe4f62d518cd2f4b92d9de447fa9e415aff31bc88c7640c119eb888d"} May 26 19:38:27.670515 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.670484 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k" event={"ID":"a7c8df20-322f-42cf-9781-f05b4325c9a1","Type":"ContainerStarted","Data":"161ebe2cc7ba2b5cadcf3fdb5c8ad4ab4cd8d602139e47f744690009d99913d5"} May 26 19:38:27.758123 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.758095 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm" May 26 19:38:27.884869 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:27.884846 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm"] May 26 19:38:27.887453 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:38:27.887427 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a1dc18_5889_42d2_9c98_a068167022cb.slice/crio-8cdde1fe01c8b4938b190ae6cba5079e39ed1f4a2fa6029a029f61a4c6d68726 WatchSource:0}: Error finding container 8cdde1fe01c8b4938b190ae6cba5079e39ed1f4a2fa6029a029f61a4c6d68726: Status 404 returned error can't find the container with id 8cdde1fe01c8b4938b190ae6cba5079e39ed1f4a2fa6029a029f61a4c6d68726 May 26 19:38:28.676148 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:28.676116 2578 generic.go:358] "Generic (PLEG): container finished" podID="f5deffd3-7ce2-4a96-ae8e-b18c404a2f82" containerID="0355b9fc453ffd2fd11ec8d52a101da4ec35d4bf68d7ca9e28531a854708d9b1" exitCode=0 May 26 19:38:28.676570 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:28.676167 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc" event={"ID":"f5deffd3-7ce2-4a96-ae8e-b18c404a2f82","Type":"ContainerDied","Data":"0355b9fc453ffd2fd11ec8d52a101da4ec35d4bf68d7ca9e28531a854708d9b1"} May 26 19:38:28.678235 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:28.678215 2578 generic.go:358] "Generic (PLEG): container finished" podID="a7c8df20-322f-42cf-9781-f05b4325c9a1" containerID="6eb1ec49c5db37cddc929da5c85bb9876cdde4a25e9e2eeee6b2824ba2b997ae" exitCode=0 May 26 19:38:28.678376 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:28.678299 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k" event={"ID":"a7c8df20-322f-42cf-9781-f05b4325c9a1","Type":"ContainerDied","Data":"6eb1ec49c5db37cddc929da5c85bb9876cdde4a25e9e2eeee6b2824ba2b997ae"} May 26 19:38:28.680011 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:28.679941 2578 generic.go:358] "Generic (PLEG): container finished" podID="c5c6a83e-3823-4d5d-93c4-62801527549b" containerID="7cfaa37bd3c973ee7d0717f67c0675fd86bad1b7640c63553e2b530775dec8ec" exitCode=0 May 26 19:38:28.680011 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:28.679989 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf" event={"ID":"c5c6a83e-3823-4d5d-93c4-62801527549b","Type":"ContainerDied","Data":"7cfaa37bd3c973ee7d0717f67c0675fd86bad1b7640c63553e2b530775dec8ec"} May 26 19:38:28.681297 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:28.681277 2578 generic.go:358] "Generic (PLEG): container finished" podID="c3a1dc18-5889-42d2-9c98-a068167022cb" containerID="52ab17aea3c42ca15f9a3036485f1ee0ae451d04d0075c0b9dee8f2f28915825" exitCode=0 May 26 19:38:28.681411 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:28.681355 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm" event={"ID":"c3a1dc18-5889-42d2-9c98-a068167022cb","Type":"ContainerDied","Data":"52ab17aea3c42ca15f9a3036485f1ee0ae451d04d0075c0b9dee8f2f28915825"} May 26 19:38:28.681411 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:28.681379 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm" event={"ID":"c3a1dc18-5889-42d2-9c98-a068167022cb","Type":"ContainerStarted","Data":"8cdde1fe01c8b4938b190ae6cba5079e39ed1f4a2fa6029a029f61a4c6d68726"} May 26 19:38:29.687152 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:29.687124 2578 generic.go:358] "Generic (PLEG): container finished" podID="c5c6a83e-3823-4d5d-93c4-62801527549b" containerID="96b8b5de52ce2e788189ef53247e26ebaf8d6878b40b3d258b6972d830848348" exitCode=0 May 26 19:38:29.687544 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:29.687187 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf" event={"ID":"c5c6a83e-3823-4d5d-93c4-62801527549b","Type":"ContainerDied","Data":"96b8b5de52ce2e788189ef53247e26ebaf8d6878b40b3d258b6972d830848348"} May 26 19:38:29.688843 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:29.688817 2578 generic.go:358] "Generic (PLEG): container finished" podID="c3a1dc18-5889-42d2-9c98-a068167022cb" containerID="c30829862e7db2843704acb789c8969e206372744f12c8d439b9655b402ff941" exitCode=0 May 26 19:38:29.688962 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:29.688888 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm" event={"ID":"c3a1dc18-5889-42d2-9c98-a068167022cb","Type":"ContainerDied","Data":"c30829862e7db2843704acb789c8969e206372744f12c8d439b9655b402ff941"} May 26 19:38:29.690674 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:29.690650 2578 generic.go:358] "Generic (PLEG): container finished" podID="a7c8df20-322f-42cf-9781-f05b4325c9a1" containerID="8c4d1652e40367259c5a6fd763aa41f226ca281fb8c15758a315ff420d60f596" exitCode=0 May 26 19:38:29.690778 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:29.690749 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k" event={"ID":"a7c8df20-322f-42cf-9781-f05b4325c9a1","Type":"ContainerDied","Data":"8c4d1652e40367259c5a6fd763aa41f226ca281fb8c15758a315ff420d60f596"} May 26 19:38:29.822268 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:29.822236 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc" May 26 19:38:29.918854 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:29.918821 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7856r\" (UniqueName: \"kubernetes.io/projected/f5deffd3-7ce2-4a96-ae8e-b18c404a2f82-kube-api-access-7856r\") pod \"f5deffd3-7ce2-4a96-ae8e-b18c404a2f82\" (UID: \"f5deffd3-7ce2-4a96-ae8e-b18c404a2f82\") " May 26 19:38:29.919031 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:29.918904 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5deffd3-7ce2-4a96-ae8e-b18c404a2f82-util\") pod \"f5deffd3-7ce2-4a96-ae8e-b18c404a2f82\" (UID: \"f5deffd3-7ce2-4a96-ae8e-b18c404a2f82\") " May 26 19:38:29.919031 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:29.918993 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5deffd3-7ce2-4a96-ae8e-b18c404a2f82-bundle\") pod \"f5deffd3-7ce2-4a96-ae8e-b18c404a2f82\" (UID: \"f5deffd3-7ce2-4a96-ae8e-b18c404a2f82\") " May 26 19:38:29.919500 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:29.919475 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5deffd3-7ce2-4a96-ae8e-b18c404a2f82-bundle" (OuterVolumeSpecName: "bundle") pod "f5deffd3-7ce2-4a96-ae8e-b18c404a2f82" (UID: "f5deffd3-7ce2-4a96-ae8e-b18c404a2f82"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:38:29.921051 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:29.921024 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5deffd3-7ce2-4a96-ae8e-b18c404a2f82-kube-api-access-7856r" (OuterVolumeSpecName: "kube-api-access-7856r") pod "f5deffd3-7ce2-4a96-ae8e-b18c404a2f82" (UID: "f5deffd3-7ce2-4a96-ae8e-b18c404a2f82"). InnerVolumeSpecName "kube-api-access-7856r". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:38:29.923798 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:29.923766 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5deffd3-7ce2-4a96-ae8e-b18c404a2f82-util" (OuterVolumeSpecName: "util") pod "f5deffd3-7ce2-4a96-ae8e-b18c404a2f82" (UID: "f5deffd3-7ce2-4a96-ae8e-b18c404a2f82"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:38:30.019899 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:30.019863 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5deffd3-7ce2-4a96-ae8e-b18c404a2f82-bundle\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:38:30.019899 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:30.019892 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7856r\" (UniqueName: \"kubernetes.io/projected/f5deffd3-7ce2-4a96-ae8e-b18c404a2f82-kube-api-access-7856r\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:38:30.019899 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:30.019903 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5deffd3-7ce2-4a96-ae8e-b18c404a2f82-util\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:38:30.697232 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:30.697199 2578 generic.go:358] "Generic (PLEG): container finished" podID="c3a1dc18-5889-42d2-9c98-a068167022cb" containerID="3628946eceba6abf62ba5b2db21cede501477e8a752b5a686933a68103ba4163" exitCode=0 May 26 19:38:30.697632 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:30.697290 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm" event={"ID":"c3a1dc18-5889-42d2-9c98-a068167022cb","Type":"ContainerDied","Data":"3628946eceba6abf62ba5b2db21cede501477e8a752b5a686933a68103ba4163"} May 26 19:38:30.698967 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:30.698944 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc" event={"ID":"f5deffd3-7ce2-4a96-ae8e-b18c404a2f82","Type":"ContainerDied","Data":"11d3e8417d71417f293019c2f5f114771fae43cc2672989a339ddd731b7bbd52"} May 26 19:38:30.699042 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:30.698975 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11d3e8417d71417f293019c2f5f114771fae43cc2672989a339ddd731b7bbd52" May 26 19:38:30.699673 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:30.699261 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc" May 26 19:38:30.835350 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:30.835312 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf" May 26 19:38:30.868701 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:30.868681 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k" May 26 19:38:30.926621 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:30.926595 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmt5l\" (UniqueName: \"kubernetes.io/projected/a7c8df20-322f-42cf-9781-f05b4325c9a1-kube-api-access-rmt5l\") pod \"a7c8df20-322f-42cf-9781-f05b4325c9a1\" (UID: \"a7c8df20-322f-42cf-9781-f05b4325c9a1\") " May 26 19:38:30.926783 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:30.926635 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5c6a83e-3823-4d5d-93c4-62801527549b-bundle\") pod \"c5c6a83e-3823-4d5d-93c4-62801527549b\" (UID: \"c5c6a83e-3823-4d5d-93c4-62801527549b\") " May 26 19:38:30.926783 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:30.926667 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7c8df20-322f-42cf-9781-f05b4325c9a1-bundle\") pod \"a7c8df20-322f-42cf-9781-f05b4325c9a1\" (UID: \"a7c8df20-322f-42cf-9781-f05b4325c9a1\") " May 26 19:38:30.926783 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:30.926683 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5c6a83e-3823-4d5d-93c4-62801527549b-util\") pod \"c5c6a83e-3823-4d5d-93c4-62801527549b\" (UID: \"c5c6a83e-3823-4d5d-93c4-62801527549b\") " May 26 19:38:30.926783 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:30.926732 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7c8df20-322f-42cf-9781-f05b4325c9a1-util\") pod \"a7c8df20-322f-42cf-9781-f05b4325c9a1\" (UID: \"a7c8df20-322f-42cf-9781-f05b4325c9a1\") " May 26 19:38:30.926783 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:30.926773 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d964j\" (UniqueName: \"kubernetes.io/projected/c5c6a83e-3823-4d5d-93c4-62801527549b-kube-api-access-d964j\") pod \"c5c6a83e-3823-4d5d-93c4-62801527549b\" (UID: \"c5c6a83e-3823-4d5d-93c4-62801527549b\") " May 26 19:38:30.927241 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:30.927193 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7c8df20-322f-42cf-9781-f05b4325c9a1-bundle" (OuterVolumeSpecName: "bundle") pod "a7c8df20-322f-42cf-9781-f05b4325c9a1" (UID: "a7c8df20-322f-42cf-9781-f05b4325c9a1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:38:30.927448 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:30.927422 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5c6a83e-3823-4d5d-93c4-62801527549b-bundle" (OuterVolumeSpecName: "bundle") pod "c5c6a83e-3823-4d5d-93c4-62801527549b" (UID: "c5c6a83e-3823-4d5d-93c4-62801527549b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:38:30.928849 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:30.928826 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7c8df20-322f-42cf-9781-f05b4325c9a1-kube-api-access-rmt5l" (OuterVolumeSpecName: "kube-api-access-rmt5l") pod "a7c8df20-322f-42cf-9781-f05b4325c9a1" (UID: "a7c8df20-322f-42cf-9781-f05b4325c9a1"). InnerVolumeSpecName "kube-api-access-rmt5l". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:38:30.928943 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:30.928877 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5c6a83e-3823-4d5d-93c4-62801527549b-kube-api-access-d964j" (OuterVolumeSpecName: "kube-api-access-d964j") pod "c5c6a83e-3823-4d5d-93c4-62801527549b" (UID: "c5c6a83e-3823-4d5d-93c4-62801527549b"). InnerVolumeSpecName "kube-api-access-d964j". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:38:30.931851 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:30.931812 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5c6a83e-3823-4d5d-93c4-62801527549b-util" (OuterVolumeSpecName: "util") pod "c5c6a83e-3823-4d5d-93c4-62801527549b" (UID: "c5c6a83e-3823-4d5d-93c4-62801527549b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:38:30.932428 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:30.932405 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7c8df20-322f-42cf-9781-f05b4325c9a1-util" (OuterVolumeSpecName: "util") pod "a7c8df20-322f-42cf-9781-f05b4325c9a1" (UID: "a7c8df20-322f-42cf-9781-f05b4325c9a1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:38:31.028241 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:31.028163 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmt5l\" (UniqueName: \"kubernetes.io/projected/a7c8df20-322f-42cf-9781-f05b4325c9a1-kube-api-access-rmt5l\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:38:31.028241 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:31.028192 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5c6a83e-3823-4d5d-93c4-62801527549b-bundle\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:38:31.028241 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:31.028203 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7c8df20-322f-42cf-9781-f05b4325c9a1-bundle\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:38:31.028241 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:31.028211 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5c6a83e-3823-4d5d-93c4-62801527549b-util\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:38:31.028241 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:31.028219 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7c8df20-322f-42cf-9781-f05b4325c9a1-util\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:38:31.028241 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:31.028228 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d964j\" (UniqueName: \"kubernetes.io/projected/c5c6a83e-3823-4d5d-93c4-62801527549b-kube-api-access-d964j\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:38:31.705482 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:31.705443 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k" event={"ID":"a7c8df20-322f-42cf-9781-f05b4325c9a1","Type":"ContainerDied","Data":"161ebe2cc7ba2b5cadcf3fdb5c8ad4ab4cd8d602139e47f744690009d99913d5"} May 26 19:38:31.705482 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:31.705466 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k" May 26 19:38:31.705482 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:31.705483 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="161ebe2cc7ba2b5cadcf3fdb5c8ad4ab4cd8d602139e47f744690009d99913d5" May 26 19:38:31.707250 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:31.707228 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf" May 26 19:38:31.707250 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:31.707246 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf" event={"ID":"c5c6a83e-3823-4d5d-93c4-62801527549b","Type":"ContainerDied","Data":"03e9b26cfe9bcbc888510ce6ddc232317a013e9b68f4498368669224d422848f"} May 26 19:38:31.707458 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:31.707268 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03e9b26cfe9bcbc888510ce6ddc232317a013e9b68f4498368669224d422848f" May 26 19:38:31.841626 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:31.841595 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm" May 26 19:38:31.935409 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:31.935375 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5r5w4\" (UniqueName: \"kubernetes.io/projected/c3a1dc18-5889-42d2-9c98-a068167022cb-kube-api-access-5r5w4\") pod \"c3a1dc18-5889-42d2-9c98-a068167022cb\" (UID: \"c3a1dc18-5889-42d2-9c98-a068167022cb\") " May 26 19:38:31.935603 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:31.935416 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3a1dc18-5889-42d2-9c98-a068167022cb-util\") pod \"c3a1dc18-5889-42d2-9c98-a068167022cb\" (UID: \"c3a1dc18-5889-42d2-9c98-a068167022cb\") " May 26 19:38:31.935603 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:31.935503 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3a1dc18-5889-42d2-9c98-a068167022cb-bundle\") pod \"c3a1dc18-5889-42d2-9c98-a068167022cb\" (UID: \"c3a1dc18-5889-42d2-9c98-a068167022cb\") " May 26 19:38:31.935956 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:31.935924 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3a1dc18-5889-42d2-9c98-a068167022cb-bundle" (OuterVolumeSpecName: "bundle") pod "c3a1dc18-5889-42d2-9c98-a068167022cb" (UID: "c3a1dc18-5889-42d2-9c98-a068167022cb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:38:31.937594 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:31.937571 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3a1dc18-5889-42d2-9c98-a068167022cb-kube-api-access-5r5w4" (OuterVolumeSpecName: "kube-api-access-5r5w4") pod "c3a1dc18-5889-42d2-9c98-a068167022cb" (UID: "c3a1dc18-5889-42d2-9c98-a068167022cb"). InnerVolumeSpecName "kube-api-access-5r5w4". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:38:31.943385 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:31.943363 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3a1dc18-5889-42d2-9c98-a068167022cb-util" (OuterVolumeSpecName: "util") pod "c3a1dc18-5889-42d2-9c98-a068167022cb" (UID: "c3a1dc18-5889-42d2-9c98-a068167022cb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:38:32.036442 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:32.036367 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5r5w4\" (UniqueName: \"kubernetes.io/projected/c3a1dc18-5889-42d2-9c98-a068167022cb-kube-api-access-5r5w4\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:38:32.036442 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:32.036394 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3a1dc18-5889-42d2-9c98-a068167022cb-util\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:38:32.036442 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:32.036407 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3a1dc18-5889-42d2-9c98-a068167022cb-bundle\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:38:32.718882 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:32.718844 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm" event={"ID":"c3a1dc18-5889-42d2-9c98-a068167022cb","Type":"ContainerDied","Data":"8cdde1fe01c8b4938b190ae6cba5079e39ed1f4a2fa6029a029f61a4c6d68726"} May 26 19:38:32.719252 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:32.718888 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8cdde1fe01c8b4938b190ae6cba5079e39ed1f4a2fa6029a029f61a4c6d68726" May 26 19:38:32.719252 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:38:32.718888 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm" May 26 19:39:03.172187 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172155 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vfn4l"] May 26 19:39:03.172668 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172594 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7c8df20-322f-42cf-9781-f05b4325c9a1" containerName="util" May 26 19:39:03.172668 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172612 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7c8df20-322f-42cf-9781-f05b4325c9a1" containerName="util" May 26 19:39:03.172668 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172634 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5deffd3-7ce2-4a96-ae8e-b18c404a2f82" containerName="extract" May 26 19:39:03.172668 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172643 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5deffd3-7ce2-4a96-ae8e-b18c404a2f82" containerName="extract" May 26 19:39:03.172668 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172651 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3a1dc18-5889-42d2-9c98-a068167022cb" containerName="pull" May 26 19:39:03.172668 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172657 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3a1dc18-5889-42d2-9c98-a068167022cb" containerName="pull" May 26 19:39:03.172668 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172667 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5deffd3-7ce2-4a96-ae8e-b18c404a2f82" containerName="util" May 26 19:39:03.172668 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172672 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5deffd3-7ce2-4a96-ae8e-b18c404a2f82" containerName="util" May 26 19:39:03.172924 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172678 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5deffd3-7ce2-4a96-ae8e-b18c404a2f82" containerName="pull" May 26 19:39:03.172924 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172683 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5deffd3-7ce2-4a96-ae8e-b18c404a2f82" containerName="pull" May 26 19:39:03.172924 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172688 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3a1dc18-5889-42d2-9c98-a068167022cb" containerName="extract" May 26 19:39:03.172924 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172693 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3a1dc18-5889-42d2-9c98-a068167022cb" containerName="extract" May 26 19:39:03.172924 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172707 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7c8df20-322f-42cf-9781-f05b4325c9a1" containerName="extract" May 26 19:39:03.172924 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172713 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7c8df20-322f-42cf-9781-f05b4325c9a1" containerName="extract" May 26 19:39:03.172924 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172718 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5c6a83e-3823-4d5d-93c4-62801527549b" containerName="pull" May 26 19:39:03.172924 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172723 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5c6a83e-3823-4d5d-93c4-62801527549b" containerName="pull" May 26 19:39:03.172924 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172728 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5c6a83e-3823-4d5d-93c4-62801527549b" containerName="util" May 26 19:39:03.172924 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172733 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5c6a83e-3823-4d5d-93c4-62801527549b" containerName="util" May 26 19:39:03.172924 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172738 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7c8df20-322f-42cf-9781-f05b4325c9a1" containerName="pull" May 26 19:39:03.172924 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172742 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7c8df20-322f-42cf-9781-f05b4325c9a1" containerName="pull" May 26 19:39:03.172924 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172748 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5c6a83e-3823-4d5d-93c4-62801527549b" containerName="extract" May 26 19:39:03.172924 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172752 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5c6a83e-3823-4d5d-93c4-62801527549b" containerName="extract" May 26 19:39:03.172924 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172760 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3a1dc18-5889-42d2-9c98-a068167022cb" containerName="util" May 26 19:39:03.172924 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172765 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3a1dc18-5889-42d2-9c98-a068167022cb" containerName="util" May 26 19:39:03.172924 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172819 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="a7c8df20-322f-42cf-9781-f05b4325c9a1" containerName="extract" May 26 19:39:03.172924 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172828 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3a1dc18-5889-42d2-9c98-a068167022cb" containerName="extract" May 26 19:39:03.172924 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172837 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="c5c6a83e-3823-4d5d-93c4-62801527549b" containerName="extract" May 26 19:39:03.172924 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.172845 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="f5deffd3-7ce2-4a96-ae8e-b18c404a2f82" containerName="extract" May 26 19:39:03.175758 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.175743 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vfn4l" May 26 19:39:03.178288 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.178257 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 26 19:39:03.178475 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.178267 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 26 19:39:03.179290 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.179268 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 26 19:39:03.179447 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.179288 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 26 19:39:03.179447 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.179270 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pb8hs\"" May 26 19:39:03.182055 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.182033 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vfn4l"] May 26 19:39:03.308041 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.308005 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/625174be-714e-4a82-b33b-dfe1709752c3-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-vfn4l\" (UID: \"625174be-714e-4a82-b33b-dfe1709752c3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vfn4l" May 26 19:39:03.308216 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.308084 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/625174be-714e-4a82-b33b-dfe1709752c3-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-vfn4l\" (UID: \"625174be-714e-4a82-b33b-dfe1709752c3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vfn4l" May 26 19:39:03.308216 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.308153 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjczw\" (UniqueName: \"kubernetes.io/projected/625174be-714e-4a82-b33b-dfe1709752c3-kube-api-access-tjczw\") pod \"kuadrant-console-plugin-6cb54b5c86-vfn4l\" (UID: \"625174be-714e-4a82-b33b-dfe1709752c3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vfn4l" May 26 19:39:03.409463 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.409433 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tjczw\" (UniqueName: \"kubernetes.io/projected/625174be-714e-4a82-b33b-dfe1709752c3-kube-api-access-tjczw\") pod \"kuadrant-console-plugin-6cb54b5c86-vfn4l\" (UID: \"625174be-714e-4a82-b33b-dfe1709752c3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vfn4l" May 26 19:39:03.409629 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.409492 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/625174be-714e-4a82-b33b-dfe1709752c3-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-vfn4l\" (UID: \"625174be-714e-4a82-b33b-dfe1709752c3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vfn4l" May 26 19:39:03.409629 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.409548 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/625174be-714e-4a82-b33b-dfe1709752c3-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-vfn4l\" (UID: \"625174be-714e-4a82-b33b-dfe1709752c3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vfn4l" May 26 19:39:03.410158 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.410129 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/625174be-714e-4a82-b33b-dfe1709752c3-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-vfn4l\" (UID: \"625174be-714e-4a82-b33b-dfe1709752c3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vfn4l" May 26 19:39:03.411830 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.411813 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/625174be-714e-4a82-b33b-dfe1709752c3-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-vfn4l\" (UID: \"625174be-714e-4a82-b33b-dfe1709752c3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vfn4l" May 26 19:39:03.417193 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.417171 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjczw\" (UniqueName: \"kubernetes.io/projected/625174be-714e-4a82-b33b-dfe1709752c3-kube-api-access-tjczw\") pod \"kuadrant-console-plugin-6cb54b5c86-vfn4l\" (UID: \"625174be-714e-4a82-b33b-dfe1709752c3\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vfn4l" May 26 19:39:03.485117 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.485046 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vfn4l" May 26 19:39:03.634724 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.634688 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vfn4l"] May 26 19:39:03.636938 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:39:03.636904 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod625174be_714e_4a82_b33b_dfe1709752c3.slice/crio-6c3b76ba1f87990576015886f86d2bca9ee15fd95895c0a2424f9d27eeadeff9 WatchSource:0}: Error finding container 6c3b76ba1f87990576015886f86d2bca9ee15fd95895c0a2424f9d27eeadeff9: Status 404 returned error can't find the container with id 6c3b76ba1f87990576015886f86d2bca9ee15fd95895c0a2424f9d27eeadeff9 May 26 19:39:03.843902 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:03.843818 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vfn4l" event={"ID":"625174be-714e-4a82-b33b-dfe1709752c3","Type":"ContainerStarted","Data":"6c3b76ba1f87990576015886f86d2bca9ee15fd95895c0a2424f9d27eeadeff9"} May 26 19:39:27.954784 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:27.954739 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vfn4l" event={"ID":"625174be-714e-4a82-b33b-dfe1709752c3","Type":"ContainerStarted","Data":"319aec2eae647111449de988ccf0f30cd516d37bd861cced84bb8ba943f6097b"} May 26 19:39:27.971811 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:27.971765 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-vfn4l" podStartSLOduration=1.211699174 podStartE2EDuration="24.971749504s" podCreationTimestamp="2026-05-26 19:39:03 +0000 UTC" firstStartedPulling="2026-05-26 19:39:03.638090077 +0000 UTC m=+808.172062842" lastFinishedPulling="2026-05-26 19:39:27.398140405 +0000 UTC m=+831.932113172" observedRunningTime="2026-05-26 19:39:27.968825678 +0000 UTC m=+832.502798462" watchObservedRunningTime="2026-05-26 19:39:27.971749504 +0000 UTC m=+832.505722288" May 26 19:39:51.829297 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:51.829260 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-h5jds"] May 26 19:39:51.940447 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:51.940409 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-h5jds"] May 26 19:39:51.940629 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:51.940530 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-h5jds" May 26 19:39:51.943191 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:51.943169 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rwnst\"" May 26 19:39:51.982356 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:51.982313 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-gnwxg"] May 26 19:39:52.012666 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:52.012628 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-gnwxg"] May 26 19:39:52.012666 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:52.012656 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-gnwxg" May 26 19:39:52.026371 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:52.026343 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzbrv\" (UniqueName: \"kubernetes.io/projected/af2b0a37-47ed-449c-b2ce-6f5e0a9ebe40-kube-api-access-nzbrv\") pod \"authorino-f99f4b5cd-h5jds\" (UID: \"af2b0a37-47ed-449c-b2ce-6f5e0a9ebe40\") " pod="kuadrant-system/authorino-f99f4b5cd-h5jds" May 26 19:39:52.127248 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:52.127176 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lgmm\" (UniqueName: \"kubernetes.io/projected/e95fa27d-cdf6-4b67-87ee-e0c2c9184bbc-kube-api-access-2lgmm\") pod \"authorino-7498df8756-gnwxg\" (UID: \"e95fa27d-cdf6-4b67-87ee-e0c2c9184bbc\") " pod="kuadrant-system/authorino-7498df8756-gnwxg" May 26 19:39:52.127248 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:52.127226 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nzbrv\" (UniqueName: \"kubernetes.io/projected/af2b0a37-47ed-449c-b2ce-6f5e0a9ebe40-kube-api-access-nzbrv\") pod \"authorino-f99f4b5cd-h5jds\" (UID: \"af2b0a37-47ed-449c-b2ce-6f5e0a9ebe40\") " pod="kuadrant-system/authorino-f99f4b5cd-h5jds" May 26 19:39:52.134782 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:52.134757 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzbrv\" (UniqueName: \"kubernetes.io/projected/af2b0a37-47ed-449c-b2ce-6f5e0a9ebe40-kube-api-access-nzbrv\") pod \"authorino-f99f4b5cd-h5jds\" (UID: \"af2b0a37-47ed-449c-b2ce-6f5e0a9ebe40\") " pod="kuadrant-system/authorino-f99f4b5cd-h5jds" May 26 19:39:52.228104 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:52.228068 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2lgmm\" (UniqueName: \"kubernetes.io/projected/e95fa27d-cdf6-4b67-87ee-e0c2c9184bbc-kube-api-access-2lgmm\") pod \"authorino-7498df8756-gnwxg\" (UID: \"e95fa27d-cdf6-4b67-87ee-e0c2c9184bbc\") " pod="kuadrant-system/authorino-7498df8756-gnwxg" May 26 19:39:52.235724 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:52.235700 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lgmm\" (UniqueName: \"kubernetes.io/projected/e95fa27d-cdf6-4b67-87ee-e0c2c9184bbc-kube-api-access-2lgmm\") pod \"authorino-7498df8756-gnwxg\" (UID: \"e95fa27d-cdf6-4b67-87ee-e0c2c9184bbc\") " pod="kuadrant-system/authorino-7498df8756-gnwxg" May 26 19:39:52.249488 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:52.249464 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-h5jds" May 26 19:39:52.321667 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:52.321641 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-gnwxg" May 26 19:39:52.382193 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:52.382172 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-h5jds"] May 26 19:39:52.385192 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:39:52.385164 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf2b0a37_47ed_449c_b2ce_6f5e0a9ebe40.slice/crio-efa74fa929251de00cfdeeeeaa86e2ab8dd210c9e7a0a5faff9085216bf14689 WatchSource:0}: Error finding container efa74fa929251de00cfdeeeeaa86e2ab8dd210c9e7a0a5faff9085216bf14689: Status 404 returned error can't find the container with id efa74fa929251de00cfdeeeeaa86e2ab8dd210c9e7a0a5faff9085216bf14689 May 26 19:39:52.386452 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:52.386433 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 19:39:52.465532 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:52.465502 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-gnwxg"] May 26 19:39:52.467043 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:39:52.467015 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode95fa27d_cdf6_4b67_87ee_e0c2c9184bbc.slice/crio-22132f17f4fbc5b44d3e233252a5aad6617ddc7ec6bb4b14b4ae0405fc37933e WatchSource:0}: Error finding container 22132f17f4fbc5b44d3e233252a5aad6617ddc7ec6bb4b14b4ae0405fc37933e: Status 404 returned error can't find the container with id 22132f17f4fbc5b44d3e233252a5aad6617ddc7ec6bb4b14b4ae0405fc37933e May 26 19:39:53.053936 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:53.053899 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-h5jds" event={"ID":"af2b0a37-47ed-449c-b2ce-6f5e0a9ebe40","Type":"ContainerStarted","Data":"efa74fa929251de00cfdeeeeaa86e2ab8dd210c9e7a0a5faff9085216bf14689"} May 26 19:39:53.055291 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:53.055253 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-gnwxg" event={"ID":"e95fa27d-cdf6-4b67-87ee-e0c2c9184bbc","Type":"ContainerStarted","Data":"22132f17f4fbc5b44d3e233252a5aad6617ddc7ec6bb4b14b4ae0405fc37933e"} May 26 19:39:58.079657 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:58.079621 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-gnwxg" event={"ID":"e95fa27d-cdf6-4b67-87ee-e0c2c9184bbc","Type":"ContainerStarted","Data":"bb5f3a393743eef276ae64b0123b71bb3a55ebe5e05117f707b1c0f6621bd8d4"} May 26 19:39:58.081092 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:58.081067 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-h5jds" event={"ID":"af2b0a37-47ed-449c-b2ce-6f5e0a9ebe40","Type":"ContainerStarted","Data":"04699dd921e8b57cfc84c427103e5576a77d9735508bc797852fcb0c0e02c14c"} May 26 19:39:58.094890 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:58.094851 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-gnwxg" podStartSLOduration=2.380913003 podStartE2EDuration="7.094839344s" podCreationTimestamp="2026-05-26 19:39:51 +0000 UTC" firstStartedPulling="2026-05-26 19:39:52.468548632 +0000 UTC m=+857.002521393" lastFinishedPulling="2026-05-26 19:39:57.182474972 +0000 UTC m=+861.716447734" observedRunningTime="2026-05-26 19:39:58.092422305 +0000 UTC m=+862.626395089" watchObservedRunningTime="2026-05-26 19:39:58.094839344 +0000 UTC m=+862.628812128" May 26 19:39:58.113643 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:58.113588 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-h5jds" podStartSLOduration=2.330396772 podStartE2EDuration="7.113573709s" podCreationTimestamp="2026-05-26 19:39:51 +0000 UTC" firstStartedPulling="2026-05-26 19:39:52.386554242 +0000 UTC m=+856.920527003" lastFinishedPulling="2026-05-26 19:39:57.169731179 +0000 UTC m=+861.703703940" observedRunningTime="2026-05-26 19:39:58.111393724 +0000 UTC m=+862.645366510" watchObservedRunningTime="2026-05-26 19:39:58.113573709 +0000 UTC m=+862.647546492" May 26 19:39:58.121937 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:39:58.121910 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-h5jds"] May 26 19:40:00.089642 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:00.089573 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-h5jds" podUID="af2b0a37-47ed-449c-b2ce-6f5e0a9ebe40" containerName="authorino" containerID="cri-o://04699dd921e8b57cfc84c427103e5576a77d9735508bc797852fcb0c0e02c14c" gracePeriod=30 May 26 19:40:00.325130 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:00.325103 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-h5jds" May 26 19:40:00.407592 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:00.407563 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzbrv\" (UniqueName: \"kubernetes.io/projected/af2b0a37-47ed-449c-b2ce-6f5e0a9ebe40-kube-api-access-nzbrv\") pod \"af2b0a37-47ed-449c-b2ce-6f5e0a9ebe40\" (UID: \"af2b0a37-47ed-449c-b2ce-6f5e0a9ebe40\") " May 26 19:40:00.409559 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:00.409528 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af2b0a37-47ed-449c-b2ce-6f5e0a9ebe40-kube-api-access-nzbrv" (OuterVolumeSpecName: "kube-api-access-nzbrv") pod "af2b0a37-47ed-449c-b2ce-6f5e0a9ebe40" (UID: "af2b0a37-47ed-449c-b2ce-6f5e0a9ebe40"). InnerVolumeSpecName "kube-api-access-nzbrv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:40:00.508553 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:00.508520 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzbrv\" (UniqueName: \"kubernetes.io/projected/af2b0a37-47ed-449c-b2ce-6f5e0a9ebe40-kube-api-access-nzbrv\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:40:01.095601 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:01.095562 2578 generic.go:358] "Generic (PLEG): container finished" podID="af2b0a37-47ed-449c-b2ce-6f5e0a9ebe40" containerID="04699dd921e8b57cfc84c427103e5576a77d9735508bc797852fcb0c0e02c14c" exitCode=0 May 26 19:40:01.096013 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:01.095608 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-h5jds" May 26 19:40:01.096013 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:01.095622 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-h5jds" event={"ID":"af2b0a37-47ed-449c-b2ce-6f5e0a9ebe40","Type":"ContainerDied","Data":"04699dd921e8b57cfc84c427103e5576a77d9735508bc797852fcb0c0e02c14c"} May 26 19:40:01.096013 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:01.095657 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-h5jds" event={"ID":"af2b0a37-47ed-449c-b2ce-6f5e0a9ebe40","Type":"ContainerDied","Data":"efa74fa929251de00cfdeeeeaa86e2ab8dd210c9e7a0a5faff9085216bf14689"} May 26 19:40:01.096013 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:01.095673 2578 scope.go:117] "RemoveContainer" containerID="04699dd921e8b57cfc84c427103e5576a77d9735508bc797852fcb0c0e02c14c" May 26 19:40:01.105540 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:01.105519 2578 scope.go:117] "RemoveContainer" containerID="04699dd921e8b57cfc84c427103e5576a77d9735508bc797852fcb0c0e02c14c" May 26 19:40:01.105806 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:40:01.105786 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04699dd921e8b57cfc84c427103e5576a77d9735508bc797852fcb0c0e02c14c\": container with ID starting with 04699dd921e8b57cfc84c427103e5576a77d9735508bc797852fcb0c0e02c14c not found: ID does not exist" containerID="04699dd921e8b57cfc84c427103e5576a77d9735508bc797852fcb0c0e02c14c" May 26 19:40:01.105849 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:01.105815 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04699dd921e8b57cfc84c427103e5576a77d9735508bc797852fcb0c0e02c14c"} err="failed to get container status \"04699dd921e8b57cfc84c427103e5576a77d9735508bc797852fcb0c0e02c14c\": rpc error: code = NotFound desc = could not find container \"04699dd921e8b57cfc84c427103e5576a77d9735508bc797852fcb0c0e02c14c\": container with ID starting with 04699dd921e8b57cfc84c427103e5576a77d9735508bc797852fcb0c0e02c14c not found: ID does not exist" May 26 19:40:01.117151 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:01.117122 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-h5jds"] May 26 19:40:01.119408 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:01.119390 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-h5jds"] May 26 19:40:02.109809 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:02.105698 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af2b0a37-47ed-449c-b2ce-6f5e0a9ebe40" path="/var/lib/kubelet/pods/af2b0a37-47ed-449c-b2ce-6f5e0a9ebe40/volumes" May 26 19:40:12.219017 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:12.218984 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-mzh9b"] May 26 19:40:12.219505 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:12.219386 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af2b0a37-47ed-449c-b2ce-6f5e0a9ebe40" containerName="authorino" May 26 19:40:12.219505 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:12.219399 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="af2b0a37-47ed-449c-b2ce-6f5e0a9ebe40" containerName="authorino" May 26 19:40:12.219505 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:12.219478 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="af2b0a37-47ed-449c-b2ce-6f5e0a9ebe40" containerName="authorino" May 26 19:40:12.222352 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:12.222314 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-mzh9b" May 26 19:40:12.224826 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:12.224803 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-k9dpz\"" May 26 19:40:12.224942 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:12.224925 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 26 19:40:12.229624 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:12.229604 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-mzh9b"] May 26 19:40:12.414697 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:12.414663 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szqfp\" (UniqueName: \"kubernetes.io/projected/829bcfac-ad3b-436d-9a9c-f9037404eba4-kube-api-access-szqfp\") pod \"postgres-68c4fbbd6f-mzh9b\" (UID: \"829bcfac-ad3b-436d-9a9c-f9037404eba4\") " pod="opendatahub/postgres-68c4fbbd6f-mzh9b" May 26 19:40:12.414864 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:12.414736 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/829bcfac-ad3b-436d-9a9c-f9037404eba4-data\") pod \"postgres-68c4fbbd6f-mzh9b\" (UID: \"829bcfac-ad3b-436d-9a9c-f9037404eba4\") " pod="opendatahub/postgres-68c4fbbd6f-mzh9b" May 26 19:40:12.515245 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:12.515152 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/829bcfac-ad3b-436d-9a9c-f9037404eba4-data\") pod \"postgres-68c4fbbd6f-mzh9b\" (UID: \"829bcfac-ad3b-436d-9a9c-f9037404eba4\") " pod="opendatahub/postgres-68c4fbbd6f-mzh9b" May 26 19:40:12.515245 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:12.515219 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-szqfp\" (UniqueName: \"kubernetes.io/projected/829bcfac-ad3b-436d-9a9c-f9037404eba4-kube-api-access-szqfp\") pod \"postgres-68c4fbbd6f-mzh9b\" (UID: \"829bcfac-ad3b-436d-9a9c-f9037404eba4\") " pod="opendatahub/postgres-68c4fbbd6f-mzh9b" May 26 19:40:12.515613 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:12.515595 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/829bcfac-ad3b-436d-9a9c-f9037404eba4-data\") pod \"postgres-68c4fbbd6f-mzh9b\" (UID: \"829bcfac-ad3b-436d-9a9c-f9037404eba4\") " pod="opendatahub/postgres-68c4fbbd6f-mzh9b" May 26 19:40:12.523396 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:12.523378 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szqfp\" (UniqueName: \"kubernetes.io/projected/829bcfac-ad3b-436d-9a9c-f9037404eba4-kube-api-access-szqfp\") pod \"postgres-68c4fbbd6f-mzh9b\" (UID: \"829bcfac-ad3b-436d-9a9c-f9037404eba4\") " pod="opendatahub/postgres-68c4fbbd6f-mzh9b" May 26 19:40:12.535166 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:12.535149 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-mzh9b" May 26 19:40:12.660471 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:12.660447 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-mzh9b"] May 26 19:40:12.661900 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:40:12.661876 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod829bcfac_ad3b_436d_9a9c_f9037404eba4.slice/crio-68711c3a7e59d4932f541daf04a39c5b09d0e40d52a1e3b1b27e9cbc1a93c820 WatchSource:0}: Error finding container 68711c3a7e59d4932f541daf04a39c5b09d0e40d52a1e3b1b27e9cbc1a93c820: Status 404 returned error can't find the container with id 68711c3a7e59d4932f541daf04a39c5b09d0e40d52a1e3b1b27e9cbc1a93c820 May 26 19:40:13.145862 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:13.145824 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-mzh9b" event={"ID":"829bcfac-ad3b-436d-9a9c-f9037404eba4","Type":"ContainerStarted","Data":"68711c3a7e59d4932f541daf04a39c5b09d0e40d52a1e3b1b27e9cbc1a93c820"} May 26 19:40:18.168428 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:18.168395 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-mzh9b" event={"ID":"829bcfac-ad3b-436d-9a9c-f9037404eba4","Type":"ContainerStarted","Data":"96361c8089d23bb7d3a897398ce1ed120cc971e2559490b54a462dc0aea2adb8"} May 26 19:40:18.168869 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:18.168451 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-mzh9b" May 26 19:40:18.183049 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:18.183003 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-mzh9b" podStartSLOduration=1.313808972 podStartE2EDuration="6.182989143s" podCreationTimestamp="2026-05-26 19:40:12 +0000 UTC" firstStartedPulling="2026-05-26 19:40:12.663250505 +0000 UTC m=+877.197223266" lastFinishedPulling="2026-05-26 19:40:17.53243067 +0000 UTC m=+882.066403437" observedRunningTime="2026-05-26 19:40:18.181962274 +0000 UTC m=+882.715935058" watchObservedRunningTime="2026-05-26 19:40:18.182989143 +0000 UTC m=+882.716961927" May 26 19:40:24.199895 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:24.199867 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-mzh9b" May 26 19:40:25.544718 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:25.544641 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv"] May 26 19:40:25.551331 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:25.551298 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv" May 26 19:40:25.554058 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:25.554039 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 26 19:40:25.554997 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:25.554973 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv"] May 26 19:40:25.555100 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:25.555089 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 26 19:40:25.555167 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:25.555144 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ps5z8\"" May 26 19:40:25.633241 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:25.633215 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfc62960-4272-428a-965e-62c964be5eaf-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv\" (UID: \"cfc62960-4272-428a-965e-62c964be5eaf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv" May 26 19:40:25.633377 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:25.633279 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfc62960-4272-428a-965e-62c964be5eaf-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv\" (UID: \"cfc62960-4272-428a-965e-62c964be5eaf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv" May 26 19:40:25.633440 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:25.633380 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvkm4\" (UniqueName: \"kubernetes.io/projected/cfc62960-4272-428a-965e-62c964be5eaf-kube-api-access-bvkm4\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv\" (UID: \"cfc62960-4272-428a-965e-62c964be5eaf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv" May 26 19:40:25.734150 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:25.734113 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfc62960-4272-428a-965e-62c964be5eaf-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv\" (UID: \"cfc62960-4272-428a-965e-62c964be5eaf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv" May 26 19:40:25.734357 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:25.734167 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfc62960-4272-428a-965e-62c964be5eaf-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv\" (UID: \"cfc62960-4272-428a-965e-62c964be5eaf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv" May 26 19:40:25.734357 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:25.734210 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bvkm4\" (UniqueName: \"kubernetes.io/projected/cfc62960-4272-428a-965e-62c964be5eaf-kube-api-access-bvkm4\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv\" (UID: \"cfc62960-4272-428a-965e-62c964be5eaf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv" May 26 19:40:25.734568 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:25.734542 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfc62960-4272-428a-965e-62c964be5eaf-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv\" (UID: \"cfc62960-4272-428a-965e-62c964be5eaf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv" May 26 19:40:25.734607 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:25.734587 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfc62960-4272-428a-965e-62c964be5eaf-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv\" (UID: \"cfc62960-4272-428a-965e-62c964be5eaf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv" May 26 19:40:25.742374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:25.742351 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvkm4\" (UniqueName: \"kubernetes.io/projected/cfc62960-4272-428a-965e-62c964be5eaf-kube-api-access-bvkm4\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv\" (UID: \"cfc62960-4272-428a-965e-62c964be5eaf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv" May 26 19:40:25.886551 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:25.886508 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv" May 26 19:40:26.014844 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:26.014818 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv"] May 26 19:40:26.017103 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:40:26.017074 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfc62960_4272_428a_965e_62c964be5eaf.slice/crio-372d96d1f41856e4c07e3c9b40698c2085189ab73325c0277bbf3ae2f57e3ba8 WatchSource:0}: Error finding container 372d96d1f41856e4c07e3c9b40698c2085189ab73325c0277bbf3ae2f57e3ba8: Status 404 returned error can't find the container with id 372d96d1f41856e4c07e3c9b40698c2085189ab73325c0277bbf3ae2f57e3ba8 May 26 19:40:26.199157 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:26.199067 2578 generic.go:358] "Generic (PLEG): container finished" podID="cfc62960-4272-428a-965e-62c964be5eaf" containerID="3acf4ce9984f9b07a32eb38e46eefc0b2c1ce7afbecec710b0d18e6df10fe9f7" exitCode=0 May 26 19:40:26.199358 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:26.199151 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv" event={"ID":"cfc62960-4272-428a-965e-62c964be5eaf","Type":"ContainerDied","Data":"3acf4ce9984f9b07a32eb38e46eefc0b2c1ce7afbecec710b0d18e6df10fe9f7"} May 26 19:40:26.199358 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:26.199185 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv" event={"ID":"cfc62960-4272-428a-965e-62c964be5eaf","Type":"ContainerStarted","Data":"372d96d1f41856e4c07e3c9b40698c2085189ab73325c0277bbf3ae2f57e3ba8"} May 26 19:40:27.204166 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:27.204128 2578 generic.go:358] "Generic (PLEG): container finished" podID="cfc62960-4272-428a-965e-62c964be5eaf" containerID="0d01f1283f6dd4e263cb12c77df6c48ea27bbe3db99f58342bd813ff13ac425b" exitCode=0 May 26 19:40:27.204566 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:27.204207 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv" event={"ID":"cfc62960-4272-428a-965e-62c964be5eaf","Type":"ContainerDied","Data":"0d01f1283f6dd4e263cb12c77df6c48ea27bbe3db99f58342bd813ff13ac425b"} May 26 19:40:28.210085 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:28.210046 2578 generic.go:358] "Generic (PLEG): container finished" podID="cfc62960-4272-428a-965e-62c964be5eaf" containerID="73c4f713d37135b629b445c59c7acd45111c0d8c81edd7023301791454ec6993" exitCode=0 May 26 19:40:28.210560 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:28.210128 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv" event={"ID":"cfc62960-4272-428a-965e-62c964be5eaf","Type":"ContainerDied","Data":"73c4f713d37135b629b445c59c7acd45111c0d8c81edd7023301791454ec6993"} May 26 19:40:29.342370 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:29.342348 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv" May 26 19:40:29.464400 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:29.464302 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvkm4\" (UniqueName: \"kubernetes.io/projected/cfc62960-4272-428a-965e-62c964be5eaf-kube-api-access-bvkm4\") pod \"cfc62960-4272-428a-965e-62c964be5eaf\" (UID: \"cfc62960-4272-428a-965e-62c964be5eaf\") " May 26 19:40:29.464400 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:29.464365 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfc62960-4272-428a-965e-62c964be5eaf-bundle\") pod \"cfc62960-4272-428a-965e-62c964be5eaf\" (UID: \"cfc62960-4272-428a-965e-62c964be5eaf\") " May 26 19:40:29.464573 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:29.464474 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfc62960-4272-428a-965e-62c964be5eaf-util\") pod \"cfc62960-4272-428a-965e-62c964be5eaf\" (UID: \"cfc62960-4272-428a-965e-62c964be5eaf\") " May 26 19:40:29.464816 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:29.464791 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfc62960-4272-428a-965e-62c964be5eaf-bundle" (OuterVolumeSpecName: "bundle") pod "cfc62960-4272-428a-965e-62c964be5eaf" (UID: "cfc62960-4272-428a-965e-62c964be5eaf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:40:29.466436 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:29.466416 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfc62960-4272-428a-965e-62c964be5eaf-kube-api-access-bvkm4" (OuterVolumeSpecName: "kube-api-access-bvkm4") pod "cfc62960-4272-428a-965e-62c964be5eaf" (UID: "cfc62960-4272-428a-965e-62c964be5eaf"). InnerVolumeSpecName "kube-api-access-bvkm4". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:40:29.469828 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:29.469810 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfc62960-4272-428a-965e-62c964be5eaf-util" (OuterVolumeSpecName: "util") pod "cfc62960-4272-428a-965e-62c964be5eaf" (UID: "cfc62960-4272-428a-965e-62c964be5eaf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 19:40:29.565762 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:29.565736 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvkm4\" (UniqueName: \"kubernetes.io/projected/cfc62960-4272-428a-965e-62c964be5eaf-kube-api-access-bvkm4\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:40:29.565762 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:29.565761 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfc62960-4272-428a-965e-62c964be5eaf-bundle\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:40:29.565932 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:29.565771 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfc62960-4272-428a-965e-62c964be5eaf-util\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:40:30.218803 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:30.218776 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv" May 26 19:40:30.218979 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:30.218775 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70qz7vv" event={"ID":"cfc62960-4272-428a-965e-62c964be5eaf","Type":"ContainerDied","Data":"372d96d1f41856e4c07e3c9b40698c2085189ab73325c0277bbf3ae2f57e3ba8"} May 26 19:40:30.218979 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:40:30.218881 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="372d96d1f41856e4c07e3c9b40698c2085189ab73325c0277bbf3ae2f57e3ba8" May 26 19:41:18.490043 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.490005 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-csj76"] May 26 19:41:18.490556 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.490537 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfc62960-4272-428a-965e-62c964be5eaf" containerName="extract" May 26 19:41:18.490626 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.490556 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfc62960-4272-428a-965e-62c964be5eaf" containerName="extract" May 26 19:41:18.490626 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.490582 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfc62960-4272-428a-965e-62c964be5eaf" containerName="util" May 26 19:41:18.490626 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.490591 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfc62960-4272-428a-965e-62c964be5eaf" containerName="util" May 26 19:41:18.490626 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.490603 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfc62960-4272-428a-965e-62c964be5eaf" containerName="pull" May 26 19:41:18.490626 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.490611 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfc62960-4272-428a-965e-62c964be5eaf" containerName="pull" May 26 19:41:18.490862 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.490720 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="cfc62960-4272-428a-965e-62c964be5eaf" containerName="extract" May 26 19:41:18.493753 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.493732 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-csj76" May 26 19:41:18.499427 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.499399 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-csj76"] May 26 19:41:18.578028 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.577996 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vc8j\" (UniqueName: \"kubernetes.io/projected/8ae37611-583e-480a-8028-7d1420d744c3-kube-api-access-7vc8j\") pod \"authorino-8b475cf9f-csj76\" (UID: \"8ae37611-583e-480a-8028-7d1420d744c3\") " pod="kuadrant-system/authorino-8b475cf9f-csj76" May 26 19:41:18.656933 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.656902 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-csj76"] May 26 19:41:18.657173 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:41:18.657155 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-7vc8j], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-csj76" podUID="8ae37611-583e-480a-8028-7d1420d744c3" May 26 19:41:18.679414 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.679386 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7vc8j\" (UniqueName: \"kubernetes.io/projected/8ae37611-583e-480a-8028-7d1420d744c3-kube-api-access-7vc8j\") pod \"authorino-8b475cf9f-csj76\" (UID: \"8ae37611-583e-480a-8028-7d1420d744c3\") " pod="kuadrant-system/authorino-8b475cf9f-csj76" May 26 19:41:18.682860 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.682840 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56fdd757f5-vzcpr"] May 26 19:41:18.686330 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.686308 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-vzcpr" May 26 19:41:18.688776 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.688759 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 26 19:41:18.695513 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.695487 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-vzcpr"] May 26 19:41:18.696094 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.696066 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vc8j\" (UniqueName: \"kubernetes.io/projected/8ae37611-583e-480a-8028-7d1420d744c3-kube-api-access-7vc8j\") pod \"authorino-8b475cf9f-csj76\" (UID: \"8ae37611-583e-480a-8028-7d1420d744c3\") " pod="kuadrant-system/authorino-8b475cf9f-csj76" May 26 19:41:18.720758 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.720730 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-vzcpr"] May 26 19:41:18.720970 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:41:18.720953 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-z29k8 tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-z29k8 tls-cert]: context canceled" pod="kuadrant-system/authorino-56fdd757f5-vzcpr" podUID="12a35665-d552-4166-9a3d-ccbe080a828f" May 26 19:41:18.746095 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.746070 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54c8f8c8f7-mw2h5"] May 26 19:41:18.749565 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.749550 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54c8f8c8f7-mw2h5" May 26 19:41:18.754457 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.754432 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54c8f8c8f7-mw2h5"] May 26 19:41:18.779978 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.779948 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4a8e19f9-0bf7-432d-bf33-d3644ad45ee5-tls-cert\") pod \"authorino-54c8f8c8f7-mw2h5\" (UID: \"4a8e19f9-0bf7-432d-bf33-d3644ad45ee5\") " pod="kuadrant-system/authorino-54c8f8c8f7-mw2h5" May 26 19:41:18.780100 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.779991 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/12a35665-d552-4166-9a3d-ccbe080a828f-tls-cert\") pod \"authorino-56fdd757f5-vzcpr\" (UID: \"12a35665-d552-4166-9a3d-ccbe080a828f\") " pod="kuadrant-system/authorino-56fdd757f5-vzcpr" May 26 19:41:18.780100 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.780025 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwnfx\" (UniqueName: \"kubernetes.io/projected/4a8e19f9-0bf7-432d-bf33-d3644ad45ee5-kube-api-access-gwnfx\") pod \"authorino-54c8f8c8f7-mw2h5\" (UID: \"4a8e19f9-0bf7-432d-bf33-d3644ad45ee5\") " pod="kuadrant-system/authorino-54c8f8c8f7-mw2h5" May 26 19:41:18.780100 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.780079 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z29k8\" (UniqueName: \"kubernetes.io/projected/12a35665-d552-4166-9a3d-ccbe080a828f-kube-api-access-z29k8\") pod \"authorino-56fdd757f5-vzcpr\" (UID: \"12a35665-d552-4166-9a3d-ccbe080a828f\") " pod="kuadrant-system/authorino-56fdd757f5-vzcpr" May 26 19:41:18.881496 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.881458 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4a8e19f9-0bf7-432d-bf33-d3644ad45ee5-tls-cert\") pod \"authorino-54c8f8c8f7-mw2h5\" (UID: \"4a8e19f9-0bf7-432d-bf33-d3644ad45ee5\") " pod="kuadrant-system/authorino-54c8f8c8f7-mw2h5" May 26 19:41:18.881496 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.881500 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/12a35665-d552-4166-9a3d-ccbe080a828f-tls-cert\") pod \"authorino-56fdd757f5-vzcpr\" (UID: \"12a35665-d552-4166-9a3d-ccbe080a828f\") " pod="kuadrant-system/authorino-56fdd757f5-vzcpr" May 26 19:41:18.881709 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.881521 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwnfx\" (UniqueName: \"kubernetes.io/projected/4a8e19f9-0bf7-432d-bf33-d3644ad45ee5-kube-api-access-gwnfx\") pod \"authorino-54c8f8c8f7-mw2h5\" (UID: \"4a8e19f9-0bf7-432d-bf33-d3644ad45ee5\") " pod="kuadrant-system/authorino-54c8f8c8f7-mw2h5" May 26 19:41:18.881709 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.881556 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z29k8\" (UniqueName: \"kubernetes.io/projected/12a35665-d552-4166-9a3d-ccbe080a828f-kube-api-access-z29k8\") pod \"authorino-56fdd757f5-vzcpr\" (UID: \"12a35665-d552-4166-9a3d-ccbe080a828f\") " pod="kuadrant-system/authorino-56fdd757f5-vzcpr" May 26 19:41:18.883880 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.883856 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/12a35665-d552-4166-9a3d-ccbe080a828f-tls-cert\") pod \"authorino-56fdd757f5-vzcpr\" (UID: \"12a35665-d552-4166-9a3d-ccbe080a828f\") " pod="kuadrant-system/authorino-56fdd757f5-vzcpr" May 26 19:41:18.884075 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.884057 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4a8e19f9-0bf7-432d-bf33-d3644ad45ee5-tls-cert\") pod \"authorino-54c8f8c8f7-mw2h5\" (UID: \"4a8e19f9-0bf7-432d-bf33-d3644ad45ee5\") " pod="kuadrant-system/authorino-54c8f8c8f7-mw2h5" May 26 19:41:18.889450 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.889429 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z29k8\" (UniqueName: \"kubernetes.io/projected/12a35665-d552-4166-9a3d-ccbe080a828f-kube-api-access-z29k8\") pod \"authorino-56fdd757f5-vzcpr\" (UID: \"12a35665-d552-4166-9a3d-ccbe080a828f\") " pod="kuadrant-system/authorino-56fdd757f5-vzcpr" May 26 19:41:18.889662 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:18.889645 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwnfx\" (UniqueName: \"kubernetes.io/projected/4a8e19f9-0bf7-432d-bf33-d3644ad45ee5-kube-api-access-gwnfx\") pod \"authorino-54c8f8c8f7-mw2h5\" (UID: \"4a8e19f9-0bf7-432d-bf33-d3644ad45ee5\") " pod="kuadrant-system/authorino-54c8f8c8f7-mw2h5" May 26 19:41:19.060222 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:19.060138 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54c8f8c8f7-mw2h5" May 26 19:41:19.187429 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:19.187403 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54c8f8c8f7-mw2h5"] May 26 19:41:19.189150 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:41:19.189124 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a8e19f9_0bf7_432d_bf33_d3644ad45ee5.slice/crio-64e5b96fc98384084dd39396651819f1c91811383ab0c8fc6b029fea976c43fb WatchSource:0}: Error finding container 64e5b96fc98384084dd39396651819f1c91811383ab0c8fc6b029fea976c43fb: Status 404 returned error can't find the container with id 64e5b96fc98384084dd39396651819f1c91811383ab0c8fc6b029fea976c43fb May 26 19:41:19.416160 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:19.416108 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54c8f8c8f7-mw2h5" event={"ID":"4a8e19f9-0bf7-432d-bf33-d3644ad45ee5","Type":"ContainerStarted","Data":"64e5b96fc98384084dd39396651819f1c91811383ab0c8fc6b029fea976c43fb"} May 26 19:41:19.416348 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:19.416203 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-csj76" May 26 19:41:19.416348 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:19.416205 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-vzcpr" May 26 19:41:19.421395 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:19.421373 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-csj76" May 26 19:41:19.424508 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:19.424484 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-vzcpr" May 26 19:41:19.486648 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:19.486623 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vc8j\" (UniqueName: \"kubernetes.io/projected/8ae37611-583e-480a-8028-7d1420d744c3-kube-api-access-7vc8j\") pod \"8ae37611-583e-480a-8028-7d1420d744c3\" (UID: \"8ae37611-583e-480a-8028-7d1420d744c3\") " May 26 19:41:19.486774 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:19.486666 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/12a35665-d552-4166-9a3d-ccbe080a828f-tls-cert\") pod \"12a35665-d552-4166-9a3d-ccbe080a828f\" (UID: \"12a35665-d552-4166-9a3d-ccbe080a828f\") " May 26 19:41:19.486774 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:19.486726 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z29k8\" (UniqueName: \"kubernetes.io/projected/12a35665-d552-4166-9a3d-ccbe080a828f-kube-api-access-z29k8\") pod \"12a35665-d552-4166-9a3d-ccbe080a828f\" (UID: \"12a35665-d552-4166-9a3d-ccbe080a828f\") " May 26 19:41:19.488679 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:19.488652 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12a35665-d552-4166-9a3d-ccbe080a828f-kube-api-access-z29k8" (OuterVolumeSpecName: "kube-api-access-z29k8") pod "12a35665-d552-4166-9a3d-ccbe080a828f" (UID: "12a35665-d552-4166-9a3d-ccbe080a828f"). InnerVolumeSpecName "kube-api-access-z29k8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:41:19.488679 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:19.488669 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ae37611-583e-480a-8028-7d1420d744c3-kube-api-access-7vc8j" (OuterVolumeSpecName: "kube-api-access-7vc8j") pod "8ae37611-583e-480a-8028-7d1420d744c3" (UID: "8ae37611-583e-480a-8028-7d1420d744c3"). InnerVolumeSpecName "kube-api-access-7vc8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:41:19.488806 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:19.488675 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12a35665-d552-4166-9a3d-ccbe080a828f-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "12a35665-d552-4166-9a3d-ccbe080a828f" (UID: "12a35665-d552-4166-9a3d-ccbe080a828f"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:41:19.588253 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:19.588228 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vc8j\" (UniqueName: \"kubernetes.io/projected/8ae37611-583e-480a-8028-7d1420d744c3-kube-api-access-7vc8j\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:41:19.588525 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:19.588257 2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/12a35665-d552-4166-9a3d-ccbe080a828f-tls-cert\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:41:19.588525 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:19.588267 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z29k8\" (UniqueName: \"kubernetes.io/projected/12a35665-d552-4166-9a3d-ccbe080a828f-kube-api-access-z29k8\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:41:20.421626 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:20.421587 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54c8f8c8f7-mw2h5" event={"ID":"4a8e19f9-0bf7-432d-bf33-d3644ad45ee5","Type":"ContainerStarted","Data":"9490c44c760000182daf890db59d30dbc8fed9c7a6b5b2b3dfea765bf25f441a"} May 26 19:41:20.421793 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:20.421654 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-vzcpr" May 26 19:41:20.421793 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:20.421656 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-csj76" May 26 19:41:20.436878 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:20.436833 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-54c8f8c8f7-mw2h5" podStartSLOduration=2.066398526 podStartE2EDuration="2.436821875s" podCreationTimestamp="2026-05-26 19:41:18 +0000 UTC" firstStartedPulling="2026-05-26 19:41:19.190763763 +0000 UTC m=+943.724736528" lastFinishedPulling="2026-05-26 19:41:19.561187104 +0000 UTC m=+944.095159877" observedRunningTime="2026-05-26 19:41:20.435663001 +0000 UTC m=+944.969635797" watchObservedRunningTime="2026-05-26 19:41:20.436821875 +0000 UTC m=+944.970794652" May 26 19:41:20.460011 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:20.459983 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-csj76"] May 26 19:41:20.465981 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:20.465956 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-gnwxg"] May 26 19:41:20.466211 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:20.466180 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-gnwxg" podUID="e95fa27d-cdf6-4b67-87ee-e0c2c9184bbc" containerName="authorino" containerID="cri-o://bb5f3a393743eef276ae64b0123b71bb3a55ebe5e05117f707b1c0f6621bd8d4" gracePeriod=30 May 26 19:41:20.468639 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:20.468608 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-csj76"] May 26 19:41:20.492780 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:20.492751 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-vzcpr"] May 26 19:41:20.505734 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:20.505704 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-vzcpr"] May 26 19:41:20.712359 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:20.712317 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-gnwxg" May 26 19:41:20.798986 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:20.798921 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lgmm\" (UniqueName: \"kubernetes.io/projected/e95fa27d-cdf6-4b67-87ee-e0c2c9184bbc-kube-api-access-2lgmm\") pod \"e95fa27d-cdf6-4b67-87ee-e0c2c9184bbc\" (UID: \"e95fa27d-cdf6-4b67-87ee-e0c2c9184bbc\") " May 26 19:41:20.800895 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:20.800869 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e95fa27d-cdf6-4b67-87ee-e0c2c9184bbc-kube-api-access-2lgmm" (OuterVolumeSpecName: "kube-api-access-2lgmm") pod "e95fa27d-cdf6-4b67-87ee-e0c2c9184bbc" (UID: "e95fa27d-cdf6-4b67-87ee-e0c2c9184bbc"). InnerVolumeSpecName "kube-api-access-2lgmm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:41:20.900036 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:20.900010 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lgmm\" (UniqueName: \"kubernetes.io/projected/e95fa27d-cdf6-4b67-87ee-e0c2c9184bbc-kube-api-access-2lgmm\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:41:21.426282 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:21.426248 2578 generic.go:358] "Generic (PLEG): container finished" podID="e95fa27d-cdf6-4b67-87ee-e0c2c9184bbc" containerID="bb5f3a393743eef276ae64b0123b71bb3a55ebe5e05117f707b1c0f6621bd8d4" exitCode=0 May 26 19:41:21.426461 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:21.426300 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-gnwxg" May 26 19:41:21.426461 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:21.426347 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-gnwxg" event={"ID":"e95fa27d-cdf6-4b67-87ee-e0c2c9184bbc","Type":"ContainerDied","Data":"bb5f3a393743eef276ae64b0123b71bb3a55ebe5e05117f707b1c0f6621bd8d4"} May 26 19:41:21.426461 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:21.426387 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-gnwxg" event={"ID":"e95fa27d-cdf6-4b67-87ee-e0c2c9184bbc","Type":"ContainerDied","Data":"22132f17f4fbc5b44d3e233252a5aad6617ddc7ec6bb4b14b4ae0405fc37933e"} May 26 19:41:21.426461 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:21.426401 2578 scope.go:117] "RemoveContainer" containerID="bb5f3a393743eef276ae64b0123b71bb3a55ebe5e05117f707b1c0f6621bd8d4" May 26 19:41:21.435678 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:21.435662 2578 scope.go:117] "RemoveContainer" containerID="bb5f3a393743eef276ae64b0123b71bb3a55ebe5e05117f707b1c0f6621bd8d4" May 26 19:41:21.435914 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:41:21.435895 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb5f3a393743eef276ae64b0123b71bb3a55ebe5e05117f707b1c0f6621bd8d4\": container with ID starting with bb5f3a393743eef276ae64b0123b71bb3a55ebe5e05117f707b1c0f6621bd8d4 not found: ID does not exist" containerID="bb5f3a393743eef276ae64b0123b71bb3a55ebe5e05117f707b1c0f6621bd8d4" May 26 19:41:21.435962 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:21.435922 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb5f3a393743eef276ae64b0123b71bb3a55ebe5e05117f707b1c0f6621bd8d4"} err="failed to get container status \"bb5f3a393743eef276ae64b0123b71bb3a55ebe5e05117f707b1c0f6621bd8d4\": rpc error: code = NotFound desc = could not find container \"bb5f3a393743eef276ae64b0123b71bb3a55ebe5e05117f707b1c0f6621bd8d4\": container with ID starting with bb5f3a393743eef276ae64b0123b71bb3a55ebe5e05117f707b1c0f6621bd8d4 not found: ID does not exist" May 26 19:41:21.447137 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:21.447112 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-gnwxg"] May 26 19:41:21.449444 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:21.449428 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-gnwxg"] May 26 19:41:22.104301 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:22.104271 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12a35665-d552-4166-9a3d-ccbe080a828f" path="/var/lib/kubelet/pods/12a35665-d552-4166-9a3d-ccbe080a828f/volumes" May 26 19:41:22.104672 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:22.104516 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ae37611-583e-480a-8028-7d1420d744c3" path="/var/lib/kubelet/pods/8ae37611-583e-480a-8028-7d1420d744c3/volumes" May 26 19:41:22.104713 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:22.104700 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e95fa27d-cdf6-4b67-87ee-e0c2c9184bbc" path="/var/lib/kubelet/pods/e95fa27d-cdf6-4b67-87ee-e0c2c9184bbc/volumes" May 26 19:41:23.562357 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:23.562310 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54f7cc5fc4-qfx2p"] May 26 19:41:23.562713 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:23.562697 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e95fa27d-cdf6-4b67-87ee-e0c2c9184bbc" containerName="authorino" May 26 19:41:23.562713 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:23.562709 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e95fa27d-cdf6-4b67-87ee-e0c2c9184bbc" containerName="authorino" May 26 19:41:23.562786 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:23.562766 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="e95fa27d-cdf6-4b67-87ee-e0c2c9184bbc" containerName="authorino" May 26 19:41:23.567244 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:23.567223 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54f7cc5fc4-qfx2p" May 26 19:41:23.570022 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:23.570002 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 26 19:41:23.570368 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:23.570035 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vrfwk\"" May 26 19:41:23.574693 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:23.574548 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54f7cc5fc4-qfx2p"] May 26 19:41:23.623504 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:23.623474 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2v96\" (UniqueName: \"kubernetes.io/projected/d7d26d6d-a81c-4230-92d9-d095d6d13998-kube-api-access-c2v96\") pod \"maas-controller-54f7cc5fc4-qfx2p\" (UID: \"d7d26d6d-a81c-4230-92d9-d095d6d13998\") " pod="opendatahub/maas-controller-54f7cc5fc4-qfx2p" May 26 19:41:23.705599 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:23.705564 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5656c94d98-75ml8"] May 26 19:41:23.709131 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:23.709116 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5656c94d98-75ml8" May 26 19:41:23.715368 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:23.715346 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5656c94d98-75ml8"] May 26 19:41:23.725018 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:23.724994 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2v96\" (UniqueName: \"kubernetes.io/projected/d7d26d6d-a81c-4230-92d9-d095d6d13998-kube-api-access-c2v96\") pod \"maas-controller-54f7cc5fc4-qfx2p\" (UID: \"d7d26d6d-a81c-4230-92d9-d095d6d13998\") " pod="opendatahub/maas-controller-54f7cc5fc4-qfx2p" May 26 19:41:23.732310 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:23.732292 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2v96\" (UniqueName: \"kubernetes.io/projected/d7d26d6d-a81c-4230-92d9-d095d6d13998-kube-api-access-c2v96\") pod \"maas-controller-54f7cc5fc4-qfx2p\" (UID: \"d7d26d6d-a81c-4230-92d9-d095d6d13998\") " pod="opendatahub/maas-controller-54f7cc5fc4-qfx2p" May 26 19:41:23.825865 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:23.825768 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwwfz\" (UniqueName: \"kubernetes.io/projected/dff534dc-f23a-4815-ba54-35d0b0b48040-kube-api-access-zwwfz\") pod \"maas-controller-5656c94d98-75ml8\" (UID: \"dff534dc-f23a-4815-ba54-35d0b0b48040\") " pod="opendatahub/maas-controller-5656c94d98-75ml8" May 26 19:41:23.878670 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:23.878635 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54f7cc5fc4-qfx2p" May 26 19:41:23.926600 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:23.926568 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zwwfz\" (UniqueName: \"kubernetes.io/projected/dff534dc-f23a-4815-ba54-35d0b0b48040-kube-api-access-zwwfz\") pod \"maas-controller-5656c94d98-75ml8\" (UID: \"dff534dc-f23a-4815-ba54-35d0b0b48040\") " pod="opendatahub/maas-controller-5656c94d98-75ml8" May 26 19:41:23.934971 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:23.934879 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwwfz\" (UniqueName: \"kubernetes.io/projected/dff534dc-f23a-4815-ba54-35d0b0b48040-kube-api-access-zwwfz\") pod \"maas-controller-5656c94d98-75ml8\" (UID: \"dff534dc-f23a-4815-ba54-35d0b0b48040\") " pod="opendatahub/maas-controller-5656c94d98-75ml8" May 26 19:41:24.015725 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:24.015685 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54f7cc5fc4-qfx2p"] May 26 19:41:24.016851 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:41:24.016825 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7d26d6d_a81c_4230_92d9_d095d6d13998.slice/crio-a68cd984b77b7bcae537b7b78fce510b66893d70dcbbc2e89100fc3c9d09db83 WatchSource:0}: Error finding container a68cd984b77b7bcae537b7b78fce510b66893d70dcbbc2e89100fc3c9d09db83: Status 404 returned error can't find the container with id a68cd984b77b7bcae537b7b78fce510b66893d70dcbbc2e89100fc3c9d09db83 May 26 19:41:24.019853 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:24.019833 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5656c94d98-75ml8" May 26 19:41:24.142737 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:24.142714 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5656c94d98-75ml8"] May 26 19:41:24.144361 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:41:24.144337 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddff534dc_f23a_4815_ba54_35d0b0b48040.slice/crio-086bb94882d8296da3686cf8c609665171223e3417e7aaa3f62fbdc6f0fb70de WatchSource:0}: Error finding container 086bb94882d8296da3686cf8c609665171223e3417e7aaa3f62fbdc6f0fb70de: Status 404 returned error can't find the container with id 086bb94882d8296da3686cf8c609665171223e3417e7aaa3f62fbdc6f0fb70de May 26 19:41:24.440242 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:24.440205 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5656c94d98-75ml8" event={"ID":"dff534dc-f23a-4815-ba54-35d0b0b48040","Type":"ContainerStarted","Data":"086bb94882d8296da3686cf8c609665171223e3417e7aaa3f62fbdc6f0fb70de"} May 26 19:41:24.441212 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:24.441181 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54f7cc5fc4-qfx2p" event={"ID":"d7d26d6d-a81c-4230-92d9-d095d6d13998","Type":"ContainerStarted","Data":"a68cd984b77b7bcae537b7b78fce510b66893d70dcbbc2e89100fc3c9d09db83"} May 26 19:41:27.458437 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:27.458399 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5656c94d98-75ml8" event={"ID":"dff534dc-f23a-4815-ba54-35d0b0b48040","Type":"ContainerStarted","Data":"98455862dc7dbe824b9ca354fea2c0f38af7f08e67446681e9c84189b7234c2f"} May 26 19:41:27.458880 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:27.458470 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5656c94d98-75ml8" May 26 19:41:27.459908 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:27.459884 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54f7cc5fc4-qfx2p" event={"ID":"d7d26d6d-a81c-4230-92d9-d095d6d13998","Type":"ContainerStarted","Data":"2ae3654ad01c256dad3b9e3f50705f6cd354a705c2f949eee1cbe71b5afa916a"} May 26 19:41:27.460007 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:27.459937 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54f7cc5fc4-qfx2p" May 26 19:41:27.475342 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:27.475283 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5656c94d98-75ml8" podStartSLOduration=1.913732112 podStartE2EDuration="4.475268187s" podCreationTimestamp="2026-05-26 19:41:23 +0000 UTC" firstStartedPulling="2026-05-26 19:41:24.14562943 +0000 UTC m=+948.679602192" lastFinishedPulling="2026-05-26 19:41:26.707165495 +0000 UTC m=+951.241138267" observedRunningTime="2026-05-26 19:41:27.474563295 +0000 UTC m=+952.008536079" watchObservedRunningTime="2026-05-26 19:41:27.475268187 +0000 UTC m=+952.009240972" May 26 19:41:27.496670 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:27.496628 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-54f7cc5fc4-qfx2p" podStartSLOduration=1.820448617 podStartE2EDuration="4.49661493s" podCreationTimestamp="2026-05-26 19:41:23 +0000 UTC" firstStartedPulling="2026-05-26 19:41:24.018493907 +0000 UTC m=+948.552466669" lastFinishedPulling="2026-05-26 19:41:26.694660219 +0000 UTC m=+951.228632982" observedRunningTime="2026-05-26 19:41:27.494710217 +0000 UTC m=+952.028683002" watchObservedRunningTime="2026-05-26 19:41:27.49661493 +0000 UTC m=+952.030587746" May 26 19:41:38.469209 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:38.469179 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5656c94d98-75ml8" May 26 19:41:38.469749 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:38.469240 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54f7cc5fc4-qfx2p" May 26 19:41:38.532860 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:38.532825 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54f7cc5fc4-qfx2p"] May 26 19:41:38.533046 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:38.533009 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-54f7cc5fc4-qfx2p" podUID="d7d26d6d-a81c-4230-92d9-d095d6d13998" containerName="manager" containerID="cri-o://2ae3654ad01c256dad3b9e3f50705f6cd354a705c2f949eee1cbe71b5afa916a" gracePeriod=30 May 26 19:41:38.770091 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:38.770067 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54f7cc5fc4-qfx2p" May 26 19:41:38.873520 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:38.873485 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2v96\" (UniqueName: \"kubernetes.io/projected/d7d26d6d-a81c-4230-92d9-d095d6d13998-kube-api-access-c2v96\") pod \"d7d26d6d-a81c-4230-92d9-d095d6d13998\" (UID: \"d7d26d6d-a81c-4230-92d9-d095d6d13998\") " May 26 19:41:38.875713 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:38.875680 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7d26d6d-a81c-4230-92d9-d095d6d13998-kube-api-access-c2v96" (OuterVolumeSpecName: "kube-api-access-c2v96") pod "d7d26d6d-a81c-4230-92d9-d095d6d13998" (UID: "d7d26d6d-a81c-4230-92d9-d095d6d13998"). InnerVolumeSpecName "kube-api-access-c2v96". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:41:38.974111 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:38.974073 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2v96\" (UniqueName: \"kubernetes.io/projected/d7d26d6d-a81c-4230-92d9-d095d6d13998-kube-api-access-c2v96\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:41:39.512257 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:39.512227 2578 generic.go:358] "Generic (PLEG): container finished" podID="d7d26d6d-a81c-4230-92d9-d095d6d13998" containerID="2ae3654ad01c256dad3b9e3f50705f6cd354a705c2f949eee1cbe71b5afa916a" exitCode=0 May 26 19:41:39.512725 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:39.512283 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54f7cc5fc4-qfx2p" event={"ID":"d7d26d6d-a81c-4230-92d9-d095d6d13998","Type":"ContainerDied","Data":"2ae3654ad01c256dad3b9e3f50705f6cd354a705c2f949eee1cbe71b5afa916a"} May 26 19:41:39.512725 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:39.512301 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54f7cc5fc4-qfx2p" May 26 19:41:39.512725 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:39.512341 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54f7cc5fc4-qfx2p" event={"ID":"d7d26d6d-a81c-4230-92d9-d095d6d13998","Type":"ContainerDied","Data":"a68cd984b77b7bcae537b7b78fce510b66893d70dcbbc2e89100fc3c9d09db83"} May 26 19:41:39.512725 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:39.512363 2578 scope.go:117] "RemoveContainer" containerID="2ae3654ad01c256dad3b9e3f50705f6cd354a705c2f949eee1cbe71b5afa916a" May 26 19:41:39.521090 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:39.521074 2578 scope.go:117] "RemoveContainer" containerID="2ae3654ad01c256dad3b9e3f50705f6cd354a705c2f949eee1cbe71b5afa916a" May 26 19:41:39.521360 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:41:39.521316 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ae3654ad01c256dad3b9e3f50705f6cd354a705c2f949eee1cbe71b5afa916a\": container with ID starting with 2ae3654ad01c256dad3b9e3f50705f6cd354a705c2f949eee1cbe71b5afa916a not found: ID does not exist" containerID="2ae3654ad01c256dad3b9e3f50705f6cd354a705c2f949eee1cbe71b5afa916a" May 26 19:41:39.521437 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:39.521373 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ae3654ad01c256dad3b9e3f50705f6cd354a705c2f949eee1cbe71b5afa916a"} err="failed to get container status \"2ae3654ad01c256dad3b9e3f50705f6cd354a705c2f949eee1cbe71b5afa916a\": rpc error: code = NotFound desc = could not find container \"2ae3654ad01c256dad3b9e3f50705f6cd354a705c2f949eee1cbe71b5afa916a\": container with ID starting with 2ae3654ad01c256dad3b9e3f50705f6cd354a705c2f949eee1cbe71b5afa916a not found: ID does not exist" May 26 19:41:39.535633 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:39.535603 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54f7cc5fc4-qfx2p"] May 26 19:41:39.539258 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:39.539238 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54f7cc5fc4-qfx2p"] May 26 19:41:40.103958 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:40.103922 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7d26d6d-a81c-4230-92d9-d095d6d13998" path="/var/lib/kubelet/pods/d7d26d6d-a81c-4230-92d9-d095d6d13998/volumes" May 26 19:41:56.912341 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:56.912254 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-lls7f"] May 26 19:41:56.912780 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:56.912696 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7d26d6d-a81c-4230-92d9-d095d6d13998" containerName="manager" May 26 19:41:56.912780 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:56.912710 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7d26d6d-a81c-4230-92d9-d095d6d13998" containerName="manager" May 26 19:41:56.912855 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:56.912782 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="d7d26d6d-a81c-4230-92d9-d095d6d13998" containerName="manager" May 26 19:41:56.917187 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:56.917170 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-lls7f" May 26 19:41:56.920233 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:56.920213 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 26 19:41:56.920374 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:56.920213 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6wcsq\"" May 26 19:41:56.921994 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:56.921971 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-lls7f"] May 26 19:41:56.928728 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:56.928709 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94m56\" (UniqueName: \"kubernetes.io/projected/c5c410ca-b1c4-46a4-bbd1-a405f7d3a595-kube-api-access-94m56\") pod \"payload-processing-58b6c8fdc7-lls7f\" (UID: \"c5c410ca-b1c4-46a4-bbd1-a405f7d3a595\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-lls7f" May 26 19:41:57.030179 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:57.030148 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-94m56\" (UniqueName: \"kubernetes.io/projected/c5c410ca-b1c4-46a4-bbd1-a405f7d3a595-kube-api-access-94m56\") pod \"payload-processing-58b6c8fdc7-lls7f\" (UID: \"c5c410ca-b1c4-46a4-bbd1-a405f7d3a595\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-lls7f" May 26 19:41:57.037802 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:57.037774 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94m56\" (UniqueName: \"kubernetes.io/projected/c5c410ca-b1c4-46a4-bbd1-a405f7d3a595-kube-api-access-94m56\") pod \"payload-processing-58b6c8fdc7-lls7f\" (UID: \"c5c410ca-b1c4-46a4-bbd1-a405f7d3a595\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-lls7f" May 26 19:41:57.229346 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:57.229224 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-lls7f" May 26 19:41:57.364733 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:57.364706 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-lls7f"] May 26 19:41:57.366187 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:41:57.366155 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5c410ca_b1c4_46a4_bbd1_a405f7d3a595.slice/crio-d3ded6d6400114c9e6382581056b18937c165a640559b82284c783b26e44c352 WatchSource:0}: Error finding container d3ded6d6400114c9e6382581056b18937c165a640559b82284c783b26e44c352: Status 404 returned error can't find the container with id d3ded6d6400114c9e6382581056b18937c165a640559b82284c783b26e44c352 May 26 19:41:57.587457 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:41:57.587372 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-lls7f" event={"ID":"c5c410ca-b1c4-46a4-bbd1-a405f7d3a595","Type":"ContainerStarted","Data":"d3ded6d6400114c9e6382581056b18937c165a640559b82284c783b26e44c352"} May 26 19:42:00.602844 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:00.602805 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-lls7f" event={"ID":"c5c410ca-b1c4-46a4-bbd1-a405f7d3a595","Type":"ContainerStarted","Data":"a5778c81db4dc58753292a743678fc764001eb9444309ed90551033b585a69f8"} May 26 19:42:00.603300 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:00.602963 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-lls7f" May 26 19:42:00.624166 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:00.624120 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-lls7f" podStartSLOduration=2.079042101 podStartE2EDuration="4.624108292s" podCreationTimestamp="2026-05-26 19:41:56 +0000 UTC" firstStartedPulling="2026-05-26 19:41:57.368182047 +0000 UTC m=+981.902154813" lastFinishedPulling="2026-05-26 19:41:59.913248226 +0000 UTC m=+984.447221004" observedRunningTime="2026-05-26 19:42:00.62039318 +0000 UTC m=+985.154365984" watchObservedRunningTime="2026-05-26 19:42:00.624108292 +0000 UTC m=+985.158081076" May 26 19:42:11.610076 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:11.610044 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-lls7f" May 26 19:42:44.928166 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:44.928130 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7dc5b6767f-9nfbc"] May 26 19:42:44.935453 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:44.935432 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dc5b6767f-9nfbc" May 26 19:42:44.937975 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:44.937953 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" May 26 19:42:44.938568 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:44.938541 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7dc5b6767f-9nfbc"] May 26 19:42:44.968973 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:44.968944 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4fe522cf-c25e-4702-8ad6-52bbf41b0b86-tls-cert\") pod \"authorino-7dc5b6767f-9nfbc\" (UID: \"4fe522cf-c25e-4702-8ad6-52bbf41b0b86\") " pod="kuadrant-system/authorino-7dc5b6767f-9nfbc" May 26 19:42:44.968973 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:44.968976 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4fe522cf-c25e-4702-8ad6-52bbf41b0b86-oidc-ca\") pod \"authorino-7dc5b6767f-9nfbc\" (UID: \"4fe522cf-c25e-4702-8ad6-52bbf41b0b86\") " pod="kuadrant-system/authorino-7dc5b6767f-9nfbc" May 26 19:42:44.969131 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:44.969051 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzlrj\" (UniqueName: \"kubernetes.io/projected/4fe522cf-c25e-4702-8ad6-52bbf41b0b86-kube-api-access-vzlrj\") pod \"authorino-7dc5b6767f-9nfbc\" (UID: \"4fe522cf-c25e-4702-8ad6-52bbf41b0b86\") " pod="kuadrant-system/authorino-7dc5b6767f-9nfbc" May 26 19:42:45.070349 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:45.070277 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vzlrj\" (UniqueName: \"kubernetes.io/projected/4fe522cf-c25e-4702-8ad6-52bbf41b0b86-kube-api-access-vzlrj\") pod \"authorino-7dc5b6767f-9nfbc\" (UID: \"4fe522cf-c25e-4702-8ad6-52bbf41b0b86\") " pod="kuadrant-system/authorino-7dc5b6767f-9nfbc" May 26 19:42:45.070554 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:45.070382 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4fe522cf-c25e-4702-8ad6-52bbf41b0b86-tls-cert\") pod \"authorino-7dc5b6767f-9nfbc\" (UID: \"4fe522cf-c25e-4702-8ad6-52bbf41b0b86\") " pod="kuadrant-system/authorino-7dc5b6767f-9nfbc" May 26 19:42:45.070554 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:45.070408 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4fe522cf-c25e-4702-8ad6-52bbf41b0b86-oidc-ca\") pod \"authorino-7dc5b6767f-9nfbc\" (UID: \"4fe522cf-c25e-4702-8ad6-52bbf41b0b86\") " pod="kuadrant-system/authorino-7dc5b6767f-9nfbc" May 26 19:42:45.071057 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:45.071032 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4fe522cf-c25e-4702-8ad6-52bbf41b0b86-oidc-ca\") pod \"authorino-7dc5b6767f-9nfbc\" (UID: \"4fe522cf-c25e-4702-8ad6-52bbf41b0b86\") " pod="kuadrant-system/authorino-7dc5b6767f-9nfbc" May 26 19:42:45.072804 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:45.072777 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4fe522cf-c25e-4702-8ad6-52bbf41b0b86-tls-cert\") pod \"authorino-7dc5b6767f-9nfbc\" (UID: \"4fe522cf-c25e-4702-8ad6-52bbf41b0b86\") " pod="kuadrant-system/authorino-7dc5b6767f-9nfbc" May 26 19:42:45.077566 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:45.077544 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzlrj\" (UniqueName: \"kubernetes.io/projected/4fe522cf-c25e-4702-8ad6-52bbf41b0b86-kube-api-access-vzlrj\") pod \"authorino-7dc5b6767f-9nfbc\" (UID: \"4fe522cf-c25e-4702-8ad6-52bbf41b0b86\") " pod="kuadrant-system/authorino-7dc5b6767f-9nfbc" May 26 19:42:45.245905 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:45.245813 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dc5b6767f-9nfbc" May 26 19:42:45.383331 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:45.383291 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7dc5b6767f-9nfbc"] May 26 19:42:45.384872 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:42:45.384843 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4fe522cf_c25e_4702_8ad6_52bbf41b0b86.slice/crio-0cf2b8af2e9723606c5dc8ff3d1d905fce57cb8183b21f665bea7d7b8caac4c3 WatchSource:0}: Error finding container 0cf2b8af2e9723606c5dc8ff3d1d905fce57cb8183b21f665bea7d7b8caac4c3: Status 404 returned error can't find the container with id 0cf2b8af2e9723606c5dc8ff3d1d905fce57cb8183b21f665bea7d7b8caac4c3 May 26 19:42:45.793286 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:45.793246 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dc5b6767f-9nfbc" event={"ID":"4fe522cf-c25e-4702-8ad6-52bbf41b0b86","Type":"ContainerStarted","Data":"0cf2b8af2e9723606c5dc8ff3d1d905fce57cb8183b21f665bea7d7b8caac4c3"} May 26 19:42:46.798390 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:46.798352 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dc5b6767f-9nfbc" event={"ID":"4fe522cf-c25e-4702-8ad6-52bbf41b0b86","Type":"ContainerStarted","Data":"da9ad537be3933a89c35be9fd8aeed7878def03c6bea5346fd159c3d8201a285"} May 26 19:42:46.813548 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:46.813497 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7dc5b6767f-9nfbc" podStartSLOduration=2.400195652 podStartE2EDuration="2.813482832s" podCreationTimestamp="2026-05-26 19:42:44 +0000 UTC" firstStartedPulling="2026-05-26 19:42:45.386229512 +0000 UTC m=+1029.920202276" lastFinishedPulling="2026-05-26 19:42:45.799516695 +0000 UTC m=+1030.333489456" observedRunningTime="2026-05-26 19:42:46.812187532 +0000 UTC m=+1031.346160315" watchObservedRunningTime="2026-05-26 19:42:46.813482832 +0000 UTC m=+1031.347455615" May 26 19:42:46.842156 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:46.842119 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54c8f8c8f7-mw2h5"] May 26 19:42:46.842363 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:46.842311 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-54c8f8c8f7-mw2h5" podUID="4a8e19f9-0bf7-432d-bf33-d3644ad45ee5" containerName="authorino" containerID="cri-o://9490c44c760000182daf890db59d30dbc8fed9c7a6b5b2b3dfea765bf25f441a" gracePeriod=30 May 26 19:42:47.113363 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:47.113338 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54c8f8c8f7-mw2h5" May 26 19:42:47.192096 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:47.192065 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4a8e19f9-0bf7-432d-bf33-d3644ad45ee5-tls-cert\") pod \"4a8e19f9-0bf7-432d-bf33-d3644ad45ee5\" (UID: \"4a8e19f9-0bf7-432d-bf33-d3644ad45ee5\") " May 26 19:42:47.192253 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:47.192165 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwnfx\" (UniqueName: \"kubernetes.io/projected/4a8e19f9-0bf7-432d-bf33-d3644ad45ee5-kube-api-access-gwnfx\") pod \"4a8e19f9-0bf7-432d-bf33-d3644ad45ee5\" (UID: \"4a8e19f9-0bf7-432d-bf33-d3644ad45ee5\") " May 26 19:42:47.194316 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:47.194288 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a8e19f9-0bf7-432d-bf33-d3644ad45ee5-kube-api-access-gwnfx" (OuterVolumeSpecName: "kube-api-access-gwnfx") pod "4a8e19f9-0bf7-432d-bf33-d3644ad45ee5" (UID: "4a8e19f9-0bf7-432d-bf33-d3644ad45ee5"). InnerVolumeSpecName "kube-api-access-gwnfx". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:42:47.202812 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:47.202783 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a8e19f9-0bf7-432d-bf33-d3644ad45ee5-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4a8e19f9-0bf7-432d-bf33-d3644ad45ee5" (UID: "4a8e19f9-0bf7-432d-bf33-d3644ad45ee5"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:42:47.293808 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:47.293773 2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4a8e19f9-0bf7-432d-bf33-d3644ad45ee5-tls-cert\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:42:47.293808 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:47.293802 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwnfx\" (UniqueName: \"kubernetes.io/projected/4a8e19f9-0bf7-432d-bf33-d3644ad45ee5-kube-api-access-gwnfx\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:42:47.802818 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:47.802781 2578 generic.go:358] "Generic (PLEG): container finished" podID="4a8e19f9-0bf7-432d-bf33-d3644ad45ee5" containerID="9490c44c760000182daf890db59d30dbc8fed9c7a6b5b2b3dfea765bf25f441a" exitCode=0 May 26 19:42:47.803269 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:47.802832 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54c8f8c8f7-mw2h5" May 26 19:42:47.803269 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:47.802863 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54c8f8c8f7-mw2h5" event={"ID":"4a8e19f9-0bf7-432d-bf33-d3644ad45ee5","Type":"ContainerDied","Data":"9490c44c760000182daf890db59d30dbc8fed9c7a6b5b2b3dfea765bf25f441a"} May 26 19:42:47.803269 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:47.802904 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54c8f8c8f7-mw2h5" event={"ID":"4a8e19f9-0bf7-432d-bf33-d3644ad45ee5","Type":"ContainerDied","Data":"64e5b96fc98384084dd39396651819f1c91811383ab0c8fc6b029fea976c43fb"} May 26 19:42:47.803269 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:47.802926 2578 scope.go:117] "RemoveContainer" containerID="9490c44c760000182daf890db59d30dbc8fed9c7a6b5b2b3dfea765bf25f441a" May 26 19:42:47.812831 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:47.812812 2578 scope.go:117] "RemoveContainer" containerID="9490c44c760000182daf890db59d30dbc8fed9c7a6b5b2b3dfea765bf25f441a" May 26 19:42:47.813075 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:42:47.813054 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9490c44c760000182daf890db59d30dbc8fed9c7a6b5b2b3dfea765bf25f441a\": container with ID starting with 9490c44c760000182daf890db59d30dbc8fed9c7a6b5b2b3dfea765bf25f441a not found: ID does not exist" containerID="9490c44c760000182daf890db59d30dbc8fed9c7a6b5b2b3dfea765bf25f441a" May 26 19:42:47.813120 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:47.813085 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9490c44c760000182daf890db59d30dbc8fed9c7a6b5b2b3dfea765bf25f441a"} err="failed to get container status \"9490c44c760000182daf890db59d30dbc8fed9c7a6b5b2b3dfea765bf25f441a\": rpc error: code = NotFound desc = could not find container \"9490c44c760000182daf890db59d30dbc8fed9c7a6b5b2b3dfea765bf25f441a\": container with ID starting with 9490c44c760000182daf890db59d30dbc8fed9c7a6b5b2b3dfea765bf25f441a not found: ID does not exist" May 26 19:42:47.824274 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:47.824243 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54c8f8c8f7-mw2h5"] May 26 19:42:47.826659 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:47.826635 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-54c8f8c8f7-mw2h5"] May 26 19:42:48.104878 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:42:48.104792 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a8e19f9-0bf7-432d-bf33-d3644ad45ee5" path="/var/lib/kubelet/pods/4a8e19f9-0bf7-432d-bf33-d3644ad45ee5/volumes" May 26 19:43:05.175060 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.175021 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8"] May 26 19:43:05.175648 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.175631 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a8e19f9-0bf7-432d-bf33-d3644ad45ee5" containerName="authorino" May 26 19:43:05.175693 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.175651 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a8e19f9-0bf7-432d-bf33-d3644ad45ee5" containerName="authorino" May 26 19:43:05.175764 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.175753 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="4a8e19f9-0bf7-432d-bf33-d3644ad45ee5" containerName="authorino" May 26 19:43:05.179404 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.179385 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" May 26 19:43:05.183081 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.183059 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nrlxv\"" May 26 19:43:05.183226 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.183099 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 26 19:43:05.183301 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.183115 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 26 19:43:05.183301 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.183151 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 26 19:43:05.186298 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.186270 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8"] May 26 19:43:05.262848 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.262821 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b61c7a36-72e7-4d2a-a3ff-f92cff990dd1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-qjkg8\" (UID: \"b61c7a36-72e7-4d2a-a3ff-f92cff990dd1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" May 26 19:43:05.263027 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.262853 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hdlx\" (UniqueName: \"kubernetes.io/projected/b61c7a36-72e7-4d2a-a3ff-f92cff990dd1-kube-api-access-5hdlx\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-qjkg8\" (UID: \"b61c7a36-72e7-4d2a-a3ff-f92cff990dd1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" May 26 19:43:05.263027 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.262936 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b61c7a36-72e7-4d2a-a3ff-f92cff990dd1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-qjkg8\" (UID: \"b61c7a36-72e7-4d2a-a3ff-f92cff990dd1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" May 26 19:43:05.263027 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.262995 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b61c7a36-72e7-4d2a-a3ff-f92cff990dd1-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-qjkg8\" (UID: \"b61c7a36-72e7-4d2a-a3ff-f92cff990dd1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" May 26 19:43:05.263194 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.263095 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b61c7a36-72e7-4d2a-a3ff-f92cff990dd1-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-qjkg8\" (UID: \"b61c7a36-72e7-4d2a-a3ff-f92cff990dd1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" May 26 19:43:05.263194 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.263135 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b61c7a36-72e7-4d2a-a3ff-f92cff990dd1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-qjkg8\" (UID: \"b61c7a36-72e7-4d2a-a3ff-f92cff990dd1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" May 26 19:43:05.364314 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.364277 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b61c7a36-72e7-4d2a-a3ff-f92cff990dd1-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-qjkg8\" (UID: \"b61c7a36-72e7-4d2a-a3ff-f92cff990dd1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" May 26 19:43:05.364495 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.364341 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b61c7a36-72e7-4d2a-a3ff-f92cff990dd1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-qjkg8\" (UID: \"b61c7a36-72e7-4d2a-a3ff-f92cff990dd1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" May 26 19:43:05.364495 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.364372 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b61c7a36-72e7-4d2a-a3ff-f92cff990dd1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-qjkg8\" (UID: \"b61c7a36-72e7-4d2a-a3ff-f92cff990dd1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" May 26 19:43:05.364495 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.364389 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5hdlx\" (UniqueName: \"kubernetes.io/projected/b61c7a36-72e7-4d2a-a3ff-f92cff990dd1-kube-api-access-5hdlx\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-qjkg8\" (UID: \"b61c7a36-72e7-4d2a-a3ff-f92cff990dd1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" May 26 19:43:05.364495 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.364426 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b61c7a36-72e7-4d2a-a3ff-f92cff990dd1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-qjkg8\" (UID: \"b61c7a36-72e7-4d2a-a3ff-f92cff990dd1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" May 26 19:43:05.364495 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.364457 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b61c7a36-72e7-4d2a-a3ff-f92cff990dd1-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-qjkg8\" (UID: \"b61c7a36-72e7-4d2a-a3ff-f92cff990dd1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" May 26 19:43:05.364823 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.364798 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b61c7a36-72e7-4d2a-a3ff-f92cff990dd1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-qjkg8\" (UID: \"b61c7a36-72e7-4d2a-a3ff-f92cff990dd1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" May 26 19:43:05.364907 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.364830 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b61c7a36-72e7-4d2a-a3ff-f92cff990dd1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-qjkg8\" (UID: \"b61c7a36-72e7-4d2a-a3ff-f92cff990dd1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" May 26 19:43:05.364907 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.364867 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b61c7a36-72e7-4d2a-a3ff-f92cff990dd1-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-qjkg8\" (UID: \"b61c7a36-72e7-4d2a-a3ff-f92cff990dd1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" May 26 19:43:05.366452 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.366434 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b61c7a36-72e7-4d2a-a3ff-f92cff990dd1-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-qjkg8\" (UID: \"b61c7a36-72e7-4d2a-a3ff-f92cff990dd1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" May 26 19:43:05.366790 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.366773 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b61c7a36-72e7-4d2a-a3ff-f92cff990dd1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-qjkg8\" (UID: \"b61c7a36-72e7-4d2a-a3ff-f92cff990dd1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" May 26 19:43:05.371577 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.371556 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hdlx\" (UniqueName: \"kubernetes.io/projected/b61c7a36-72e7-4d2a-a3ff-f92cff990dd1-kube-api-access-5hdlx\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-qjkg8\" (UID: \"b61c7a36-72e7-4d2a-a3ff-f92cff990dd1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" May 26 19:43:05.491216 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.491141 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" May 26 19:43:05.622891 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.622867 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8"] May 26 19:43:05.623837 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:43:05.623815 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb61c7a36_72e7_4d2a_a3ff_f92cff990dd1.slice/crio-8fd4b68c0d7211383d10b45cc6601e04043d705d7c4c8d7499df2468263fd358 WatchSource:0}: Error finding container 8fd4b68c0d7211383d10b45cc6601e04043d705d7c4c8d7499df2468263fd358: Status 404 returned error can't find the container with id 8fd4b68c0d7211383d10b45cc6601e04043d705d7c4c8d7499df2468263fd358 May 26 19:43:05.872722 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:05.872637 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" event={"ID":"b61c7a36-72e7-4d2a-a3ff-f92cff990dd1","Type":"ContainerStarted","Data":"8fd4b68c0d7211383d10b45cc6601e04043d705d7c4c8d7499df2468263fd358"} May 26 19:43:10.897925 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:10.897881 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" event={"ID":"b61c7a36-72e7-4d2a-a3ff-f92cff990dd1","Type":"ContainerStarted","Data":"efb02eec3a0a365de92a54fe266f08716a3f8c14fd634c7a82e2c638696b3687"} May 26 19:43:15.918621 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:15.918587 2578 generic.go:358] "Generic (PLEG): container finished" podID="b61c7a36-72e7-4d2a-a3ff-f92cff990dd1" containerID="efb02eec3a0a365de92a54fe266f08716a3f8c14fd634c7a82e2c638696b3687" exitCode=0 May 26 19:43:15.919023 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:15.918661 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" event={"ID":"b61c7a36-72e7-4d2a-a3ff-f92cff990dd1","Type":"ContainerDied","Data":"efb02eec3a0a365de92a54fe266f08716a3f8c14fd634c7a82e2c638696b3687"} May 26 19:43:17.929045 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:17.929012 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" event={"ID":"b61c7a36-72e7-4d2a-a3ff-f92cff990dd1","Type":"ContainerStarted","Data":"eb514ba4bb1656dc621f1537311da700d80be45a4e3f5f3e30425adcb3a71632"} May 26 19:43:17.929541 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:17.929244 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" May 26 19:43:17.948677 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:17.948627 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" podStartSLOduration=1.552485011 podStartE2EDuration="12.948615074s" podCreationTimestamp="2026-05-26 19:43:05 +0000 UTC" firstStartedPulling="2026-05-26 19:43:05.625565566 +0000 UTC m=+1050.159538328" lastFinishedPulling="2026-05-26 19:43:17.021695629 +0000 UTC m=+1061.555668391" observedRunningTime="2026-05-26 19:43:17.946443636 +0000 UTC m=+1062.480416431" watchObservedRunningTime="2026-05-26 19:43:17.948615074 +0000 UTC m=+1062.482587858" May 26 19:43:28.945727 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:43:28.945656 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-qjkg8" May 26 19:44:18.463819 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:18.463784 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b9c7f566-v989v"] May 26 19:44:18.467451 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:18.467433 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b9c7f566-v989v" May 26 19:44:18.475542 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:18.475517 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b9c7f566-v989v"] May 26 19:44:18.505972 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:18.505947 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bb6fa5b9-b1a4-49c7-84a6-3e58b73efa0a-tls-cert\") pod \"authorino-b9c7f566-v989v\" (UID: \"bb6fa5b9-b1a4-49c7-84a6-3e58b73efa0a\") " pod="kuadrant-system/authorino-b9c7f566-v989v" May 26 19:44:18.506098 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:18.505979 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d79f4\" (UniqueName: \"kubernetes.io/projected/bb6fa5b9-b1a4-49c7-84a6-3e58b73efa0a-kube-api-access-d79f4\") pod \"authorino-b9c7f566-v989v\" (UID: \"bb6fa5b9-b1a4-49c7-84a6-3e58b73efa0a\") " pod="kuadrant-system/authorino-b9c7f566-v989v" May 26 19:44:18.506098 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:18.506002 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bb6fa5b9-b1a4-49c7-84a6-3e58b73efa0a-oidc-ca\") pod \"authorino-b9c7f566-v989v\" (UID: \"bb6fa5b9-b1a4-49c7-84a6-3e58b73efa0a\") " pod="kuadrant-system/authorino-b9c7f566-v989v" May 26 19:44:18.607227 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:18.607198 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bb6fa5b9-b1a4-49c7-84a6-3e58b73efa0a-tls-cert\") pod \"authorino-b9c7f566-v989v\" (UID: \"bb6fa5b9-b1a4-49c7-84a6-3e58b73efa0a\") " pod="kuadrant-system/authorino-b9c7f566-v989v" May 26 19:44:18.607227 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:18.607230 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d79f4\" (UniqueName: \"kubernetes.io/projected/bb6fa5b9-b1a4-49c7-84a6-3e58b73efa0a-kube-api-access-d79f4\") pod \"authorino-b9c7f566-v989v\" (UID: \"bb6fa5b9-b1a4-49c7-84a6-3e58b73efa0a\") " pod="kuadrant-system/authorino-b9c7f566-v989v" May 26 19:44:18.607486 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:18.607255 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bb6fa5b9-b1a4-49c7-84a6-3e58b73efa0a-oidc-ca\") pod \"authorino-b9c7f566-v989v\" (UID: \"bb6fa5b9-b1a4-49c7-84a6-3e58b73efa0a\") " pod="kuadrant-system/authorino-b9c7f566-v989v" May 26 19:44:18.607907 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:18.607886 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bb6fa5b9-b1a4-49c7-84a6-3e58b73efa0a-oidc-ca\") pod \"authorino-b9c7f566-v989v\" (UID: \"bb6fa5b9-b1a4-49c7-84a6-3e58b73efa0a\") " pod="kuadrant-system/authorino-b9c7f566-v989v" May 26 19:44:18.609627 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:18.609603 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bb6fa5b9-b1a4-49c7-84a6-3e58b73efa0a-tls-cert\") pod \"authorino-b9c7f566-v989v\" (UID: \"bb6fa5b9-b1a4-49c7-84a6-3e58b73efa0a\") " pod="kuadrant-system/authorino-b9c7f566-v989v" May 26 19:44:18.614904 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:18.614881 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d79f4\" (UniqueName: \"kubernetes.io/projected/bb6fa5b9-b1a4-49c7-84a6-3e58b73efa0a-kube-api-access-d79f4\") pod \"authorino-b9c7f566-v989v\" (UID: \"bb6fa5b9-b1a4-49c7-84a6-3e58b73efa0a\") " pod="kuadrant-system/authorino-b9c7f566-v989v" May 26 19:44:18.777178 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:18.777144 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b9c7f566-v989v" May 26 19:44:18.905653 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:18.905626 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b9c7f566-v989v"] May 26 19:44:18.906873 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:44:18.906842 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb6fa5b9_b1a4_49c7_84a6_3e58b73efa0a.slice/crio-4fdf965134811e70381043385b4c63bce3f1909e14f9479f0853dee475f7e117 WatchSource:0}: Error finding container 4fdf965134811e70381043385b4c63bce3f1909e14f9479f0853dee475f7e117: Status 404 returned error can't find the container with id 4fdf965134811e70381043385b4c63bce3f1909e14f9479f0853dee475f7e117 May 26 19:44:19.171999 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:19.171965 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b9c7f566-v989v" event={"ID":"bb6fa5b9-b1a4-49c7-84a6-3e58b73efa0a","Type":"ContainerStarted","Data":"4fdf965134811e70381043385b4c63bce3f1909e14f9479f0853dee475f7e117"} May 26 19:44:20.177241 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:20.177207 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b9c7f566-v989v" event={"ID":"bb6fa5b9-b1a4-49c7-84a6-3e58b73efa0a","Type":"ContainerStarted","Data":"477ca0b7f9f38853730ce8cb813692a680703909f3271edd426bf8c507801728"} May 26 19:44:20.193437 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:20.193390 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-b9c7f566-v989v" podStartSLOduration=1.782030481 podStartE2EDuration="2.193375657s" podCreationTimestamp="2026-05-26 19:44:18 +0000 UTC" firstStartedPulling="2026-05-26 19:44:18.908464193 +0000 UTC m=+1123.442436956" lastFinishedPulling="2026-05-26 19:44:19.319809353 +0000 UTC m=+1123.853782132" observedRunningTime="2026-05-26 19:44:20.190820363 +0000 UTC m=+1124.724793147" watchObservedRunningTime="2026-05-26 19:44:20.193375657 +0000 UTC m=+1124.727348469" May 26 19:44:20.225931 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:20.225901 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7dc5b6767f-9nfbc"] May 26 19:44:20.226104 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:20.226084 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7dc5b6767f-9nfbc" podUID="4fe522cf-c25e-4702-8ad6-52bbf41b0b86" containerName="authorino" containerID="cri-o://da9ad537be3933a89c35be9fd8aeed7878def03c6bea5346fd159c3d8201a285" gracePeriod=30 May 26 19:44:20.472417 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:20.472393 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dc5b6767f-9nfbc" May 26 19:44:20.522870 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:20.522841 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4fe522cf-c25e-4702-8ad6-52bbf41b0b86-tls-cert\") pod \"4fe522cf-c25e-4702-8ad6-52bbf41b0b86\" (UID: \"4fe522cf-c25e-4702-8ad6-52bbf41b0b86\") " May 26 19:44:20.523061 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:20.522889 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4fe522cf-c25e-4702-8ad6-52bbf41b0b86-oidc-ca\") pod \"4fe522cf-c25e-4702-8ad6-52bbf41b0b86\" (UID: \"4fe522cf-c25e-4702-8ad6-52bbf41b0b86\") " May 26 19:44:20.523061 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:20.522959 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzlrj\" (UniqueName: \"kubernetes.io/projected/4fe522cf-c25e-4702-8ad6-52bbf41b0b86-kube-api-access-vzlrj\") pod \"4fe522cf-c25e-4702-8ad6-52bbf41b0b86\" (UID: \"4fe522cf-c25e-4702-8ad6-52bbf41b0b86\") " May 26 19:44:20.524874 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:20.524843 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fe522cf-c25e-4702-8ad6-52bbf41b0b86-kube-api-access-vzlrj" (OuterVolumeSpecName: "kube-api-access-vzlrj") pod "4fe522cf-c25e-4702-8ad6-52bbf41b0b86" (UID: "4fe522cf-c25e-4702-8ad6-52bbf41b0b86"). InnerVolumeSpecName "kube-api-access-vzlrj". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:44:20.527971 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:20.527944 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fe522cf-c25e-4702-8ad6-52bbf41b0b86-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "4fe522cf-c25e-4702-8ad6-52bbf41b0b86" (UID: "4fe522cf-c25e-4702-8ad6-52bbf41b0b86"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 19:44:20.533011 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:20.532987 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fe522cf-c25e-4702-8ad6-52bbf41b0b86-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4fe522cf-c25e-4702-8ad6-52bbf41b0b86" (UID: "4fe522cf-c25e-4702-8ad6-52bbf41b0b86"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 19:44:20.623608 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:20.623584 2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4fe522cf-c25e-4702-8ad6-52bbf41b0b86-tls-cert\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:44:20.623608 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:20.623610 2578 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4fe522cf-c25e-4702-8ad6-52bbf41b0b86-oidc-ca\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:44:20.623745 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:20.623623 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzlrj\" (UniqueName: \"kubernetes.io/projected/4fe522cf-c25e-4702-8ad6-52bbf41b0b86-kube-api-access-vzlrj\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:44:21.182629 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:21.182588 2578 generic.go:358] "Generic (PLEG): container finished" podID="4fe522cf-c25e-4702-8ad6-52bbf41b0b86" containerID="da9ad537be3933a89c35be9fd8aeed7878def03c6bea5346fd159c3d8201a285" exitCode=0 May 26 19:44:21.183127 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:21.182649 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dc5b6767f-9nfbc" May 26 19:44:21.183127 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:21.182651 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dc5b6767f-9nfbc" event={"ID":"4fe522cf-c25e-4702-8ad6-52bbf41b0b86","Type":"ContainerDied","Data":"da9ad537be3933a89c35be9fd8aeed7878def03c6bea5346fd159c3d8201a285"} May 26 19:44:21.183127 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:21.182741 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dc5b6767f-9nfbc" event={"ID":"4fe522cf-c25e-4702-8ad6-52bbf41b0b86","Type":"ContainerDied","Data":"0cf2b8af2e9723606c5dc8ff3d1d905fce57cb8183b21f665bea7d7b8caac4c3"} May 26 19:44:21.183127 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:21.182766 2578 scope.go:117] "RemoveContainer" containerID="da9ad537be3933a89c35be9fd8aeed7878def03c6bea5346fd159c3d8201a285" May 26 19:44:21.193190 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:21.193173 2578 scope.go:117] "RemoveContainer" containerID="da9ad537be3933a89c35be9fd8aeed7878def03c6bea5346fd159c3d8201a285" May 26 19:44:21.193431 ip-10-0-139-192 kubenswrapper[2578]: E0526 19:44:21.193411 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da9ad537be3933a89c35be9fd8aeed7878def03c6bea5346fd159c3d8201a285\": container with ID starting with da9ad537be3933a89c35be9fd8aeed7878def03c6bea5346fd159c3d8201a285 not found: ID does not exist" containerID="da9ad537be3933a89c35be9fd8aeed7878def03c6bea5346fd159c3d8201a285" May 26 19:44:21.193486 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:21.193439 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da9ad537be3933a89c35be9fd8aeed7878def03c6bea5346fd159c3d8201a285"} err="failed to get container status \"da9ad537be3933a89c35be9fd8aeed7878def03c6bea5346fd159c3d8201a285\": rpc error: code = NotFound desc = could not find container \"da9ad537be3933a89c35be9fd8aeed7878def03c6bea5346fd159c3d8201a285\": container with ID starting with da9ad537be3933a89c35be9fd8aeed7878def03c6bea5346fd159c3d8201a285 not found: ID does not exist" May 26 19:44:21.221721 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:21.221688 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7dc5b6767f-9nfbc"] May 26 19:44:21.230950 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:21.230924 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7dc5b6767f-9nfbc"] May 26 19:44:22.103872 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:44:22.103837 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fe522cf-c25e-4702-8ad6-52bbf41b0b86" path="/var/lib/kubelet/pods/4fe522cf-c25e-4702-8ad6-52bbf41b0b86/volumes" May 26 19:45:00.140293 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:00.140208 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29663745-27kf7"] May 26 19:45:00.140859 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:00.140842 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fe522cf-c25e-4702-8ad6-52bbf41b0b86" containerName="authorino" May 26 19:45:00.140937 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:00.140861 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fe522cf-c25e-4702-8ad6-52bbf41b0b86" containerName="authorino" May 26 19:45:00.140995 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:00.140979 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="4fe522cf-c25e-4702-8ad6-52bbf41b0b86" containerName="authorino" May 26 19:45:00.145640 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:00.145613 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663745-27kf7" May 26 19:45:00.147925 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:00.147897 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29663745-27kf7"] May 26 19:45:00.148107 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:00.148083 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cck8c\"" May 26 19:45:00.275847 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:00.275798 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6mzq\" (UniqueName: \"kubernetes.io/projected/5a520b6b-cf51-4e56-b65b-5550cc1c1981-kube-api-access-d6mzq\") pod \"maas-api-key-cleanup-29663745-27kf7\" (UID: \"5a520b6b-cf51-4e56-b65b-5550cc1c1981\") " pod="opendatahub/maas-api-key-cleanup-29663745-27kf7" May 26 19:45:00.376705 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:00.376668 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d6mzq\" (UniqueName: \"kubernetes.io/projected/5a520b6b-cf51-4e56-b65b-5550cc1c1981-kube-api-access-d6mzq\") pod \"maas-api-key-cleanup-29663745-27kf7\" (UID: \"5a520b6b-cf51-4e56-b65b-5550cc1c1981\") " pod="opendatahub/maas-api-key-cleanup-29663745-27kf7" May 26 19:45:00.385400 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:00.385376 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6mzq\" (UniqueName: \"kubernetes.io/projected/5a520b6b-cf51-4e56-b65b-5550cc1c1981-kube-api-access-d6mzq\") pod \"maas-api-key-cleanup-29663745-27kf7\" (UID: \"5a520b6b-cf51-4e56-b65b-5550cc1c1981\") " pod="opendatahub/maas-api-key-cleanup-29663745-27kf7" May 26 19:45:00.459543 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:00.459466 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663745-27kf7" May 26 19:45:00.590460 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:00.590436 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29663745-27kf7"] May 26 19:45:00.592290 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:45:00.592246 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a520b6b_cf51_4e56_b65b_5550cc1c1981.slice/crio-4da014091cc4f20bccccdd4fd9e199a0f7e38a9d691700a6be88345b673ab6b4 WatchSource:0}: Error finding container 4da014091cc4f20bccccdd4fd9e199a0f7e38a9d691700a6be88345b673ab6b4: Status 404 returned error can't find the container with id 4da014091cc4f20bccccdd4fd9e199a0f7e38a9d691700a6be88345b673ab6b4 May 26 19:45:00.594122 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:00.594103 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 19:45:01.344639 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:01.344609 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663745-27kf7" event={"ID":"5a520b6b-cf51-4e56-b65b-5550cc1c1981","Type":"ContainerStarted","Data":"4da014091cc4f20bccccdd4fd9e199a0f7e38a9d691700a6be88345b673ab6b4"} May 26 19:45:04.359924 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:04.359892 2578 generic.go:358] "Generic (PLEG): container finished" podID="5a520b6b-cf51-4e56-b65b-5550cc1c1981" containerID="368a1f8bdd4497b434d40352f30ebc6f9cbfc0ab1836a8fc4a915902f102dfd8" exitCode=0 May 26 19:45:04.360303 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:04.359978 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663745-27kf7" event={"ID":"5a520b6b-cf51-4e56-b65b-5550cc1c1981","Type":"ContainerDied","Data":"368a1f8bdd4497b434d40352f30ebc6f9cbfc0ab1836a8fc4a915902f102dfd8"} May 26 19:45:05.492488 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:05.492461 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663745-27kf7" May 26 19:45:05.624563 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:05.624473 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6mzq\" (UniqueName: \"kubernetes.io/projected/5a520b6b-cf51-4e56-b65b-5550cc1c1981-kube-api-access-d6mzq\") pod \"5a520b6b-cf51-4e56-b65b-5550cc1c1981\" (UID: \"5a520b6b-cf51-4e56-b65b-5550cc1c1981\") " May 26 19:45:05.626535 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:05.626508 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a520b6b-cf51-4e56-b65b-5550cc1c1981-kube-api-access-d6mzq" (OuterVolumeSpecName: "kube-api-access-d6mzq") pod "5a520b6b-cf51-4e56-b65b-5550cc1c1981" (UID: "5a520b6b-cf51-4e56-b65b-5550cc1c1981"). InnerVolumeSpecName "kube-api-access-d6mzq". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:45:05.725225 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:05.725180 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6mzq\" (UniqueName: \"kubernetes.io/projected/5a520b6b-cf51-4e56-b65b-5550cc1c1981-kube-api-access-d6mzq\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:45:06.369496 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:06.369409 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663745-27kf7" event={"ID":"5a520b6b-cf51-4e56-b65b-5550cc1c1981","Type":"ContainerDied","Data":"4da014091cc4f20bccccdd4fd9e199a0f7e38a9d691700a6be88345b673ab6b4"} May 26 19:45:06.369496 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:06.369434 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663745-27kf7" May 26 19:45:06.369680 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:06.369443 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4da014091cc4f20bccccdd4fd9e199a0f7e38a9d691700a6be88345b673ab6b4" May 26 19:45:48.399245 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:48.399206 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5656c94d98-75ml8"] May 26 19:45:48.399771 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:48.399441 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-5656c94d98-75ml8" podUID="dff534dc-f23a-4815-ba54-35d0b0b48040" containerName="manager" containerID="cri-o://98455862dc7dbe824b9ca354fea2c0f38af7f08e67446681e9c84189b7234c2f" gracePeriod=30 May 26 19:45:48.464349 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:48.464284 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-5656c94d98-75ml8" podUID="dff534dc-f23a-4815-ba54-35d0b0b48040" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.53:8081/readyz\": dial tcp 10.133.0.53:8081: connect: connection refused" May 26 19:45:48.539668 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:48.539629 2578 generic.go:358] "Generic (PLEG): container finished" podID="dff534dc-f23a-4815-ba54-35d0b0b48040" containerID="98455862dc7dbe824b9ca354fea2c0f38af7f08e67446681e9c84189b7234c2f" exitCode=0 May 26 19:45:48.539833 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:48.539703 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5656c94d98-75ml8" event={"ID":"dff534dc-f23a-4815-ba54-35d0b0b48040","Type":"ContainerDied","Data":"98455862dc7dbe824b9ca354fea2c0f38af7f08e67446681e9c84189b7234c2f"} May 26 19:45:48.642874 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:48.642852 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5656c94d98-75ml8" May 26 19:45:48.700824 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:48.700735 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwwfz\" (UniqueName: \"kubernetes.io/projected/dff534dc-f23a-4815-ba54-35d0b0b48040-kube-api-access-zwwfz\") pod \"dff534dc-f23a-4815-ba54-35d0b0b48040\" (UID: \"dff534dc-f23a-4815-ba54-35d0b0b48040\") " May 26 19:45:48.702839 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:48.702812 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dff534dc-f23a-4815-ba54-35d0b0b48040-kube-api-access-zwwfz" (OuterVolumeSpecName: "kube-api-access-zwwfz") pod "dff534dc-f23a-4815-ba54-35d0b0b48040" (UID: "dff534dc-f23a-4815-ba54-35d0b0b48040"). InnerVolumeSpecName "kube-api-access-zwwfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 19:45:48.801972 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:48.801940 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwwfz\" (UniqueName: \"kubernetes.io/projected/dff534dc-f23a-4815-ba54-35d0b0b48040-kube-api-access-zwwfz\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 19:45:49.545300 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:49.545270 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5656c94d98-75ml8" May 26 19:45:49.545300 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:49.545281 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5656c94d98-75ml8" event={"ID":"dff534dc-f23a-4815-ba54-35d0b0b48040","Type":"ContainerDied","Data":"086bb94882d8296da3686cf8c609665171223e3417e7aaa3f62fbdc6f0fb70de"} May 26 19:45:49.545832 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:49.545339 2578 scope.go:117] "RemoveContainer" containerID="98455862dc7dbe824b9ca354fea2c0f38af7f08e67446681e9c84189b7234c2f" May 26 19:45:49.567450 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:49.567422 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5656c94d98-75ml8"] May 26 19:45:49.571259 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:49.571235 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5656c94d98-75ml8"] May 26 19:45:50.104274 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:50.104242 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dff534dc-f23a-4815-ba54-35d0b0b48040" path="/var/lib/kubelet/pods/dff534dc-f23a-4815-ba54-35d0b0b48040/volumes" May 26 19:45:50.296488 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:50.296458 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5656c94d98-2756w"] May 26 19:45:50.296895 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:50.296881 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dff534dc-f23a-4815-ba54-35d0b0b48040" containerName="manager" May 26 19:45:50.296938 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:50.296896 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dff534dc-f23a-4815-ba54-35d0b0b48040" containerName="manager" May 26 19:45:50.296938 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:50.296913 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a520b6b-cf51-4e56-b65b-5550cc1c1981" containerName="cleanup" May 26 19:45:50.296938 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:50.296919 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a520b6b-cf51-4e56-b65b-5550cc1c1981" containerName="cleanup" May 26 19:45:50.297037 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:50.296976 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="5a520b6b-cf51-4e56-b65b-5550cc1c1981" containerName="cleanup" May 26 19:45:50.297037 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:50.296989 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="dff534dc-f23a-4815-ba54-35d0b0b48040" containerName="manager" May 26 19:45:50.301752 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:50.301734 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5656c94d98-2756w" May 26 19:45:50.304373 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:50.304351 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vrfwk\"" May 26 19:45:50.304483 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:50.304461 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 26 19:45:50.307808 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:50.307787 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5656c94d98-2756w"] May 26 19:45:50.416221 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:50.416187 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87tqg\" (UniqueName: \"kubernetes.io/projected/77af5fad-4b9f-4546-81c4-bfb26e9f4299-kube-api-access-87tqg\") pod \"maas-controller-5656c94d98-2756w\" (UID: \"77af5fad-4b9f-4546-81c4-bfb26e9f4299\") " pod="opendatahub/maas-controller-5656c94d98-2756w" May 26 19:45:50.516745 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:50.516704 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-87tqg\" (UniqueName: \"kubernetes.io/projected/77af5fad-4b9f-4546-81c4-bfb26e9f4299-kube-api-access-87tqg\") pod \"maas-controller-5656c94d98-2756w\" (UID: \"77af5fad-4b9f-4546-81c4-bfb26e9f4299\") " pod="opendatahub/maas-controller-5656c94d98-2756w" May 26 19:45:50.524803 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:50.524772 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87tqg\" (UniqueName: \"kubernetes.io/projected/77af5fad-4b9f-4546-81c4-bfb26e9f4299-kube-api-access-87tqg\") pod \"maas-controller-5656c94d98-2756w\" (UID: \"77af5fad-4b9f-4546-81c4-bfb26e9f4299\") " pod="opendatahub/maas-controller-5656c94d98-2756w" May 26 19:45:50.613878 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:50.613845 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5656c94d98-2756w" May 26 19:45:50.745547 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:50.745518 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5656c94d98-2756w"] May 26 19:45:50.746730 ip-10-0-139-192 kubenswrapper[2578]: W0526 19:45:50.746702 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77af5fad_4b9f_4546_81c4_bfb26e9f4299.slice/crio-68d0090473908121b345e1a56732f1a62d7e88776e5b692dfe36e4b17a221856 WatchSource:0}: Error finding container 68d0090473908121b345e1a56732f1a62d7e88776e5b692dfe36e4b17a221856: Status 404 returned error can't find the container with id 68d0090473908121b345e1a56732f1a62d7e88776e5b692dfe36e4b17a221856 May 26 19:45:51.555978 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:51.555941 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5656c94d98-2756w" event={"ID":"77af5fad-4b9f-4546-81c4-bfb26e9f4299","Type":"ContainerStarted","Data":"62a613251b577b79d03586c6e4b1b22c305e097a0bf8d316f84091d3cc1ff2e4"} May 26 19:45:51.555978 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:51.555982 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5656c94d98-2756w" event={"ID":"77af5fad-4b9f-4546-81c4-bfb26e9f4299","Type":"ContainerStarted","Data":"68d0090473908121b345e1a56732f1a62d7e88776e5b692dfe36e4b17a221856"} May 26 19:45:51.556205 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:51.556027 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5656c94d98-2756w" May 26 19:45:51.573396 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:45:51.573341 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5656c94d98-2756w" podStartSLOduration=1.191874606 podStartE2EDuration="1.573315799s" podCreationTimestamp="2026-05-26 19:45:50 +0000 UTC" firstStartedPulling="2026-05-26 19:45:50.747970995 +0000 UTC m=+1215.281943757" lastFinishedPulling="2026-05-26 19:45:51.129412188 +0000 UTC m=+1215.663384950" observedRunningTime="2026-05-26 19:45:51.570140123 +0000 UTC m=+1216.104112906" watchObservedRunningTime="2026-05-26 19:45:51.573315799 +0000 UTC m=+1216.107288599" May 26 19:46:02.565589 ip-10-0-139-192 kubenswrapper[2578]: I0526 19:46:02.565553 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5656c94d98-2756w" May 26 20:00:00.131437 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:00:00.131357 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29663760-czvb4"] May 26 20:00:00.134903 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:00:00.134875 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663760-czvb4" May 26 20:00:00.137232 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:00:00.137204 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cck8c\"" May 26 20:00:00.146357 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:00:00.146314 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rw4r\" (UniqueName: \"kubernetes.io/projected/aa8ab5d7-21a8-443c-a90e-7ca8c74d8ae3-kube-api-access-2rw4r\") pod \"maas-api-key-cleanup-29663760-czvb4\" (UID: \"aa8ab5d7-21a8-443c-a90e-7ca8c74d8ae3\") " pod="opendatahub/maas-api-key-cleanup-29663760-czvb4" May 26 20:00:00.149604 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:00:00.149578 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29663760-czvb4"] May 26 20:00:00.247409 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:00:00.247375 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2rw4r\" (UniqueName: \"kubernetes.io/projected/aa8ab5d7-21a8-443c-a90e-7ca8c74d8ae3-kube-api-access-2rw4r\") pod \"maas-api-key-cleanup-29663760-czvb4\" (UID: \"aa8ab5d7-21a8-443c-a90e-7ca8c74d8ae3\") " pod="opendatahub/maas-api-key-cleanup-29663760-czvb4" May 26 20:00:00.254954 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:00:00.254932 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rw4r\" (UniqueName: \"kubernetes.io/projected/aa8ab5d7-21a8-443c-a90e-7ca8c74d8ae3-kube-api-access-2rw4r\") pod \"maas-api-key-cleanup-29663760-czvb4\" (UID: \"aa8ab5d7-21a8-443c-a90e-7ca8c74d8ae3\") " pod="opendatahub/maas-api-key-cleanup-29663760-czvb4" May 26 20:00:00.446565 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:00:00.446532 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663760-czvb4" May 26 20:00:00.581266 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:00:00.581234 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29663760-czvb4"] May 26 20:00:00.582752 ip-10-0-139-192 kubenswrapper[2578]: W0526 20:00:00.582723 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa8ab5d7_21a8_443c_a90e_7ca8c74d8ae3.slice/crio-b4902d6e17cb562dcbcba1ed5fd31209a9764421cd8b29f86576ffe7a3f719be WatchSource:0}: Error finding container b4902d6e17cb562dcbcba1ed5fd31209a9764421cd8b29f86576ffe7a3f719be: Status 404 returned error can't find the container with id b4902d6e17cb562dcbcba1ed5fd31209a9764421cd8b29f86576ffe7a3f719be May 26 20:00:00.584532 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:00:00.584516 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 20:00:00.987412 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:00:00.987374 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663760-czvb4" event={"ID":"aa8ab5d7-21a8-443c-a90e-7ca8c74d8ae3","Type":"ContainerStarted","Data":"7f1dc423755a1f54f83efd85be3d830e29cbb5298fb529abb91d9f56c7724122"} May 26 20:00:00.987412 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:00:00.987409 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663760-czvb4" event={"ID":"aa8ab5d7-21a8-443c-a90e-7ca8c74d8ae3","Type":"ContainerStarted","Data":"b4902d6e17cb562dcbcba1ed5fd31209a9764421cd8b29f86576ffe7a3f719be"} May 26 20:00:01.003032 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:00:01.002941 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29663760-czvb4" podStartSLOduration=1.002925823 podStartE2EDuration="1.002925823s" podCreationTimestamp="2026-05-26 20:00:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 20:00:01.00167435 +0000 UTC m=+2065.535647135" watchObservedRunningTime="2026-05-26 20:00:01.002925823 +0000 UTC m=+2065.536898626" May 26 20:00:01.992819 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:00:01.992786 2578 generic.go:358] "Generic (PLEG): container finished" podID="aa8ab5d7-21a8-443c-a90e-7ca8c74d8ae3" containerID="7f1dc423755a1f54f83efd85be3d830e29cbb5298fb529abb91d9f56c7724122" exitCode=0 May 26 20:00:01.993202 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:00:01.992873 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663760-czvb4" event={"ID":"aa8ab5d7-21a8-443c-a90e-7ca8c74d8ae3","Type":"ContainerDied","Data":"7f1dc423755a1f54f83efd85be3d830e29cbb5298fb529abb91d9f56c7724122"} May 26 20:00:03.129089 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:00:03.129068 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663760-czvb4" May 26 20:00:03.178535 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:00:03.178500 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rw4r\" (UniqueName: \"kubernetes.io/projected/aa8ab5d7-21a8-443c-a90e-7ca8c74d8ae3-kube-api-access-2rw4r\") pod \"aa8ab5d7-21a8-443c-a90e-7ca8c74d8ae3\" (UID: \"aa8ab5d7-21a8-443c-a90e-7ca8c74d8ae3\") " May 26 20:00:03.180472 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:00:03.180448 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa8ab5d7-21a8-443c-a90e-7ca8c74d8ae3-kube-api-access-2rw4r" (OuterVolumeSpecName: "kube-api-access-2rw4r") pod "aa8ab5d7-21a8-443c-a90e-7ca8c74d8ae3" (UID: "aa8ab5d7-21a8-443c-a90e-7ca8c74d8ae3"). InnerVolumeSpecName "kube-api-access-2rw4r". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 20:00:03.280004 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:00:03.279915 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rw4r\" (UniqueName: \"kubernetes.io/projected/aa8ab5d7-21a8-443c-a90e-7ca8c74d8ae3-kube-api-access-2rw4r\") on node \"ip-10-0-139-192.ec2.internal\" DevicePath \"\"" May 26 20:00:04.002218 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:00:04.002180 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663760-czvb4" event={"ID":"aa8ab5d7-21a8-443c-a90e-7ca8c74d8ae3","Type":"ContainerDied","Data":"b4902d6e17cb562dcbcba1ed5fd31209a9764421cd8b29f86576ffe7a3f719be"} May 26 20:00:04.002218 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:00:04.002210 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663760-czvb4" May 26 20:00:04.002218 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:00:04.002223 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b4902d6e17cb562dcbcba1ed5fd31209a9764421cd8b29f86576ffe7a3f719be" May 26 20:07:02.632091 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:02.632058 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b9c7f566-v989v_bb6fa5b9-b1a4-49c7-84a6-3e58b73efa0a/authorino/0.log" May 26 20:07:07.338225 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:07.338196 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29663745-27kf7_5a520b6b-cf51-4e56-b65b-5550cc1c1981/cleanup/0.log" May 26 20:07:07.447837 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:07.447803 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29663760-czvb4_aa8ab5d7-21a8-443c-a90e-7ca8c74d8ae3/cleanup/0.log" May 26 20:07:07.568112 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:07.568081 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5656c94d98-2756w_77af5fad-4b9f-4546-81c4-bfb26e9f4299/manager/0.log" May 26 20:07:07.797705 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:07.797674 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94b8b45bb-7kbpp_f62ce15e-c048-4085-ab5a-bab25e13e876/manager/0.log" May 26 20:07:08.146380 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:08.146352 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-mzh9b_829bcfac-ad3b-436d-9a9c-f9037404eba4/postgres/0.log" May 26 20:07:08.940888 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:08.940861 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm_c3a1dc18-5889-42d2-9c98-a068167022cb/util/0.log" May 26 20:07:08.947511 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:08.947490 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm_c3a1dc18-5889-42d2-9c98-a068167022cb/pull/0.log" May 26 20:07:08.953730 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:08.953712 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm_c3a1dc18-5889-42d2-9c98-a068167022cb/extract/0.log" May 26 20:07:09.065172 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:09.065142 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k_a7c8df20-322f-42cf-9781-f05b4325c9a1/util/0.log" May 26 20:07:09.070916 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:09.070884 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k_a7c8df20-322f-42cf-9781-f05b4325c9a1/pull/0.log" May 26 20:07:09.076283 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:09.076268 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k_a7c8df20-322f-42cf-9781-f05b4325c9a1/extract/0.log" May 26 20:07:09.187818 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:09.187790 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf_c5c6a83e-3823-4d5d-93c4-62801527549b/util/0.log" May 26 20:07:09.193971 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:09.193910 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf_c5c6a83e-3823-4d5d-93c4-62801527549b/pull/0.log" May 26 20:07:09.200008 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:09.199986 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf_c5c6a83e-3823-4d5d-93c4-62801527549b/extract/0.log" May 26 20:07:09.318698 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:09.318663 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc_f5deffd3-7ce2-4a96-ae8e-b18c404a2f82/util/0.log" May 26 20:07:09.325014 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:09.324986 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc_f5deffd3-7ce2-4a96-ae8e-b18c404a2f82/pull/0.log" May 26 20:07:09.331420 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:09.331401 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc_f5deffd3-7ce2-4a96-ae8e-b18c404a2f82/extract/0.log" May 26 20:07:09.442180 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:09.442149 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b9c7f566-v989v_bb6fa5b9-b1a4-49c7-84a6-3e58b73efa0a/authorino/0.log" May 26 20:07:09.797029 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:09.797004 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-vfn4l_625174be-714e-4a82-b33b-dfe1709752c3/kuadrant-console-plugin/0.log" May 26 20:07:10.972041 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:10.972013 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59cf57849b-fg6kt_f8289a95-e6e5-43a9-809f-75dc20e065fe/kube-auth-proxy/0.log" May 26 20:07:11.207703 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:11.207673 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-lls7f_c5c410ca-b1c4-46a4-bbd1-a405f7d3a595/payload-processing/0.log" May 26 20:07:11.904164 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:11.904137 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-qjkg8_b61c7a36-72e7-4d2a-a3ff-f92cff990dd1/storage-initializer/0.log" May 26 20:07:11.910409 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:11.910381 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-qjkg8_b61c7a36-72e7-4d2a-a3ff-f92cff990dd1/main/0.log" May 26 20:07:16.583674 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:16.583640 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gpbg8/must-gather-npfk2"] May 26 20:07:16.584130 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:16.584114 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa8ab5d7-21a8-443c-a90e-7ca8c74d8ae3" containerName="cleanup" May 26 20:07:16.584173 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:16.584133 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa8ab5d7-21a8-443c-a90e-7ca8c74d8ae3" containerName="cleanup" May 26 20:07:16.584233 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:16.584219 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="aa8ab5d7-21a8-443c-a90e-7ca8c74d8ae3" containerName="cleanup" May 26 20:07:16.587244 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:16.587225 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gpbg8/must-gather-npfk2" May 26 20:07:16.589885 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:16.589866 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gpbg8\"/\"openshift-service-ca.crt\"" May 26 20:07:16.590880 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:16.590859 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gpbg8\"/\"default-dockercfg-bq52n\"" May 26 20:07:16.590998 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:16.590867 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gpbg8\"/\"kube-root-ca.crt\"" May 26 20:07:16.602124 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:16.602097 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gpbg8/must-gather-npfk2"] May 26 20:07:16.623578 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:16.623548 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d0b12648-01d7-4b11-977f-d64348806adf-must-gather-output\") pod \"must-gather-npfk2\" (UID: \"d0b12648-01d7-4b11-977f-d64348806adf\") " pod="openshift-must-gather-gpbg8/must-gather-npfk2" May 26 20:07:16.623730 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:16.623591 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-776sp\" (UniqueName: \"kubernetes.io/projected/d0b12648-01d7-4b11-977f-d64348806adf-kube-api-access-776sp\") pod \"must-gather-npfk2\" (UID: \"d0b12648-01d7-4b11-977f-d64348806adf\") " pod="openshift-must-gather-gpbg8/must-gather-npfk2" May 26 20:07:16.724427 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:16.724387 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d0b12648-01d7-4b11-977f-d64348806adf-must-gather-output\") pod \"must-gather-npfk2\" (UID: \"d0b12648-01d7-4b11-977f-d64348806adf\") " pod="openshift-must-gather-gpbg8/must-gather-npfk2" May 26 20:07:16.724616 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:16.724453 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-776sp\" (UniqueName: \"kubernetes.io/projected/d0b12648-01d7-4b11-977f-d64348806adf-kube-api-access-776sp\") pod \"must-gather-npfk2\" (UID: \"d0b12648-01d7-4b11-977f-d64348806adf\") " pod="openshift-must-gather-gpbg8/must-gather-npfk2" May 26 20:07:16.724746 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:16.724727 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d0b12648-01d7-4b11-977f-d64348806adf-must-gather-output\") pod \"must-gather-npfk2\" (UID: \"d0b12648-01d7-4b11-977f-d64348806adf\") " pod="openshift-must-gather-gpbg8/must-gather-npfk2" May 26 20:07:16.743691 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:16.743663 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-776sp\" (UniqueName: \"kubernetes.io/projected/d0b12648-01d7-4b11-977f-d64348806adf-kube-api-access-776sp\") pod \"must-gather-npfk2\" (UID: \"d0b12648-01d7-4b11-977f-d64348806adf\") " pod="openshift-must-gather-gpbg8/must-gather-npfk2" May 26 20:07:16.896137 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:16.896103 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gpbg8/must-gather-npfk2" May 26 20:07:17.034550 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:17.034522 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gpbg8/must-gather-npfk2"] May 26 20:07:17.035530 ip-10-0-139-192 kubenswrapper[2578]: W0526 20:07:17.035507 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0b12648_01d7_4b11_977f_d64348806adf.slice/crio-d786e9d57062faf0cd283d069146c6b1b669a7762bdf85846f8b05550011dff8 WatchSource:0}: Error finding container d786e9d57062faf0cd283d069146c6b1b669a7762bdf85846f8b05550011dff8: Status 404 returned error can't find the container with id d786e9d57062faf0cd283d069146c6b1b669a7762bdf85846f8b05550011dff8 May 26 20:07:17.037291 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:17.037275 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 20:07:17.770896 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:17.770862 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gpbg8/must-gather-npfk2" event={"ID":"d0b12648-01d7-4b11-977f-d64348806adf","Type":"ContainerStarted","Data":"d786e9d57062faf0cd283d069146c6b1b669a7762bdf85846f8b05550011dff8"} May 26 20:07:18.780541 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:18.778937 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gpbg8/must-gather-npfk2" event={"ID":"d0b12648-01d7-4b11-977f-d64348806adf","Type":"ContainerStarted","Data":"f3a9ac0f98a835d1faeed52a90feeb1ced81c9d0358363cee1a4740c294fe321"} May 26 20:07:18.780541 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:18.778984 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gpbg8/must-gather-npfk2" event={"ID":"d0b12648-01d7-4b11-977f-d64348806adf","Type":"ContainerStarted","Data":"0fb5e8a92b236924f79fc818add89859f27fc9b939954fd8cef86cb4b476443b"} May 26 20:07:19.309453 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:19.309349 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nsldl_b26939e2-27a6-4dfa-aaa5-85fe72fafe89/global-pull-secret-syncer/0.log" May 26 20:07:19.389884 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:19.389857 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-84vtm_c43aa978-84ce-44cf-925a-d7fca81bae38/konnectivity-agent/0.log" May 26 20:07:19.499936 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:19.499890 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-192.ec2.internal_9debf8db6ecc45306c3a0d95b6812bb8/haproxy/0.log" May 26 20:07:23.476229 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:23.476193 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm_c3a1dc18-5889-42d2-9c98-a068167022cb/extract/0.log" May 26 20:07:23.495977 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:23.495929 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm_c3a1dc18-5889-42d2-9c98-a068167022cb/util/0.log" May 26 20:07:23.516376 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:23.516347 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g86pm_c3a1dc18-5889-42d2-9c98-a068167022cb/pull/0.log" May 26 20:07:23.540558 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:23.540479 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k_a7c8df20-322f-42cf-9781-f05b4325c9a1/extract/0.log" May 26 20:07:23.562604 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:23.562508 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k_a7c8df20-322f-42cf-9781-f05b4325c9a1/util/0.log" May 26 20:07:23.581038 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:23.581009 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06q22k_a7c8df20-322f-42cf-9781-f05b4325c9a1/pull/0.log" May 26 20:07:23.605414 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:23.605387 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf_c5c6a83e-3823-4d5d-93c4-62801527549b/extract/0.log" May 26 20:07:23.624366 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:23.624340 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf_c5c6a83e-3823-4d5d-93c4-62801527549b/util/0.log" May 26 20:07:23.644414 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:23.644382 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4hhf_c5c6a83e-3823-4d5d-93c4-62801527549b/pull/0.log" May 26 20:07:23.672439 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:23.672312 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc_f5deffd3-7ce2-4a96-ae8e-b18c404a2f82/extract/0.log" May 26 20:07:23.697067 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:23.697036 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc_f5deffd3-7ce2-4a96-ae8e-b18c404a2f82/util/0.log" May 26 20:07:23.732075 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:23.731969 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18jwvc_f5deffd3-7ce2-4a96-ae8e-b18c404a2f82/pull/0.log" May 26 20:07:24.009414 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:24.009216 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b9c7f566-v989v_bb6fa5b9-b1a4-49c7-84a6-3e58b73efa0a/authorino/0.log" May 26 20:07:24.081063 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:24.081028 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-vfn4l_625174be-714e-4a82-b33b-dfe1709752c3/kuadrant-console-plugin/0.log" May 26 20:07:25.591857 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:25.591766 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8dcb7ac5-eda1-4500-8585-0dbca800596a/alertmanager/0.log" May 26 20:07:25.623134 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:25.623105 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8dcb7ac5-eda1-4500-8585-0dbca800596a/config-reloader/0.log" May 26 20:07:25.648239 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:25.648206 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8dcb7ac5-eda1-4500-8585-0dbca800596a/kube-rbac-proxy-web/0.log" May 26 20:07:25.673528 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:25.673498 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8dcb7ac5-eda1-4500-8585-0dbca800596a/kube-rbac-proxy/0.log" May 26 20:07:25.695077 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:25.695044 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8dcb7ac5-eda1-4500-8585-0dbca800596a/kube-rbac-proxy-metric/0.log" May 26 20:07:25.719133 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:25.719060 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8dcb7ac5-eda1-4500-8585-0dbca800596a/prom-label-proxy/0.log" May 26 20:07:25.740713 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:25.740685 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8dcb7ac5-eda1-4500-8585-0dbca800596a/init-config-reloader/0.log" May 26 20:07:25.803702 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:25.803670 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-rcpxj_56b5862b-6b1c-4902-b40c-ef9022c5f5b5/kube-state-metrics/0.log" May 26 20:07:25.826029 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:25.825988 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-rcpxj_56b5862b-6b1c-4902-b40c-ef9022c5f5b5/kube-rbac-proxy-main/0.log" May 26 20:07:25.850235 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:25.850191 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-rcpxj_56b5862b-6b1c-4902-b40c-ef9022c5f5b5/kube-rbac-proxy-self/0.log" May 26 20:07:25.881002 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:25.880973 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-9f456bbb-626mn_3dca64ef-e955-4cef-a8d4-193fe2378c11/metrics-server/0.log" May 26 20:07:25.910759 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:25.910730 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-qkbhh_ff768363-8e4e-44c8-8b36-7077f16b5128/monitoring-plugin/0.log" May 26 20:07:25.944123 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:25.944090 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f47x8_95db239a-8064-4562-bc79-24aceb39eabc/node-exporter/0.log" May 26 20:07:25.963772 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:25.963719 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f47x8_95db239a-8064-4562-bc79-24aceb39eabc/kube-rbac-proxy/0.log" May 26 20:07:25.992858 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:25.992770 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f47x8_95db239a-8064-4562-bc79-24aceb39eabc/init-textfile/0.log" May 26 20:07:26.151313 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:26.151258 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-x8z9m_6d4ee97d-ba1e-479e-a42c-eb682fc511bf/kube-rbac-proxy-main/0.log" May 26 20:07:26.172458 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:26.172424 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-x8z9m_6d4ee97d-ba1e-479e-a42c-eb682fc511bf/kube-rbac-proxy-self/0.log" May 26 20:07:26.193370 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:26.193340 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-x8z9m_6d4ee97d-ba1e-479e-a42c-eb682fc511bf/openshift-state-metrics/0.log" May 26 20:07:26.381374 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:26.381284 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-jjgpv_c341c15c-dd66-4ef9-9b86-aaf5a30bf57f/prometheus-operator/0.log" May 26 20:07:26.401815 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:26.401787 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-jjgpv_c341c15c-dd66-4ef9-9b86-aaf5a30bf57f/kube-rbac-proxy/0.log" May 26 20:07:26.541537 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:26.541511 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cdf89bb4f-28xz4_aa143360-9d1f-4c98-b904-3625128bb74f/thanos-query/0.log" May 26 20:07:26.563856 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:26.563817 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cdf89bb4f-28xz4_aa143360-9d1f-4c98-b904-3625128bb74f/kube-rbac-proxy-web/0.log" May 26 20:07:26.592687 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:26.592659 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cdf89bb4f-28xz4_aa143360-9d1f-4c98-b904-3625128bb74f/kube-rbac-proxy/0.log" May 26 20:07:26.612471 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:26.612435 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cdf89bb4f-28xz4_aa143360-9d1f-4c98-b904-3625128bb74f/prom-label-proxy/0.log" May 26 20:07:26.631938 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:26.631857 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cdf89bb4f-28xz4_aa143360-9d1f-4c98-b904-3625128bb74f/kube-rbac-proxy-rules/0.log" May 26 20:07:26.653496 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:26.653468 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cdf89bb4f-28xz4_aa143360-9d1f-4c98-b904-3625128bb74f/kube-rbac-proxy-metrics/0.log" May 26 20:07:28.201554 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:28.201487 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-gpbg8/must-gather-npfk2" podStartSLOduration=11.500002794 podStartE2EDuration="12.201465287s" podCreationTimestamp="2026-05-26 20:07:16 +0000 UTC" firstStartedPulling="2026-05-26 20:07:17.037419863 +0000 UTC m=+2501.571392625" lastFinishedPulling="2026-05-26 20:07:17.738882353 +0000 UTC m=+2502.272855118" observedRunningTime="2026-05-26 20:07:18.796423566 +0000 UTC m=+2503.330396351" watchObservedRunningTime="2026-05-26 20:07:28.201465287 +0000 UTC m=+2512.735438072" May 26 20:07:28.202498 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:28.202475 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gpbg8/perf-node-gather-daemonset-wgvlc"] May 26 20:07:28.208813 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:28.208787 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-wgvlc" May 26 20:07:28.214636 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:28.214610 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gpbg8/perf-node-gather-daemonset-wgvlc"] May 26 20:07:28.245404 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:28.245346 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2c5442a-36f8-4caa-aeae-b794fdccd7ec-lib-modules\") pod \"perf-node-gather-daemonset-wgvlc\" (UID: \"c2c5442a-36f8-4caa-aeae-b794fdccd7ec\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-wgvlc" May 26 20:07:28.245589 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:28.245467 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd6xh\" (UniqueName: \"kubernetes.io/projected/c2c5442a-36f8-4caa-aeae-b794fdccd7ec-kube-api-access-hd6xh\") pod \"perf-node-gather-daemonset-wgvlc\" (UID: \"c2c5442a-36f8-4caa-aeae-b794fdccd7ec\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-wgvlc" May 26 20:07:28.245589 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:28.245504 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2c5442a-36f8-4caa-aeae-b794fdccd7ec-sys\") pod \"perf-node-gather-daemonset-wgvlc\" (UID: \"c2c5442a-36f8-4caa-aeae-b794fdccd7ec\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-wgvlc" May 26 20:07:28.245589 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:28.245566 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c2c5442a-36f8-4caa-aeae-b794fdccd7ec-podres\") pod \"perf-node-gather-daemonset-wgvlc\" (UID: \"c2c5442a-36f8-4caa-aeae-b794fdccd7ec\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-wgvlc" May 26 20:07:28.245774 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:28.245593 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c2c5442a-36f8-4caa-aeae-b794fdccd7ec-proc\") pod \"perf-node-gather-daemonset-wgvlc\" (UID: \"c2c5442a-36f8-4caa-aeae-b794fdccd7ec\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-wgvlc" May 26 20:07:28.347218 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:28.347161 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c2c5442a-36f8-4caa-aeae-b794fdccd7ec-podres\") pod \"perf-node-gather-daemonset-wgvlc\" (UID: \"c2c5442a-36f8-4caa-aeae-b794fdccd7ec\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-wgvlc" May 26 20:07:28.347218 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:28.347217 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c2c5442a-36f8-4caa-aeae-b794fdccd7ec-proc\") pod \"perf-node-gather-daemonset-wgvlc\" (UID: \"c2c5442a-36f8-4caa-aeae-b794fdccd7ec\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-wgvlc" May 26 20:07:28.347515 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:28.347286 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2c5442a-36f8-4caa-aeae-b794fdccd7ec-lib-modules\") pod \"perf-node-gather-daemonset-wgvlc\" (UID: \"c2c5442a-36f8-4caa-aeae-b794fdccd7ec\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-wgvlc" May 26 20:07:28.347515 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:28.347311 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c2c5442a-36f8-4caa-aeae-b794fdccd7ec-proc\") pod \"perf-node-gather-daemonset-wgvlc\" (UID: \"c2c5442a-36f8-4caa-aeae-b794fdccd7ec\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-wgvlc" May 26 20:07:28.347515 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:28.347355 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c2c5442a-36f8-4caa-aeae-b794fdccd7ec-podres\") pod \"perf-node-gather-daemonset-wgvlc\" (UID: \"c2c5442a-36f8-4caa-aeae-b794fdccd7ec\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-wgvlc" May 26 20:07:28.347515 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:28.347360 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hd6xh\" (UniqueName: \"kubernetes.io/projected/c2c5442a-36f8-4caa-aeae-b794fdccd7ec-kube-api-access-hd6xh\") pod \"perf-node-gather-daemonset-wgvlc\" (UID: \"c2c5442a-36f8-4caa-aeae-b794fdccd7ec\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-wgvlc" May 26 20:07:28.347515 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:28.347417 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2c5442a-36f8-4caa-aeae-b794fdccd7ec-sys\") pod \"perf-node-gather-daemonset-wgvlc\" (UID: \"c2c5442a-36f8-4caa-aeae-b794fdccd7ec\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-wgvlc" May 26 20:07:28.347802 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:28.347544 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2c5442a-36f8-4caa-aeae-b794fdccd7ec-sys\") pod \"perf-node-gather-daemonset-wgvlc\" (UID: \"c2c5442a-36f8-4caa-aeae-b794fdccd7ec\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-wgvlc" May 26 20:07:28.347802 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:28.347552 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2c5442a-36f8-4caa-aeae-b794fdccd7ec-lib-modules\") pod \"perf-node-gather-daemonset-wgvlc\" (UID: \"c2c5442a-36f8-4caa-aeae-b794fdccd7ec\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-wgvlc" May 26 20:07:28.355920 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:28.355878 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd6xh\" (UniqueName: \"kubernetes.io/projected/c2c5442a-36f8-4caa-aeae-b794fdccd7ec-kube-api-access-hd6xh\") pod \"perf-node-gather-daemonset-wgvlc\" (UID: \"c2c5442a-36f8-4caa-aeae-b794fdccd7ec\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-wgvlc" May 26 20:07:28.524736 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:28.524633 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-wgvlc" May 26 20:07:28.703344 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:28.701281 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gpbg8/perf-node-gather-daemonset-wgvlc"] May 26 20:07:28.721389 ip-10-0-139-192 kubenswrapper[2578]: W0526 20:07:28.718359 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc2c5442a_36f8_4caa_aeae_b794fdccd7ec.slice/crio-859fcc7bd59d04b13345c8c7b8f98a79679d9edce00f2e8f1bb7fed4ab23637b WatchSource:0}: Error finding container 859fcc7bd59d04b13345c8c7b8f98a79679d9edce00f2e8f1bb7fed4ab23637b: Status 404 returned error can't find the container with id 859fcc7bd59d04b13345c8c7b8f98a79679d9edce00f2e8f1bb7fed4ab23637b May 26 20:07:28.749163 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:28.749138 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-754d675fd8-rblrv_652d45ca-19b5-404f-af0c-da7d3edcda26/console/0.log" May 26 20:07:28.779447 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:28.779366 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-ff7jc_4f8b8e1d-613a-42d9-be26-7d0e14b5dc41/download-server/0.log" May 26 20:07:28.860455 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:28.860397 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-wgvlc" event={"ID":"c2c5442a-36f8-4caa-aeae-b794fdccd7ec","Type":"ContainerStarted","Data":"859fcc7bd59d04b13345c8c7b8f98a79679d9edce00f2e8f1bb7fed4ab23637b"} May 26 20:07:29.867488 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:29.867447 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-wgvlc" event={"ID":"c2c5442a-36f8-4caa-aeae-b794fdccd7ec","Type":"ContainerStarted","Data":"e3f445f6fd916c61acff7a38cd682c2d5f801dab47bd9c5b257e0ea11dbd14d1"} May 26 20:07:29.867930 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:29.867711 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-wgvlc" May 26 20:07:29.884470 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:29.884422 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-wgvlc" podStartSLOduration=1.884405171 podStartE2EDuration="1.884405171s" podCreationTimestamp="2026-05-26 20:07:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 20:07:29.881999081 +0000 UTC m=+2514.415971873" watchObservedRunningTime="2026-05-26 20:07:29.884405171 +0000 UTC m=+2514.418377954" May 26 20:07:30.041556 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:30.041524 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d9w79_3346df9a-a455-49fe-8602-808efc59cadc/dns/0.log" May 26 20:07:30.060115 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:30.060083 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d9w79_3346df9a-a455-49fe-8602-808efc59cadc/kube-rbac-proxy/0.log" May 26 20:07:30.157450 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:30.157423 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ggpg7_20a5cc5f-5de0-4de6-802a-cf1bcb303748/dns-node-resolver/0.log" May 26 20:07:30.691808 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:30.691783 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bjdfl_582de6bd-0ed1-4a29-b96e-f8825f9df04f/node-ca/0.log" May 26 20:07:31.618737 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:31.618709 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59cf57849b-fg6kt_f8289a95-e6e5-43a9-809f-75dc20e065fe/kube-auth-proxy/0.log" May 26 20:07:31.751088 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:31.751057 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-lls7f_c5c410ca-b1c4-46a4-bbd1-a405f7d3a595/payload-processing/0.log" May 26 20:07:32.277948 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:32.277918 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s6nbq_508f26c0-895c-41a4-ad07-6119ac41ab6a/serve-healthcheck-canary/0.log" May 26 20:07:32.783844 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:32.783817 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kcfsc_20b0cef4-e410-41b5-a73e-516948fe3616/kube-rbac-proxy/0.log" May 26 20:07:32.804106 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:32.804080 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kcfsc_20b0cef4-e410-41b5-a73e-516948fe3616/exporter/0.log" May 26 20:07:32.821782 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:32.821756 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kcfsc_20b0cef4-e410-41b5-a73e-516948fe3616/extractor/0.log" May 26 20:07:34.826980 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:34.826948 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29663745-27kf7_5a520b6b-cf51-4e56-b65b-5550cc1c1981/cleanup/0.log" May 26 20:07:34.850358 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:34.850312 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29663760-czvb4_aa8ab5d7-21a8-443c-a90e-7ca8c74d8ae3/cleanup/0.log" May 26 20:07:34.925948 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:34.925921 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5656c94d98-2756w_77af5fad-4b9f-4546-81c4-bfb26e9f4299/manager/0.log" May 26 20:07:34.980075 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:34.979901 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94b8b45bb-7kbpp_f62ce15e-c048-4085-ab5a-bab25e13e876/manager/0.log" May 26 20:07:35.070240 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:35.070205 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-mzh9b_829bcfac-ad3b-436d-9a9c-f9037404eba4/postgres/0.log" May 26 20:07:35.882681 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:35.882656 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-wgvlc" May 26 20:07:36.318877 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:36.318849 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6f8b76d9f6-kgvzk_35a48417-4435-4bbe-ad35-a31207ea1f50/manager/0.log" May 26 20:07:40.738853 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:40.738821 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-fdvw4_6fd28605-975d-4692-895c-c54c654a244e/migrator/0.log" May 26 20:07:40.755656 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:40.755622 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-fdvw4_6fd28605-975d-4692-895c-c54c654a244e/graceful-termination/0.log" May 26 20:07:41.135434 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:41.135282 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-dbpt4_e5da566c-d02a-4260-9b09-280863b75669/kube-storage-version-migrator-operator/1.log" May 26 20:07:41.136644 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:41.136620 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-dbpt4_e5da566c-d02a-4260-9b09-280863b75669/kube-storage-version-migrator-operator/0.log" May 26 20:07:42.367033 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:42.367005 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wtj5c_1cdc1bc5-00d9-435b-b4da-1c5352befce9/kube-multus-additional-cni-plugins/0.log" May 26 20:07:42.385298 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:42.385272 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wtj5c_1cdc1bc5-00d9-435b-b4da-1c5352befce9/egress-router-binary-copy/0.log" May 26 20:07:42.402725 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:42.402704 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wtj5c_1cdc1bc5-00d9-435b-b4da-1c5352befce9/cni-plugins/0.log" May 26 20:07:42.420059 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:42.420035 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wtj5c_1cdc1bc5-00d9-435b-b4da-1c5352befce9/bond-cni-plugin/0.log" May 26 20:07:42.440591 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:42.440562 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wtj5c_1cdc1bc5-00d9-435b-b4da-1c5352befce9/routeoverride-cni/0.log" May 26 20:07:42.458261 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:42.458238 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wtj5c_1cdc1bc5-00d9-435b-b4da-1c5352befce9/whereabouts-cni-bincopy/0.log" May 26 20:07:42.475262 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:42.475227 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wtj5c_1cdc1bc5-00d9-435b-b4da-1c5352befce9/whereabouts-cni/0.log" May 26 20:07:42.505747 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:42.505720 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nft6f_5b3e373a-26db-42d4-ae8b-08576159277d/kube-multus/0.log" May 26 20:07:42.647131 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:42.647094 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qsdsm_6ee8f53e-5d8f-4944-89c4-ed98b8fad590/network-metrics-daemon/0.log" May 26 20:07:42.662965 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:42.662940 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qsdsm_6ee8f53e-5d8f-4944-89c4-ed98b8fad590/kube-rbac-proxy/0.log" May 26 20:07:43.690977 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:43.690948 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k89dv_f0da33a6-a79c-40bb-ab52-0133a75f2f3a/ovn-controller/0.log" May 26 20:07:43.718069 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:43.718031 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k89dv_f0da33a6-a79c-40bb-ab52-0133a75f2f3a/ovn-acl-logging/0.log" May 26 20:07:43.738078 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:43.738048 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k89dv_f0da33a6-a79c-40bb-ab52-0133a75f2f3a/kube-rbac-proxy-node/0.log" May 26 20:07:43.757853 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:43.757828 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k89dv_f0da33a6-a79c-40bb-ab52-0133a75f2f3a/kube-rbac-proxy-ovn-metrics/0.log" May 26 20:07:43.772823 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:43.772782 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k89dv_f0da33a6-a79c-40bb-ab52-0133a75f2f3a/northd/0.log" May 26 20:07:43.791922 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:43.791893 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k89dv_f0da33a6-a79c-40bb-ab52-0133a75f2f3a/nbdb/0.log" May 26 20:07:43.810049 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:43.810019 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k89dv_f0da33a6-a79c-40bb-ab52-0133a75f2f3a/sbdb/0.log" May 26 20:07:43.932989 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:43.932959 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k89dv_f0da33a6-a79c-40bb-ab52-0133a75f2f3a/ovnkube-controller/0.log" May 26 20:07:45.259632 ip-10-0-139-192 kubenswrapper[2578]: I0526 20:07:45.259605 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-87j6z_4e8c295a-8845-4441-b1b8-6acb0b485589/network-check-target-container/0.log"